Unimodal and cross-modal identity judgements using an audiovisual sorting task: Evidence for independent processing of faces and voices

Lavan, N, Smith, H ORCID: https://orcid.org/0000-0003-2712-5527 and McGettigan, C, 2021. Unimodal and cross-modal identity judgements using an audiovisual sorting task: Evidence for independent processing of faces and voices. Memory and Cognition. ISSN 0090-502X

Preview

Text 1444323_Smith.pdf - Post-print Download (705kB) | Preview

Abstract

Unimodal and cross-modal information provided by faces and voices contribute to identity percepts. To examine how these sources of information interact, we devised a novel audiovisual sorting task in which participants were required to group video-only and audio-only clips into two identities. In a series of three experiments, we show that unimodal face and voice sorting were more accurate than cross-modal sorting accuracy: While face sorting was consistently most accurate followed by voice sorting, cross-modal sorting was at chancel-level or below. In Experiment 1, we compared performance in our novel audiovisual sorting task to a traditional identity matching task, showing that unimodal and cross-modal identity perception were overall moderately more accurate the traditional identity matching task. In Experiment 2, separating unimodal from cross-modal sorting led to small improvements in accuracy for unimodal sorting, but no change in cross-modal sorting performance. In Experiment 3 we explored the effect of minimal audiovisual training: Participants were shown a clip of the two identities in conversation prior to completing the sorting task. This led to small, non-significant improvements in accuracy for unimodal and cross-modal sorting. Our results indicate that unfamiliar face and voice perception operate relatively independently with no evidence of mutual benefit, suggesting that extracting reliable cross-modal identity information is challenging.

Item Type:	Journal article
Publication Title:	Memory and Cognition
Creators:	Lavan, N., Smith, H. and McGettigan, C.
Publisher:	Springer Verlag
Date:	12 July 2021
ISSN:	0090-502X
Identifiers:	Number Type 10.3758/s13421-021-01198-7 DOI 1444323 Other
Rights:	Post-prints are subject to Springer Nature re-use terms
Divisions:	Schools > School of Social Sciences
Record created by:	Laura Ward
Date Added:	08 Jun 2021 11:43
Last Modified:	12 Jul 2022 03:00
URI:	https://irep.ntu.ac.uk/id/eprint/43024

Actions (login required)

Edit View

Statistics

Views

Downloads