Unimodal and cross-modal identity judgements using an audiovisual sorting task: Evidence for independent processing of faces and voices

Lavan, N., Smith, H. ORCID: 0000-0003-2712-5527 and McGettigan, C., 2021. Unimodal and cross-modal identity judgements using an audiovisual sorting task: Evidence for independent processing of faces and voices. Memory and Cognition. ISSN 0090-502X (Forthcoming)

[img] Text
1444323_Smith.pdf - Post-print
Restricted to Repository staff only

Download (705kB)

Abstract

Unimodal and cross-modal information provided by faces and voices contribute to identity percepts. To examine how these sources of information interact, we devised a novel audiovisual sorting task in which participants were required to group video-only and audio-only clips into two identities. In a series of three experiments, we show that unimodal face and voice sorting were more accurate than cross-modal sorting accuracy: While face sorting was consistently most accurate followed by voice sorting, cross-modal sorting was at chancel-level or below. In Experiment 1, we compared performance in our novel audiovisual sorting task to a traditional identity matching task, showing that unimodal and cross-modal identity perception were overall moderately more accurate the traditional identity matching task. In Experiment 2, separating unimodal from cross-modal sorting led to small improvements in accuracy for unimodal sorting, but no change in cross-modal sorting performance. In Experiment 3 we explored the effect of minimal audiovisual training: Participants were shown a clip of the two identities in conversation prior to completing the sorting task. This led to small, non-significant improvements in accuracy for unimodal and cross-modal sorting. Our results indicate that unfamiliar face and voice perception operate relatively independently with no evidence of mutual benefit, suggesting that extracting reliable cross-modal identity information is challenging.

Item Type: Journal article
Publication Title: Memory and Cognition
Creators: Lavan, N., Smith, H. and McGettigan, C.
Publisher: Springer Verlag
Date: 2 June 2021
ISSN: 0090-502X
Identifiers:
NumberType
1444323Other
Divisions: Schools > School of Social Sciences
Record created by: Laura Ward
Date Added: 08 Jun 2021 11:43
Last Modified: 08 Jun 2021 11:43
URI: http://irep.ntu.ac.uk/id/eprint/43024

Actions (login required)

Edit View Edit View

Views

Views per month over past year

Downloads

Downloads per month over past year