Unimodal and cross-modal identity judgements using an audiovisual sorting task: Evidence for independent processing of faces and voices

Lavan, N., Smith, H. ORCID: 0000-0003-2712-5527 and McGettigan, C., 2021. Unimodal and cross-modal identity judgements using an audiovisual sorting task: Evidence for independent processing of faces and voices. Memory and Cognition. ISSN 0090-502X

[img]
Preview
Text
1444323_Smith.pdf - Post-print

Download (705kB) | Preview

Abstract

Unimodal and cross-modal information provided by faces and voices contribute to identity percepts. To examine how these sources of information interact, we devised a novel audiovisual sorting task in which participants were required to group video-only and audio-only clips into two identities. In a series of three experiments, we show that unimodal face and voice sorting were more accurate than cross-modal sorting accuracy: While face sorting was consistently most accurate followed by voice sorting, cross-modal sorting was at chancel-level or below. In Experiment 1, we compared performance in our novel audiovisual sorting task to a traditional identity matching task, showing that unimodal and cross-modal identity perception were overall moderately more accurate the traditional identity matching task. In Experiment 2, separating unimodal from cross-modal sorting led to small improvements in accuracy for unimodal sorting, but no change in cross-modal sorting performance. In Experiment 3 we explored the effect of minimal audiovisual training: Participants were shown a clip of the two identities in conversation prior to completing the sorting task. This led to small, non-significant improvements in accuracy for unimodal and cross-modal sorting. Our results indicate that unfamiliar face and voice perception operate relatively independently with no evidence of mutual benefit, suggesting that extracting reliable cross-modal identity information is challenging.

Item Type: Journal article
Publication Title: Memory and Cognition
Creators: Lavan, N., Smith, H. and McGettigan, C.
Publisher: Springer Verlag
Date: 12 July 2021
ISSN: 0090-502X
Identifiers:
NumberType
10.3758/s13421-021-01198-7DOI
1444323Other
Rights: Post-prints are subject to Springer Nature re-use terms
Divisions: Schools > School of Social Sciences
Record created by: Laura Ward
Date Added: 08 Jun 2021 11:43
Last Modified: 12 Jul 2022 03:00
URI: https://irep.ntu.ac.uk/id/eprint/43024

Actions (login required)

Edit View Edit View

Views

Views per month over past year

Downloads

Downloads per month over past year