Lavan, N., Smith, H. ORCID: 0000-0003-2712-5527 and McGettigan, C., 2021. Unimodal and cross-modal identity judgements using an audiovisual sorting task: Evidence for independent processing of faces and voices. Memory and Cognition. ISSN 0090-502X
|
Text
1444323_Smith.pdf - Post-print Download (705kB) | Preview |
Abstract
Unimodal and cross-modal information provided by faces and voices contribute to identity percepts. To examine how these sources of information interact, we devised a novel audiovisual sorting task in which participants were required to group video-only and audio-only clips into two identities. In a series of three experiments, we show that unimodal face and voice sorting were more accurate than cross-modal sorting accuracy: While face sorting was consistently most accurate followed by voice sorting, cross-modal sorting was at chancel-level or below. In Experiment 1, we compared performance in our novel audiovisual sorting task to a traditional identity matching task, showing that unimodal and cross-modal identity perception were overall moderately more accurate the traditional identity matching task. In Experiment 2, separating unimodal from cross-modal sorting led to small improvements in accuracy for unimodal sorting, but no change in cross-modal sorting performance. In Experiment 3 we explored the effect of minimal audiovisual training: Participants were shown a clip of the two identities in conversation prior to completing the sorting task. This led to small, non-significant improvements in accuracy for unimodal and cross-modal sorting. Our results indicate that unfamiliar face and voice perception operate relatively independently with no evidence of mutual benefit, suggesting that extracting reliable cross-modal identity information is challenging.
Item Type: | Journal article | ||||||
---|---|---|---|---|---|---|---|
Publication Title: | Memory and Cognition | ||||||
Creators: | Lavan, N., Smith, H. and McGettigan, C. | ||||||
Publisher: | Springer Verlag | ||||||
Date: | 12 July 2021 | ||||||
ISSN: | 0090-502X | ||||||
Identifiers: |
|
||||||
Rights: | Post-prints are subject to Springer Nature re-use terms | ||||||
Divisions: | Schools > School of Social Sciences | ||||||
Record created by: | Laura Ward | ||||||
Date Added: | 08 Jun 2021 11:43 | ||||||
Last Modified: | 12 Jul 2022 03:00 | ||||||
URI: | https://irep.ntu.ac.uk/id/eprint/43024 |
Actions (login required)
Edit View |
Views
Views per month over past year
Downloads
Downloads per month over past year