Face and voice identity matching accuracy is not improved by multimodal identity information

Smith, HMJ ORCID: https://orcid.org/0000-0003-2712-5527, Ritchie, KL, Baguley, TS ORCID: https://orcid.org/0000-0002-0477-2492 and Lavan, N, 2024. Face and voice identity matching accuracy is not improved by multimodal identity information. British Journal of Psychology. ISSN 0007-1269

Preview

Text 2328989_Smith.pdf - Published version Download (704kB) | Preview

Abstract

Identity verification from both faces and voices can be error-prone. Previous research has shown that faces and voices signal concordant information and cross-modal unfamiliar face-to-voice matching is possible, albeit often with low accuracy. In the current study, we ask whether performance on a face or voice identity matching task can be improved by using multimodal stimuli which add a second modality (voice or face). We find that overall accuracy is higher for face matching than for voice matching. However, contrary to predictions, presenting one unimodal and one multimodal stimulus within a matching task did not improve face or voice matching compared to presenting two unimodal stimuli. Additionally, we find that presenting two multimodal stimuli does not improve accuracy compared to presenting two unimodal face stimuli. Thus, multimodal information does not improve accuracy. However, intriguingly, we find that cross-modal face-voice matching accuracy predicts voice matching accuracy but not face matching accuracy. This suggests cross-modal information can nonetheless play a role in identity matching, and face and voice information combine to inform matching decisions. We discuss our findings in light of current models of person perception, and consider the implications for identity verification in security and forensic settings.

Item Type:	Journal article
Publication Title:	British Journal of Psychology
Creators:	Smith, H.M.J., Ritchie, K.L., Baguley, T.S. and Lavan, N.
Publisher:	Wiley
Date:	17 December 2024
ISSN:	0007-1269
Identifiers:	Number Type 10.1111/bjop.12757 DOI 2328989 Other
Rights:	© 2024 The Author(s). British Journal of Psychology published by John Wiley & Sons Ltd on behalf of The British Psychological Society. This is an open access article under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
Divisions:	Schools > School of Social Sciences
Record created by:	Laura Ward
Date Added:	20 Dec 2024 13:48
Last Modified:	20 Dec 2024 13:48
URI:	https://irep.ntu.ac.uk/id/eprint/52751

Actions (login required)

Edit View

Statistics

Views

Downloads