Matching novel face and voice identity using static and dynamic facial images

Smith, H.M.J. ORCID: 0000-0003-2712-5527, 2016. Matching novel face and voice identity using static and dynamic facial images. PhD, Nottingham Trent University.

Preview

Text Harriet.Smith-2016.pdf - Published version Download (8MB) | Preview

Abstract

Research suggests that both static and dynamic faces share identity information with voices. However, face-voice matching studies offer contradictory results. Accurate face-voice matching is consistently above chance when facial stimuli are dynamic, but not when facial stimuli are static. This thesis aims to account for previous inconsistencies, comparing accuracy across a variety of two-alternative forced-choice (2AFC) procedures to isolate the features that support accuracy. In addition, the thesis provides a clearer and more complete picture of face-voice matching ability than that available in the existing literature. Samedifferent procedures are used to address original research questions relating to response bias and the delay between face and voice presentation. The overall findings indicate that faces and voices offer concordant source identity information. When faces and voices are presented close together in time, matching accuracy is consistently above chance level using both dynamic and static facial stimuli. Previous contradictory findings across studies can be accounted for by procedural differences and the characteristics of specific stimulus sets. Multilevel modelling analyses show that some people look and sound more similar than others. The results also indicate that when there is only a short (~1 second) interval between faces and voices, people exhibit a bias to assume that they belong to the same person. The findings presented in this thesis have theoretical and applied relevance. They highlight the value of considering person perception from a multimodal point of view, and are consistent with evidence for the existence of early perceptual integrative mechanisms between face and voice processing pathways. The results also offer insights into how people successfully navigate complex social situations featuring a number of novel speakers.

Item Type:	Thesis
Creators:	Smith, H.M.J.
Date:	May 2016
Rights:	This work is the intellectual property of the author. You may copy up to 5% of this work for private study, or personal, non-commercial research. Any re-use of the information contained within this document should be fully referenced, quoting the author, title, university, degree level and pagination. Queries or requests for any other use, or if a more substantial copy is required, should be directed to the owner(s) of the Intellectual Property Rights.
Divisions:	Schools > School of Social Sciences
Record created by:	Linda Sullivan
Date Added:	01 Nov 2016 14:42
Last Modified:	09 Jun 2017 14:08
URI:	https://irep.ntu.ac.uk/id/eprint/29001

Actions (login required)

Edit View

Views

Downloads