A single modality apparent first impression personality recognition model with temporal emotion based LSTM

Wang, J, Li, H, Woo, WL and Shan, S ORCID: https://orcid.org/0000-0003-4928-588X, 2025. A single modality apparent first impression personality recognition model with temporal emotion based LSTM. Expert Systems with Applications, 259: 125114. ISSN 0957-4174

Full text not available from this repository.

Abstract

Apparent first impression prediction has made great progress with deep neural networks. There is a trend for multimodal fusion where features from different sources are fused together to improve the accuracy of the prediction. However, in a real-life scenario, it is often hard to gather features from different sources such as audio and background information. It is desirable to develop a method that could improve the prediction accuracy from a single source rather than multiple sources. This study developed a method to predict personality traits from a single source of information, i.e., facial information. Specifically, a pre-trained Deep Convolutional Neural Network was employed to extract emotional expression frame by frame in the video clip, which was then fed into a Long Short Term Memory model to predict the “Big Five” personality traits score. In Parallel, the model based on the static apparent facial features was trained, and finally, the facial feature and facial expression were fused with demographic data (age and gender). The proposed system is tested on the CharLearn Dataset and achieved an accuracy score of 90.67% ranked just below the top 5 CharLearn Competition. The result also showed that the dynamic emotional pattern has a positive impact on first impression prediction, especially on extraversion.

Item Type:	Journal article
Publication Title:	Expert Systems with Applications
Creators:	Wang, J., Li, H., Woo, W.L. and Shan, S.
Publisher:	Elsevier
Date:	January 2025
Volume:	259
ISSN:	0957-4174
Identifiers:	Number Type 10.1016/j.eswa.2024.125114 DOI S095741742401981X Publisher Item Identifier 2218392 Other
Rights:	This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
Divisions:	Schools > Nottingham Business School
Record created by:	Jonathan Gallacher
Date Added:	18 Sep 2024 14:34
Last Modified:	18 Sep 2024 14:34
URI:	https://irep.ntu.ac.uk/id/eprint/52260

Actions (login required)

Edit View

Statistics

Views

Downloads