Affective computing in computer vision: a study on facial expression recognition

Bird, JJ ORCID: https://orcid.org/0000-0002-9858-1231, Saputra, AA, Kubota, N and Lotfi, A ORCID: https://orcid.org/0000-0002-5139-6565, 2022. Affective computing in computer vision: a study on facial expression recognition. In: Proceedings: 2022 13th International Congress on Advanced Applied Informatics Winter IIAI-AAI-Winter 2022. IEEE, pp. 84-88. ISBN 9798350309928

Preview

Text 1764700_Lotfi.pdf - Post-print Download (238kB) | Preview

Abstract

The use of artificial intelligence has become increasingly popular in recent years, allowing technology once thought of as futuristic to become possible and utilised at the consumer level. Many technological barriers to human-computer interaction have been overcome, and there is now a focus on the sociological acceptance of such technology. Inferring human emotional states is a time-consuming process and can be automated with computer vision. In this study, we explore how computer vision and face recognition systems can be leveraged to automatically infer human emotional states from the face. Rather than the classical single-emotion classification method, our aim is to explore whether it is possible to perform regression techniques to observe valence and arousal. Following the topology tuning of 33 different neural networks, the results show that valence and arousal can be predicted by a branched Convolutional Neural Network model with a mean squared error of 0.066 and 0.107, respectively. In addition, we discuss methods of improving the model, as well as uses of the technology, which include the autonomous monitoring of affect during situations of technological acceptance.

Item Type:	Chapter in book
Description:	Paper presented at the 2022 13th International Congress on Advanced Applied Informatics Winter (IIAI-AAI-Winter), Phuket, Thailand, 12-14 December 2022.
Creators:	Bird, J.J., Saputra, A.A., Kubota, N. and Lotfi, A.
Publisher:	IEEE
Date:	December 2022
ISBN:	9798350309928
Identifiers:	Number Type 10.1109/iiai-aai-winter58034.2022.00027 DOI 1764700 Other
Rights:	© 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Divisions:	Schools > School of Science and Technology
Record created by:	Jonathan Gallacher
Date Added:	23 May 2023 14:36
Last Modified:	23 May 2023 14:36
Related URLs:	Publisher
URI:	https://irep.ntu.ac.uk/id/eprint/49063

Actions (login required)

Edit View

Statistics

Views

Downloads