Optimisation of phonetic aware speech recognition through multi-objective evolutionary algorithms

Bird, JJ ORCID: https://orcid.org/0000-0002-9858-1231, Wanner, E, Ekárt, A and Faria, DR, 2020. Optimisation of phonetic aware speech recognition through multi-objective evolutionary algorithms. Expert Systems with Applications, 153: 113402. ISSN 0957-4174

Preview

Text 1640866_Bird.pdf - Post-print Download (488kB) | Preview

Abstract

Recent advances in the availability of computational resources allow for more sophisticated approaches to speech recognition than ever before. This study considers Artificial Neural Network and Hidden Markov Model methods of classification for Human Speech Recognition through Diphthong Vowel sounds in the English Phonetic Alphabet rather than the classical approach of the classification of whole words and phrases, with a specific focus on both single and multi-objective evolutionary optimisation of bioinspired classification methods. A set of audio clips are recorded by subjects from the United Kingdom and Mexico and the recordings are transformed into a static dataset of statistics by way of their Mel-Frequency Cepstral Coefficients (MFCC) at sliding window length of 200ms as well as a reshaped MFCC timeseries format for forecast-based models. An deep neural network with evolutionary optimised topology achieves 90.77% phoneme classification accuracy in comparison to the best HMM that achieves 86.23% accuracy with 150 hidden units, when only accuracy is considered in a single-objective optimisation approach. The obtained solutions are far more complex than the HMM taking around 248 seconds to train on powerful hardware versus 160 for the HMM. A multi-objective approach is explored due to this. In the multi-objective approaches of scalarisation presented, within which real-time resource usage is also considered towards solution fitness, far more optimal solutions are produced which train far quicker than the forecast approach (69 seconds) with classification ability retained (86.73%). Weightings towards either maximising accuracy or reducing resource usage from 0.1 to 0.9 are suggested depending on the resources available, since many future IoT devices and autonomous robots may have limited access to cloud resources at a premium in comparison to the GPU used in this experiment.

Item Type:	Journal article
Publication Title:	Expert Systems with Applications
Creators:	Bird, J.J., Wanner, E., Ekárt, A. and Faria, D.R.
Publisher:	Elsevier BV
Date:	September 2020
Volume:	153
ISSN:	0957-4174
Identifiers:	Number Type 10.1016/j.eswa.2020.113402 DOI 1640866 Other
Divisions:	Schools > School of Science and Technology
Record created by:	Jeremy Silvester
Date Added:	27 Jan 2023 14:27
Last Modified:	27 Jan 2023 14:27
URI:	https://irep.ntu.ac.uk/id/eprint/48093

Actions (login required)

Edit View

Statistics

Views

Downloads