Eating and drinking gesture spotting and recognition using a novel adaptive segmentation technique and a gesture discrepancy measure

Ortega Anderez, D ORCID logoORCID: https://orcid.org/0000-0003-3571-847X, Lotfi, A ORCID logoORCID: https://orcid.org/0000-0002-5139-6565 and Pourabdollah, A ORCID logoORCID: https://orcid.org/0000-0001-7737-1393, 2019. Eating and drinking gesture spotting and recognition using a novel adaptive segmentation technique and a gesture discrepancy measure. Expert Systems with Applications. ISSN 0957-4174

[thumbnail of 14689_Lotfi.pdf]
Preview
Text
14689_Lotfi.pdf - Post-print

Download (1MB) | Preview

Abstract

Despite the increasing developments on human activity recognition using wearable technology, there are still many open challenges in spotting and recognising sporadic gestures. As opposed to activities, which exhibit continuous behaviour, the difficulty of spotting gestures lies in their rather sparse nature. This paper proposes a novel solution to spot and recognise a set of similar eating and drinking gestures from continuous inertial data streams. First, potential segments containing an eating or a drinking gesture are found using a Crossings-based Adaptive Segmentation Technique (CAST). Second, further to the long-established range of features employed in previous human activities recognition research work, a gesture discrepancy measure is proposed to improve the classification performance of the system. At the final step, a range of state-of-the-art classification models is employed for evaluation. Various conclusions can be drawn from the results obtained. First, given the 100% recall achieved at the segmentation step, the CAST can be considered a reliable segmentation technique for spotting drinking and eating gestures which may be employed in future gesture spotting work. Second, the addition of gesture discrepancy as a feature descriptor consistently improves the classification performance of the system. Third, the reliability of the food and drink intake monitoring approach proposed in this work finds support on the out-performance of previous similar work.

Item Type: Journal article
Publication Title: Expert Systems with Applications
Creators: Ortega Anderez, D., Lotfi, A. and Pourabdollah, A.
Publisher: Elsevier
Date: 29 August 2019
ISSN: 0957-4174
Identifiers:
Number
Type
10.1016/j.eswa.2019.112888
DOI
S0957417419305986
Publisher Item Identifier
Divisions: Schools > School of Science and Technology
Record created by: Linda Sullivan
Date Added: 30 Aug 2019 08:45
Last Modified: 30 Aug 2019 08:45
URI: https://irep.ntu.ac.uk/id/eprint/37521

Actions (login required)

Edit View Edit View

Statistics

Views

Views per month over past year

Downloads

Downloads per month over past year