Measuring mental workload with EEG+fNIRS

Aghajani, H, Garbey, M and Omurtag, A ORCID: https://orcid.org/0000-0002-3773-8506, 2017. Measuring mental workload with EEG+fNIRS. Frontiers in Human Neuroscience, 11: 359. ISSN 1662-5161

Preview

Text PubSub10247_706a_Omurtag.pdf - Published version Download (3MB) | Preview

Abstract

We studied the capability of a Hybrid functional neuroimaging technique to quantify human mental workload (MWL). We have used electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) as imaging modalities with 17 healthy subjects performing the letter n-back task, a standard experimental paradigm related to working memory (WM). The level of MWL was parametrically changed by variation of n from 0 to 3. Nineteen EEG channels were covering the whole-head and 19 fNIRS channels were located on the forehead to cover the most dominant brain region involved in WM. Grand block averaging of recorded signals revealed specific behaviors of oxygenated-hemoglobin level during changes in the level of MWL. A machine learning approach has been utilized for detection of the level of MWL. We extracted different features from EEG, fNIRS, and EEG+fNIRS signals as the biomarkers of MWL and fed them to a linear support vector machine (SVM) as train and test sets. These features were selected based on their sensitivity to the changes in the level of MWL according to the literature. We introduced a new category of features within fNIRS and EEG+fNIRS systems. In addition, the performance level of each feature category was systematically assessed. We also assessed the effect of number of features and window size in classification performance. SVM classifier used in order to discriminate between different combinations of cognitive states from binary- and multi-class states. In addition to the cross-validated performance level of the classifier other metrics such as sensitivity, specificity, and predictive values were calculated for a comprehensive assessment of the classification system. The Hybrid (EEG+fNIRS) system had an accuracy that was significantly higher than that of either EEG or fNIRS. Our results suggest that EEG+fNIRS features combined with a classifier are capable of robustly discriminating among various levels of MWL. Results suggest that EEG+fNIRS should be preferred to only EEG or fNIRS, in developing passive BCIs and other applications which need to monitor users' MWL.

Item Type:	Journal article
Publication Title:	Frontiers in Human Neuroscience
Creators:	Aghajani, H., Garbey, M. and Omurtag, A.
Publisher:	Frontiers Research Foundation
Date:	14 July 2017
Volume:	11
ISSN:	1662-5161
Identifiers:	Number Type 10.3389/fnhum.2017.00359 DOI
Divisions:	Schools > School of Science and Technology
Record created by:	Jonathan Gallacher
Date Added:	15 Feb 2018 13:48
Last Modified:	12 Apr 2018 11:33
URI:	https://irep.ntu.ac.uk/id/eprint/32720

Actions (login required)

Edit View

Statistics

Views

Downloads