Exploring Machine Learning Approaches for Classifying Mental Workload using fNIRS Data from HCI Tasks

被引:21
|
作者
Benerradi, Johann [1 ,2 ]
Maior, Horia A. [2 ]
Marinescu, Adrian [3 ]
Clos, Jeremie [2 ]
Wilson, Max L. [2 ]
机构
[1] Univ Lorraine, IDMC, Nancy, France
[2] Univ Nottingham, Sch Comp Sci, Nottingham, England
[3] Univ Nottingham, Fac Engn, Nottingham, England
基金
英国工程与自然科学研究理事会;
关键词
fNIRS; Mental Workload; Machine Learning; Deep Learning; LOAD; SPECTROSCOPY; EEG;
D O I
10.1145/3363384.3363392
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Functional Near-Infrared Spectroscopy (fNIRS) has shown promise for being potentially more suitable (than e.g. EEG) for brain-based Human Computer Interaction (HCI). While some machine learning approaches have been used in prior HCI work, this paper explores different approaches and configurations for classifying Mental Workload (MWL) from a continuous HCI task, to identify and understand potential limitations and data processing decisions. In particular, we investigate three overall approaches: a logistic regression method, a supervised shallow method (SVM), and a supervised deep learning method (CNN). We examine personalised and generalised models, as well as consider different features and ways of labelling the data. Our initial explorations show that generalised models can perform as well as personalised ones and that deep learning can be a suitable approach for medium size datasets. To provide additional practical advice for future brain-computer interaction systems, we conclude by discussing the limitations and data-preparation needs of different machine learning approaches. We also make recommendations for avenues of future work that are most promising for the machine learning of fNIRS data.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Measuring Mental Workload Variations in Office Work Tasks using fNIRS
    Midha, Serena
    Maior, Horia A.
    Wilson, Max L.
    Sharples, Sarah
    [J]. INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 2021, 147
  • [2] Towards Robust Neuroadaptive HCI: Exploring Modern Machine Learning Methods to Estimate Mental Workload From EEG Signals
    Appriou, Aurelien
    Cichocki, Andrzej
    Lotte, Fabien
    [J]. CHI 2018: EXTENDED ABSTRACTS OF THE 2018 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2018,
  • [3] Mental workload recognition using ECG and machine learning in simulated flight tasks
    Jiang, Zebin
    Zhang, Ke
    Wu, Kuijun
    Xu, Jie
    Li, Xinyan
    Sun, Yu
    Ge, Xianliang
    Mao, Ming
    [J]. 2022 IEEE 6TH ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC), 2022, : 1560 - 1565
  • [4] Classifying Pseudogout Using Machine Learning Approaches With Electronic Health Record Data
    Tedeschi, Sara K.
    Cai, Tianrun
    He, Zeling
    Ahuja, Yuri
    Hong, Chuan
    Yates, Katherine A.
    Dahal, Kumar
    Xu, Chang
    Lyu, Houchen
    Yoshida, Kazuki
    Solomon, Daniel H.
    Cai, Tianxi
    Liao, Katherine P.
    [J]. ARTHRITIS CARE & RESEARCH, 2021, 73 (03) : 442 - 448
  • [5] Classifying Pseudogout Using Machine Learning Approaches with Electronic Health Record Data
    Tedeschi, Sara K.
    Cai, Tianrun
    He, Zeling
    Ahuja, Yuri
    Hong, Chuan
    Yates, Katherine
    Dahal, Kumar
    Xu, Chang
    Lyu, Houchen
    Yoshida, Kazuki
    Solomon, Daniel
    Cai, Tianxi
    Liao, Katherine
    [J]. ARTHRITIS & RHEUMATOLOGY, 2019, 71
  • [6] Classification of mental workload using brain connectivity and machine learning on electroencephalogram data
    Safari, MohammadReza
    Shalbaf, Reza
    Bagherzadeh, Sara
    Shalbaf, Ahmad
    [J]. SCIENTIFIC REPORTS, 2024, 14 (01)
  • [7] Classifying Osteosarcoma Patients Using Machine Learning Approaches
    Li, Zhi
    Soroushmehr, S. M. Reza
    Hua, Yingqi
    Mao, Min
    Qiu, Yunping
    Najarian, Kayvan
    [J]. 2017 39TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2017, : 82 - 85
  • [8] Using Cross-Task Classification for Classifying Workload Levels in Complex Learning Tasks
    Walter, Carina
    Schmidt, Stephanie
    Rosenstiel, Wolfgang
    Gerjets, Peter
    Bogdan, Martin
    [J]. 2013 HUMAINE ASSOCIATION CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION (ACII), 2013, : 876 - 881
  • [9] Mental Workload Estimation from EEG Signals Using Machine Learning Algorithms
    Cheema, Baljeet Singh
    Samima, Shabnam
    Sarma, Monalisa
    Samanta, Debasis
    [J]. ENGINEERING PSYCHOLOGY AND COGNITIVE ERGONOMICS (EPCE 2018), 2018, 10906 : 265 - 284
  • [10] Multisubject "Learning" for Mental Workload Classification Using Concurrent EEG, fNIRS, and Physiological Measures
    Liu, Yichuan
    Ayaz, Hasan
    Shewokis, Patricia A.
    [J]. FRONTIERS IN HUMAN NEUROSCIENCE, 2017, 11