Illuminating the Neural Landscape of Pilot Mental States: A Convolutional Neural Network Approach with Shapley Additive Explanations Interpretability

被引:5
|
作者
Alreshidi, Ibrahim [1 ,2 ,3 ]
Bisandu, Desmond [1 ,2 ]
Moulitsas, Irene [1 ,2 ]
机构
[1] Cranfield Univ, Ctr Computat Engn Sci, Cranfield MK43 0AL, England
[2] Cranfield Univ, Digital Aviat Res & Technol Ctr DARTeC, Machine Learning & Data Analyt Lab, Cranfield MK43 0AL, England
[3] Univ Hail, Coll Comp Sci & Engn, Hail 81451, Saudi Arabia
关键词
aviation safety; convolutional neural network; deep learning; EEG; electroencephalogram; interpretability/explainability; machine learning; mental states classification; pilot deficiencies; SHapley Additive exPlanations; EEG; ALPHA;
D O I
10.3390/s23229052
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Predicting pilots' mental states is a critical challenge in aviation safety and performance, with electroencephalogram data offering a promising avenue for detection. However, the interpretability of machine learning and deep learning models, which are often used for such tasks, remains a significant issue. This study aims to address these challenges by developing an interpretable model to detect four mental states-channelised attention, diverted attention, startle/surprise, and normal state-in pilots using EEG data. The methodology involves training a convolutional neural network on power spectral density features of EEG data from 17 pilots. The model's interpretability is enhanced via the use of SHapley Additive exPlanations values, which identify the top 10 most influential features for each mental state. The results demonstrate high performance in all metrics, with an average accuracy of 96%, a precision of 96%, a recall of 94%, and an F1 score of 95%. An examination of the effects of mental states on EEG frequency bands further elucidates the neural mechanisms underlying these states. The innovative nature of this study lies in its combination of high-performance model development, improved interpretability, and in-depth analysis of the neural correlates of mental states. This approach not only addresses the critical need for effective and interpretable mental state detection in aviation but also contributes to our understanding of the neural underpinnings of these states. This study thus represents a significant advancement in the field of EEG-based mental state detection.
引用
收藏
页数:20
相关论文
共 50 条
  • [31] A Learning Convolutional Neural Network Approach for Network Robustness Prediction
    Lou, Yang
    Wu, Ruizi
    Li, Junli
    Wang, Lin
    Li, Xiang
    Chen, Guanrong
    IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (07) : 4531 - 4544
  • [32] A Convolutional Neural Network Approach to Predicting Network Connectedness Robustness
    Lou, Yang
    Wu, Ruizi
    Li, Junli
    Wang, Lin
    Chen, Guanrong
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2021, 8 (04): : 3209 - 3219
  • [33] Predicting Network Controllability Robustness: A Convolutional Neural Network Approach
    Lou, Yang
    He, Yaodong
    Wang, Lin
    Chen, Guanrong
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (05) : 4052 - 4063
  • [34] A convolutional neural network approach to electrical resistivity tomography
    Aleardi, Mattia
    Vinciguerra, Alessandro
    Hojat, Azadeh
    JOURNAL OF APPLIED GEOPHYSICS, 2021, 193
  • [35] A deep convolutional neural network approach for astrocyte detection
    Ilida Suleymanova
    Tamas Balassa
    Sushil Tripathi
    Csaba Molnar
    Mart Saarma
    Yulia Sidorova
    Peter Horvath
    Scientific Reports, 8
  • [36] Deep Convolutional Neural Network Approach for Classification of Poems
    Deshmukh, Rushali
    Kiwelekar, Arvind W.
    INTELLIGENT HUMAN COMPUTER INTERACTION, IHCI 2021, 2022, 13184 : 74 - 88
  • [37] An Efficient Convolutional Neural Network Approach for Facial Recognition
    Mangal, Aayushi
    Malik, Himanshu
    Aggarwal, Garima
    PROCEEDINGS OF THE CONFLUENCE 2020: 10TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING, DATA SCIENCE & ENGINEERING, 2020, : 817 - 822
  • [38] A Convolutional Neural Network Based Approach for Stock Forecasting
    Yu, Haixing
    Xu, Lingyu
    Zhang, Gaowei
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, PT II, 2017, 10614 : 731 - 732
  • [39] Handwritten Signature Recognition : A Convolutional Neural Network Approach
    Kancharla, Krishnaditya
    Kamble, Varun
    Kapoor, Mohit
    2018 INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATION AND TELECOMMUNICATION (ICACAT), 2018,
  • [40] CASI: A Convolutional Neural Network Approach for Shell Identification
    Van Oort, Colin M.
    Xu, Duo
    Offner, Stella S. R.
    Gutermuth, Robert A.
    ASTROPHYSICAL JOURNAL, 2019, 880 (02):