Illuminating the Neural Landscape of Pilot Mental States: A Convolutional Neural Network Approach with Shapley Additive Explanations Interpretability

被引:5
|
作者
Alreshidi, Ibrahim [1 ,2 ,3 ]
Bisandu, Desmond [1 ,2 ]
Moulitsas, Irene [1 ,2 ]
机构
[1] Cranfield Univ, Ctr Computat Engn Sci, Cranfield MK43 0AL, England
[2] Cranfield Univ, Digital Aviat Res & Technol Ctr DARTeC, Machine Learning & Data Analyt Lab, Cranfield MK43 0AL, England
[3] Univ Hail, Coll Comp Sci & Engn, Hail 81451, Saudi Arabia
关键词
aviation safety; convolutional neural network; deep learning; EEG; electroencephalogram; interpretability/explainability; machine learning; mental states classification; pilot deficiencies; SHapley Additive exPlanations; EEG; ALPHA;
D O I
10.3390/s23229052
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Predicting pilots' mental states is a critical challenge in aviation safety and performance, with electroencephalogram data offering a promising avenue for detection. However, the interpretability of machine learning and deep learning models, which are often used for such tasks, remains a significant issue. This study aims to address these challenges by developing an interpretable model to detect four mental states-channelised attention, diverted attention, startle/surprise, and normal state-in pilots using EEG data. The methodology involves training a convolutional neural network on power spectral density features of EEG data from 17 pilots. The model's interpretability is enhanced via the use of SHapley Additive exPlanations values, which identify the top 10 most influential features for each mental state. The results demonstrate high performance in all metrics, with an average accuracy of 96%, a precision of 96%, a recall of 94%, and an F1 score of 95%. An examination of the effects of mental states on EEG frequency bands further elucidates the neural mechanisms underlying these states. The innovative nature of this study lies in its combination of high-performance model development, improved interpretability, and in-depth analysis of the neural correlates of mental states. This approach not only addresses the critical need for effective and interpretable mental state detection in aviation but also contributes to our understanding of the neural underpinnings of these states. This study thus represents a significant advancement in the field of EEG-based mental state detection.
引用
收藏
页数:20
相关论文
共 50 条
  • [41] Face recognition: A convolutional neural-network approach
    Lawrence, S
    Giles, CL
    Tsoi, AC
    Back, AD
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 1997, 8 (01): : 98 - 113
  • [42] Phase Aberration Correction: A Convolutional Neural Network Approach
    Sharifzadeh, Mostafa
    Benali, Habib
    Rivaz, Hassan
    IEEE ACCESS, 2020, 8 : 162252 - 162260
  • [43] LPLB: An approach for the design of a lightweight convolutional neural network
    Saleem, Tausifa Jan
    Chishti, Mohammad Ahsan
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2022, 34 (22):
  • [44] Metal Additive Manufacturing Parts Inspection Using Convolutional Neural Network
    Cui, Wenyuan
    Zhang, Yunlu
    Zhang, Xinchang
    Li, Lan
    Liou, Frank
    APPLIED SCIENCES-BASEL, 2020, 10 (02):
  • [45] Convolutional neural network based face recognition approach
    Kumar, Pratul
    Chande, Sayali
    Sinha, Saugata
    PROCEEDINGS OF THE 2019 IEEE REGION 10 CONFERENCE (TENCON 2019): TECHNOLOGY, KNOWLEDGE, AND SOCIETY, 2019, : 2525 - 2528
  • [46] A deep convolutional neural network approach for astrocyte detection
    Suleymanova, Ilida
    Balassa, Tamas
    Tripathi, Sushil
    Molnar, Csaba
    Saarma, Mart
    Sidorova, Yulia
    Horvath, Peter
    SCIENTIFIC REPORTS, 2018, 8
  • [47] A Convolutional Neural Network Approach to the Classification of Engineering Models
    Manda, Bharadwaj
    Bhaskare, Pranjal
    Muthuganapathy, Ramanathan
    IEEE ACCESS, 2021, 9 : 22711 - 22723
  • [48] A passive Indoor Localization with Convolutional Neural Network Approach
    Xiao, Yuxi
    Cui, Zhe
    Lu, Xiao
    Wang, Haixia
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 1140 - 1145
  • [49] Convolutional Neural Network Approach to THz Reflection Alignment
    Young, Jacob J.
    Stantchev, Rayko, I
    Hernandez-Serrano, Arturo, I
    Pickwell-MacPherson, Emma
    2022 47TH INTERNATIONAL CONFERENCE ON INFRARED, MILLIMETER AND TERAHERTZ WAVES (IRMMW-THZ 2022), 2022,
  • [50] A Convolutional Neural Network Approach for Acoustic Scene Classification
    Valenti, Michele
    Squartini, Stefano
    Diment, Aleksandr
    Parascandolo, Giambattista
    Virtanen, Tuomas
    2017 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2017, : 1547 - 1554