Illuminating the Neural Landscape of Pilot Mental States: A Convolutional Neural Network Approach with Shapley Additive Explanations Interpretability

被引:5
|
作者
Alreshidi, Ibrahim [1 ,2 ,3 ]
Bisandu, Desmond [1 ,2 ]
Moulitsas, Irene [1 ,2 ]
机构
[1] Cranfield Univ, Ctr Computat Engn Sci, Cranfield MK43 0AL, England
[2] Cranfield Univ, Digital Aviat Res & Technol Ctr DARTeC, Machine Learning & Data Analyt Lab, Cranfield MK43 0AL, England
[3] Univ Hail, Coll Comp Sci & Engn, Hail 81451, Saudi Arabia
关键词
aviation safety; convolutional neural network; deep learning; EEG; electroencephalogram; interpretability/explainability; machine learning; mental states classification; pilot deficiencies; SHapley Additive exPlanations; EEG; ALPHA;
D O I
10.3390/s23229052
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Predicting pilots' mental states is a critical challenge in aviation safety and performance, with electroencephalogram data offering a promising avenue for detection. However, the interpretability of machine learning and deep learning models, which are often used for such tasks, remains a significant issue. This study aims to address these challenges by developing an interpretable model to detect four mental states-channelised attention, diverted attention, startle/surprise, and normal state-in pilots using EEG data. The methodology involves training a convolutional neural network on power spectral density features of EEG data from 17 pilots. The model's interpretability is enhanced via the use of SHapley Additive exPlanations values, which identify the top 10 most influential features for each mental state. The results demonstrate high performance in all metrics, with an average accuracy of 96%, a precision of 96%, a recall of 94%, and an F1 score of 95%. An examination of the effects of mental states on EEG frequency bands further elucidates the neural mechanisms underlying these states. The innovative nature of this study lies in its combination of high-performance model development, improved interpretability, and in-depth analysis of the neural correlates of mental states. This approach not only addresses the critical need for effective and interpretable mental state detection in aviation but also contributes to our understanding of the neural underpinnings of these states. This study thus represents a significant advancement in the field of EEG-based mental state detection.
引用
收藏
页数:20
相关论文
共 50 条
  • [21] Convolutional Neural Network Approach for Iris Segmentation
    Abhinand, P.
    Sheela, S. V.
    Radhika, K. R.
    SOFT COMPUTING AND ITS ENGINEERING APPLICATIONS, ICSOFTCOMP 2022, 2023, 1788 : 354 - 368
  • [22] A Convolutional Neural Network Approach for Classifying Leukocoria
    Henning, Ryan
    Rivas-Perea, Pablo
    Shaw, Bryan
    Hamerly, Greg
    2014 IEEE SOUTHWEST SYMPOSIUM ON IMAGE ANALYSIS AND INTERPRETATION (SSIAI 2014), 2014, : 9 - 12
  • [23] Pruning Convolutional Neural Network with Distinctiveness Approach
    Li, Wenrui
    Plested, Jo
    NEURAL INFORMATION PROCESSING, ICONIP 2019, PT V, 2019, 1143 : 448 - 455
  • [24] A Convolutional Neural Network Approach for Face Verification
    Khalil-Hani, Mohamed
    Sung, Liew Shan
    2014 INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING & SIMULATION (HPCS), 2014, : 707 - 714
  • [25] Gender classification: a convolutional neural network approach
    Liew, Shan Sung
    Khalil-Hani, Mohamed
    Ahmad Radzi, Syafeeza
    Bakhteri, Rabia
    TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES, 2016, 24 (03) : 1248 - 1264
  • [26] A novel framework for lung cancer classification using lightweight convolutional neural networks and ridge extreme learning machine model with SHapley Additive exPlanations (SHAP)
    Nahiduzzaman, Md.
    Abdulrazak, Lway Faisal
    Ayari, Mohamed Arselene
    Khandakar, Amith
    Islam, S. M. Riazul
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 248
  • [27] Surfel convolutional neural network for support detection in additive manufacturing
    Jida Huang
    Tsz-Ho Kwok
    Chi Zhou
    Wenyao Xu
    The International Journal of Advanced Manufacturing Technology, 2019, 105 : 3593 - 3604
  • [28] Surfel convolutional neural network for support detection in additive manufacturing
    Huang, Jida
    Kwok, Tsz-Ho
    Zhou, Chi
    Xu, Wenyao
    INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2019, 105 (09): : 3593 - 3604
  • [29] Convolutional Neural Network Based Object Detection for Additive Manufacturing
    Lemos, Cezar B.
    Farias, Paulo C. M. A.
    Simas Filho, Eduardo E.
    Conceicao, Andre G. S.
    2019 19TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS (ICAR), 2019, : 420 - 425
  • [30] Using Shapley additive explanations and saliency for interpretation of multiclass classification of PDX spectral data with deep neural networks
    Rafsanjani, Mohd Rifqi
    Dooney, Alison
    Suresh, Rahul
    O'Farrell, Alice C.
    Jarzabek, Monika A.
    Shiels, Liam P.
    Byrne, Annette T.
    Prehn, Jochen H.
    Meade, Aidan D.
    DATA SCIENCE FOR PHOTONICS AND BIOPHOTONICS, 2024, 13011