Real-Time EEG-Based Driver Drowsiness Detection Based on Convolutional Neural Network With Gumbel-Softmax Trick

被引:0
|
作者
Feng, Weibin [1 ,2 ]
Wang, Xiaoping [1 ,2 ]
Xie, Jialan [3 ,4 ]
Liu, Wanqing [3 ,4 ]
Qiao, Yinghao [3 ,4 ]
Liu, Guangyuan [3 ,4 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Artificial Intelligence & Automat, Key Lab Image Proc & Intelligent Control, Educ Minist China, Wuhan 430074, Peoples R China
[2] Huazhong Univ Sci & Technol, Hubei Key Lab Brain inspired Intelligent Syst, Wuhan 430074, Peoples R China
[3] Southwest Univ, Coll Elect & Informat Engn, Chongqing 400715, Peoples R China
[4] Southwest Univ, Inst Affect Comp & Intelligent Informat Proc, Chongqing 400715, Peoples R China
基金
中国国家自然科学基金;
关键词
Electroencephalography; Brain modeling; Neurons; Feature extraction; Training; Accuracy; Vectors; Target tracking; Reviews; Real-time systems; Driver drowsiness detection; electroencephalography (EEG); graphical user interface (GUI); Gumbel-Softmax trick; real-time; FATIGUE; SIGNALS; ELECTROENCEPHALOGRAPHY; MODEL;
D O I
10.1109/JSEN.2024.3492176
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Nowadays, severe traffic accidents attributed to driver drowsiness have become increasingly frequent, prompting a widespread concern among researchers in electroencephalography (EEG)-based driver drowsiness detection. However, due to the significant differences in EEG signals between participants, the prevalence of redundant information in multichannel EEG data, and the computational burden in combining channel selection with neural networks, achieving an accurate and efficient real-time driver drowsiness recognition remains challenging. To overcome these limitations, this article proposes a novel deep learning framework that utilizes a separable convolutional neural network (CNN) to mine the intricate spatiotemporal information in EEG signals, combined with the channel selection layer to jointly optimize EEG channels and network parameters. This layer employs an efficient embedded Gumbel-Softmax technique for discrete sampling and differentiable approximation. To prevent the introduction of duplicate channels, we impose penalties on the row sums of the selection matrix to encourage the selection neurons to learn distinct channels, enabling the neural network to train in an end-to-end manner. The proposed model achieves an average accuracy of 80.84% and an F1 score of 79.65% in cross-subject drowsiness identification for 11 subjects on the publicly available sustained-attention driving task dataset. Compared to the results of recent relevant works, our model exhibits superior performance, surpassing state-of-the-art (SOTA) deep learning methods by 1.47%. Furthermore, building upon the model's advantages, we have further actualized a real-time driver drowsiness detection graphical user interface (GUI), providing a practical reference for real-world applications.
引用
收藏
页码:1860 / 1871
页数:12
相关论文
共 50 条
  • [1] Driver Safety Development: Real-Time Driver Drowsiness Detection System Based on Convolutional Neural Network
    Hashemi M.
    Mirrashid A.
    Beheshti Shirazi A.
    SN Computer Science, 2020, 1 (5)
  • [2] Cascaded Convolutional Neural Network with Attention Mechanism for Mobile EEG-based Driver Drowsiness Detection System
    Ding, Sirui
    Yuan, Zhiyong
    An, Panfeng
    Xue, Guotong
    Sun, Wenxiang
    Zhao, Jianhui
    2019 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2019, : 1457 - 1464
  • [3] EEG-Based Driver Drowsiness Estimation Using Convolutional Neural Networks
    Cui, Yuqi
    Wu, Dongrui
    NEURAL INFORMATION PROCESSING (ICONIP 2017), PT II, 2017, 10635 : 822 - 832
  • [4] EEG-Based Cross-Subject Driver Drowsiness Recognition With an Interpretable Convolutional Neural Network
    Cui, Jian
    Lan, Zirui
    Sourina, Olga
    Muller-Wittig, Wolfgang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (10) : 7921 - 7933
  • [5] Gumbel-SoftMax based graph convolution network approach for community detection
    Chaudhary L.
    Singh B.
    International Journal of Information Technology, 2023, 15 (6) : 3063 - 3070
  • [6] Real Time Driver Drowsiness Detection Based on Convolution Neural Network
    Ahmed, M. A.
    Hussein, Harith A.
    Omar, Mohammed Basim
    Hameed, Qabas A.
    JOURNAL OF ALGEBRAIC STATISTICS, 2022, 13 (02) : 2006 - 2012
  • [7] A Deep Neural Network for Real-Time Driver Drowsiness Detection
    Vu, Toan H.
    Dang, An
    Wang, Jia-Ching
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2019, E102D (12): : 2637 - 2641
  • [8] EEG-based TSK fuzzy graph neural network for driver drowsiness estimation
    Chen, Haotian
    Xie, Jialiang
    INFORMATION SCIENCES, 2024, 679
  • [9] EEG-based Real-time Drowsiness Detection using Hilbert-Huang Transform
    Wang, Rui
    Wang, Yang
    Luo, Chunheng
    2015 7TH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS IHMSC 2015, VOL I, 2015, : 195 - 198
  • [10] EEG-Based Driver Drowsiness Detection Using the Dynamic Time Dependency Method
    Zhang, Haolan
    Zhao, Qixin
    Lee, Sanghyuk
    Dowens, Margaret G.
    BRAIN INFORMATICS, 2019, 11976 : 39 - 47