A novel deep learning-based technique for driver drowsiness detection

被引:0
|
作者
Mukherjee, Prithwijit [1 ]
Roy, Anisha Halder [1 ]
机构
[1] Univ Calcutta, Inst Radio Phys & Elect, Kolkata, India
关键词
drowsiness detection; EEG; EMG; GSR; hybrid model; pulse rate; respiration rate; TLSTM;
D O I
10.1002/hfm.21056
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Every year, many people lose their lives because of road accidents. It is evident from statistics that drowsiness is one of the main causes of a large number of car accidents. In our research, we wish to solve this major problem by measuring the drowsiness level of the human brain while driving. The study aims to develop a novel technique to detect different alertness levels (i.e., awake, moderately drowsy, and maximally drowsy) of a person while driving. A hybrid model using a stacked autoencoder and hyperbolic tangent Long Short-Term Memory (TLSTM) network with attention mechanism is designed for this purpose. The designed model uses different biopotential signals, such as electroencephalography (EEG), facial electromyography (EMG), and different biomarkers, such as pulse rate, respiration rate galvanic skin response, and head movement to detect a person's alertness level. Here, the stacked autoencoder model is used for automated feature extraction. TLSTM is used to predict a person's alertness level using stacked autoencoder network-extracted features. The proposed model can classify awake, moderately drowsy, and maximally drowsy states of a person with accuracies of 99%, 98.3%, and 98.6%, respectively. The novel contributions of the paper includes (i) incorporation of an attention mechanism into the TLSTM network of the proposed hybrid model to focus on the emphatic states to enhance classification accuracy, and (ii) utilization of EEG, facial EMG, pulse rate, respiration rate, galvanic skin reaction, and head movement pattern to assess a person's alertness level.
引用
收藏
页码:667 / 684
页数:18
相关论文
共 50 条
  • [31] DDD TinyML: A TinyML-Based Driver Drowsiness Detection Model Using Deep Learning
    Alajlan, Norah N.
    Ibrahim, Dina M.
    [J]. SENSORS, 2023, 23 (12)
  • [32] EEG-based System Using Deep Learning and Attention Mechanism for Driver Drowsiness Detection
    Zhu, Miankuan
    Li, Haobo
    Chen, Jiangfan
    Kamezaki, Mitsuhiro
    Zhang, Zutao
    Hua, Zexi
    Sugano, Shigeki
    [J]. 2021 IEEE INTELLIGENT VEHICLES SYMPOSIUM WORKSHOPS (IV WORKSHOPS), 2021, : 280 - 286
  • [33] A novel deep learning-based approach for malware detection
    Shaukat, Kamran
    Luo, Suhuai
    Varadharajan, Vijay
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 122
  • [34] Explaining Deep Learning-Based Driver Models
    Lorente, Maria Paz Sesmero
    Lopez, Elena Magan
    Florez, Laura Alvarez
    Espino, Agapito Ledezma
    Martinez, Jose Antonio Iglesias
    de Miguel, Araceli Sanchis
    [J]. APPLIED SCIENCES-BASEL, 2021, 11 (08):
  • [35] Deep Learning-Based Driver Assistance System
    Kurtkaya, Bariscan
    Tezcan, Arda
    Taskiran, Murat
    [J]. ELECTRICA, 2023, 23 (03): : 607 - 618
  • [36] Temporal and spatial feature based approaches in drowsiness detection using deep learning technique
    Pandey, Nageshwar Nath
    Muppalaneni, Naresh Babu
    [J]. JOURNAL OF REAL-TIME IMAGE PROCESSING, 2021, 18 (06) : 2287 - 2299
  • [37] Driver drowsiness detection based on novel eye openness recognition method and unsupervised feature learning
    Han, Wei
    Yang, Yan
    Huang, Guang-Bin
    Sourina, Olga
    Klanner, Felix
    Denk, Cornelia
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC 2015): BIG DATA ANALYTICS FOR HUMAN-CENTRIC SYSTEMS, 2015, : 1470 - 1475
  • [38] Temporal and spatial feature based approaches in drowsiness detection using deep learning technique
    Nageshwar Nath Pandey
    Naresh Babu Muppalaneni
    [J]. Journal of Real-Time Image Processing, 2021, 18 : 2287 - 2299
  • [39] Leveraging Transfer Learning for Driver Drowsiness Detection
    Dwivedi, Subhash Arun
    Attry, Amit
    Singla, Kanika
    [J]. ADVANCES IN DATA AND INFORMATION SCIENCES, 2022, 318 : 603 - 611
  • [40] An optimized deep hybrid learning for multi-channel EEG-based driver drowsiness detection
    Latreche, Imene
    Slatnia, Sihem
    Kazar, Okba
    Harous, Saad
    [J]. Biomedical Signal Processing and Control, 2025, 99