Behind-the-Ear EEG-Based Wearable Driver Drowsiness Detection System Using Embedded Tiny Neural Networks

被引:5
|
作者
Nguyen, Ha-Trung [1 ]
Mai, Ngoc-Dau [1 ]
Lee, Boon Giin [2 ]
Chung, Wan-Young [1 ]
机构
[1] Pukyong Natl Univ, Dept Artificial Convergence, Busan 48513, South Korea
[2] Univ Nottingham Ningbo China, Nottingham Ningbo China Beacons Excellence Res &, Sch Comp Sci, Ningbo 315100, Peoples R China
基金
新加坡国家研究基金会;
关键词
Drowsiness detection (DD); edge computing; electroencephalogram (EEG); microcontroller; tiny neural networks (NNs); wearable system; FATIGUE; ELECTROENCEPHALOGRAPHY; GYROSCOPE; SENSOR;
D O I
10.1109/JSEN.2023.3307766
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Driver drowsiness is a major factor that leads to traffic accidents and loss of life. A popular drowsiness detection (DD) method is based on machine learning (ML) and monitoring electroencephalogram (EEG) signals from the scalp. However, the setup is usually bulky and too obtrusive for use in daily life. In addition, the data processing unit is usually placed in large hardware such as cloud servers and personal computers that receive the EEG signal from wearable sensors wirelessly. This results in a cumbersome system that lacks mobility and suffers high latency and power consumption because of wireless connection. The behind-the-ear (BTE) EEG is a novel approach that promises a more convenient and practical solution than scalp-EEG. Recent advances in tiny ML (TinyML) mean that on-device ML-based driver DD (DDD) could also be realized to avoid the limitations mentioned above. This article presents the design of a novel BTE EEG-based DDD system that uses a wearable headband device and runs built-in neural network (NN) models. The device collects EEG signals from four proposed BTE locations that are then preprocessed. Welch's method is applied to extract the relative power spectral density (rPSD) ratio of three EEG bands (theta, alpha, and beta). Two NN models [multilayer perceptron (MLP) and convolutional NN (CNN)] were trained and compared to a support vector machine (SVM) before deployment in the embedded device. Then, a benchmark test was performed to evaluate the on-device performances of these models. The test results established the practicality and feasibility of the proposed system for on-device DDD.
引用
收藏
页码:23875 / 23892
页数:18
相关论文
共 50 条
  • [1] EEG-Based Driver Drowsiness Estimation Using Convolutional Neural Networks
    Cui, Yuqi
    Wu, Dongrui
    [J]. NEURAL INFORMATION PROCESSING (ICONIP 2017), PT II, 2017, 10635 : 822 - 832
  • [2] Detection of tonic seizures using a multimodal wearable device with behind-the-ear EEG
    Proost, R.
    Macea, J.
    Lagae, L.
    Van Paesschen, W.
    Jansen, K.
    [J]. EPILEPSIA, 2023, 64 : 453 - 454
  • [3] Detection of Microsleep Events With a Behind-the-Ear Wearable System
    Pham, Nhat
    Dinh, Tuan
    Kim, Taeho
    Raghebi, Zohreh
    Bui, Nam
    Truong, Hoang
    Nguyen, Tuan
    Banaei-Kashani, Farnoush
    Halbower, Ann
    Dinh, Thang
    Nguyen, Phuc
    Vu, Tam
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (02) : 841 - 857
  • [4] EEG-based System Using Deep Learning and Attention Mechanism for Driver Drowsiness Detection
    Zhu, Miankuan
    Li, Haobo
    Chen, Jiangfan
    Kamezaki, Mitsuhiro
    Zhang, Zutao
    Hua, Zexi
    Sugano, Shigeki
    [J]. 2021 IEEE INTELLIGENT VEHICLES SYMPOSIUM WORKSHOPS (IV WORKSHOPS), 2021, : 280 - 286
  • [5] Smartwatch-Based Wearable EEG System for Driver Drowsiness Detection
    Li, Gang
    Lee, Boon-Leng
    Chung, Wan-Young
    [J]. IEEE SENSORS JOURNAL, 2015, 15 (12) : 7169 - 7180
  • [6] Driver Drowsiness Detection Using the In-Ear EEG
    Hwang, Taeho
    Kim, Miyoung
    Hong, Seunghyeok
    Park, Kwang Suk
    [J]. 2016 38TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2016, : 4646 - 4649
  • [7] Vehicle driver drowsiness detection method using wearable EEG based on convolution neural network
    Miankuan Zhu
    Jiangfan Chen
    Haobo Li
    Fujian Liang
    Lei Han
    Zutao Zhang
    [J]. Neural Computing and Applications, 2021, 33 : 13965 - 13980
  • [8] Vehicle driver drowsiness detection method using wearable EEG based on convolution neural network
    Zhu, Miankuan
    Chen, Jiangfan
    Li, Haobo
    Liang, Fujian
    Han, Lei
    Zhang, Zutao
    [J]. NEURAL COMPUTING & APPLICATIONS, 2021, 33 (20): : 13965 - 13980
  • [9] EEG-based neural networks approaches for fatigue and drowsiness detection: A survey
    Othmani, Alice
    Sabri, Aznul Qalid Md
    Aslan, Sinem
    Chaieb, Faten
    Rameh, Hala
    Alfred, Romain
    Cohen, Dayron
    [J]. NEUROCOMPUTING, 2023, 557
  • [10] Cascaded Convolutional Neural Network with Attention Mechanism for Mobile EEG-based Driver Drowsiness Detection System
    Ding, Sirui
    Yuan, Zhiyong
    An, Panfeng
    Xue, Guotong
    Sun, Wenxiang
    Zhao, Jianhui
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2019, : 1457 - 1464