Behind-the-Ear EEG-Based Wearable Driver Drowsiness Detection System Using Embedded Tiny Neural Networks

被引:5
|
作者
Nguyen, Ha-Trung [1 ]
Mai, Ngoc-Dau [1 ]
Lee, Boon Giin [2 ]
Chung, Wan-Young [1 ]
机构
[1] Pukyong Natl Univ, Dept Artificial Convergence, Busan 48513, South Korea
[2] Univ Nottingham Ningbo China, Nottingham Ningbo China Beacons Excellence Res &, Sch Comp Sci, Ningbo 315100, Peoples R China
基金
新加坡国家研究基金会;
关键词
Drowsiness detection (DD); edge computing; electroencephalogram (EEG); microcontroller; tiny neural networks (NNs); wearable system; FATIGUE; ELECTROENCEPHALOGRAPHY; GYROSCOPE; SENSOR;
D O I
10.1109/JSEN.2023.3307766
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Driver drowsiness is a major factor that leads to traffic accidents and loss of life. A popular drowsiness detection (DD) method is based on machine learning (ML) and monitoring electroencephalogram (EEG) signals from the scalp. However, the setup is usually bulky and too obtrusive for use in daily life. In addition, the data processing unit is usually placed in large hardware such as cloud servers and personal computers that receive the EEG signal from wearable sensors wirelessly. This results in a cumbersome system that lacks mobility and suffers high latency and power consumption because of wireless connection. The behind-the-ear (BTE) EEG is a novel approach that promises a more convenient and practical solution than scalp-EEG. Recent advances in tiny ML (TinyML) mean that on-device ML-based driver DD (DDD) could also be realized to avoid the limitations mentioned above. This article presents the design of a novel BTE EEG-based DDD system that uses a wearable headband device and runs built-in neural network (NN) models. The device collects EEG signals from four proposed BTE locations that are then preprocessed. Welch's method is applied to extract the relative power spectral density (rPSD) ratio of three EEG bands (theta, alpha, and beta). Two NN models [multilayer perceptron (MLP) and convolutional NN (CNN)] were trained and compared to a support vector machine (SVM) before deployment in the embedded device. Then, a benchmark test was performed to evaluate the on-device performances of these models. The test results established the practicality and feasibility of the proposed system for on-device DDD.
引用
收藏
页码:23875 / 23892
页数:18
相关论文
共 50 条
  • [41] EEG-Based Driver Fatigue Detection Using FAWT and Multiboosting Approaches
    Subasi, Abdulhamit
    Saikia, Aditya
    Bagedo, Kholoud
    Singh, Amarprit
    Hazarika, Anil
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (10) : 6602 - 6609
  • [42] Raspberry Pi Based Driver Drowsiness Detection System Using Convolutional Neural Network (CNN)
    Safie, S., I
    Ramli, Rusmawarni
    Azri, M. Amirul
    Aliff, M.
    Mohammad, Zulhaimi
    [J]. 2022 IEEE 18TH INTERNATIONAL COLLOQUIUM ON SIGNAL PROCESSING & APPLICATIONS (CSPA 2022), 2022, : 30 - 34
  • [43] EEG-Based Driver Fatigue Detection Using FAWT and Multiboosting Approaches
    The Institute of Biomedicine, Faculty of Medicine, University of Turku, Turku
    20500, Finland
    不详
    22332, Saudi Arabia
    不详
    781001, India
    不详
    22332, Saudi Arabia
    不详
    784028, India
    [J]. IEEE Trans. Ind. Inf., 10 (6602-6609):
  • [44] Driver Drowsiness Detection System Based on Feature Representation Learning Using Various Deep Networks
    Park, Sanghyuk
    Pan, Fei
    Kang, Sunghun
    Yoo, Chang D.
    [J]. COMPUTER VISION - ACCV 2016 WORKSHOPS, PT III, 2017, 10118 : 154 - 164
  • [45] EEG-Based Emotion Classification Using Spiking Neural Networks
    Luo, Yuling
    Fu, Qiang
    Xie, Juntao
    Qin, Yunbai
    Wu, Guopei
    Liu, Junxiu
    Jiang, Frank
    Cao, Yi
    Ding, Xuemei
    [J]. IEEE ACCESS, 2020, 8 : 46007 - 46016
  • [46] EEG-based detection of the locus of auditory attention with convolutional neural networks
    Vandecappelle, Servaas
    Deckers, Lucas
    Das, Neetha
    Ansari, Amir Hossein
    Bertrand, Alexander
    Francart, Tom
    [J]. ELIFE, 2021, 10
  • [47] Automated Driver Drowsiness Detection from Single-Channel EEG Signals Using Convolutional Neural Networks and Transfer Learning
    Ghadami, Ali
    Mohammadzadeh, Mohammad
    Taghimohammadi, Mohammadreza
    Taheri, Alireza
    [J]. 2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 4068 - 4073
  • [48] Semi-supervised automatic seizure detection using personalized anomaly detecting variational autoencoder with behind-the-ear EEG
    You, Sungmin
    Cho, Baek Hwan
    Shon, Young-Min
    Seo, Dae-Won
    Kim, In Young
    [J]. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2022, 213
  • [49] Using long short term memory and convolutional neural networks for driver drowsiness detection
    Quddus, Azhar
    Zandi, Ali Shahidi
    Prest, Laura
    Comeau, Felix J. E.
    [J]. ACCIDENT ANALYSIS AND PREVENTION, 2021, 156
  • [50] A Driver Drowsiness Detection Scheme Based on 3D Convolutional Neural Networks
    Mao, Hongyun
    Tang, Jingling
    Zhao, Xiaoran
    Tang, Mingwei
    Jiang, Zhongyuan
    [J]. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2022, 36 (02)