A Real-time Driving Drowsiness Detection Algorithm With Individual Differences Consideration

被引:40
|
作者
You, Feng [1 ]
Li, Xiaolong [1 ]
Gong, Yunbo [1 ]
Wang, Haiwei [2 ]
Li, Hongyi [3 ,4 ]
机构
[1] South China Univ Technol, Sch Civil Engn & Transportat, Guangzhou 510640, Peoples R China
[2] Guangdong Commun Polytech, Sch Transportat & Econ Management, Guangzhou 510650, Peoples R China
[3] Xinjiang Qual Prod Supervis & Inspect Inst Techno, Urumqi 830011, Peoples R China
[4] Chinese Acad Sci, Xinjiang Tech Inst Phys & Chem, Urumqi 830011, Peoples R China
基金
中国国家自然科学基金;
关键词
Traffic safety; driving drowsiness detection; CNN; individual differences; SVM; CONVOLUTIONAL NEURAL-NETWORK; DRIVER; SYSTEM;
D O I
10.1109/ACCESS.2019.2958667
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The research work about driving drowsiness detection algorithm has great significance to improve traffic safety. Presently, there are many fruits and literature about driving drowsiness detection method. However, most of them are devoted to find a universal drowsiness detection method, while ignore the individual driver differences. This paper proposes a real-time driving drowsiness detection algorithm that considers the individual differences of driver. A deep cascaded convolutional neural network was constructed to detect the face region, which avoids the problem of poor accuracy caused by artificial feature extraction. Based on the Dlib toolkit, the landmarks of frontal driver facial in a frame are found. According to the eyes landmarks, a new parameter, called Eyes Aspect Ratio, is introduced to evaluate the drowsiness of driver in the current frame. Taking into account differences in size of driver's eyes, the proposed algorithm consists of two modules: offline training and online monitoring. In the first module, a unique fatigue state classifier, based on Support Vector Machines, was trained which taking the Eyes Aspect Ratio as input. Then, in the second module, the trained classifier is application to monitor the state of driver online. Because the fatigue driving state is gradually produced, a variable which calculated by number of drowsy frames per unit time is introduced to assess the drowsiness of driver. Through comparative experiments, we demonstrate this algorithm outperforms current driving drowsiness detection approaches in both accuracy and speed. In simulated driving applications, the proposed algorithm detects the drowsy state of driver quickly from 640*480 resolution images at over 20fps and 94.80% accuracy. The research result can serve intelligent transportation system, ensure driver safety and reduce the losses caused by drowsy driving.
引用
收藏
页码:179396 / 179408
页数:13
相关论文
共 50 条
  • [41] Real-time Pedestrian and Vehicle Detection for Autonomous Driving
    Yang, Zhiheng
    Li, Jun
    Li, Huiyun
    2018 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2018, : 179 - 184
  • [42] Real-Time Warning System for Driver Drowsiness Detection Using Visual Information
    Marco Javier Flores
    José María Armingol
    Arturo de la Escalera
    Journal of Intelligent & Robotic Systems, 2010, 59 : 103 - 125
  • [43] Real-time classification for autonomous drowsiness detection using eye aspect ratio
    Maior, Caio Bezerra Souto
    Moura, Márcio José das Chagas
    Santana, João Mateus Marques
    Lins, Isis Didier
    Expert Systems with Applications, 2021, 158
  • [44] Real-Time CNN-Based Driver Distraction & Drowsiness Detection System
    Almazroi, Abdulwahab Ali
    Alqarni, Mohammed A.
    Aslam, Nida
    Shah, Rizwan Ali
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2023, 37 (02): : 2153 - 2174
  • [45] Real-Time Warning System for Driver Drowsiness Detection Using Visual Information
    Javier Flores, Marco
    Maria Armingol, Jose
    de la Escalera, Arturo
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2010, 59 (02) : 103 - 125
  • [46] A Real-Time Wireless Brain-Computer Interface System for Drowsiness Detection
    Lin, Chin-Teng
    Chang, Che-Jui
    Lin, Bor-Shyh
    Hung, Shao-Hang
    Chao, Chih-Feng
    Wang, I-Jan
    IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, 2010, 4 (04) : 214 - 222
  • [47] URFD: Urban Real-time Fatigue Driving Detection
    Li, Mingtong
    Duan, Chunsun
    Dai, Tianlun
    Zhou, Tao
    Yu, Ziqiang
    PROCEEDINGS OF 2019 2ND INTERNATIONAL CONFERENCE ON BIG DATA TECHNOLOGIES (ICBDT 2019), 2019, : 29 - 33
  • [48] A low-cost Real-Time FPGA solution for driver drowsiness detection
    Moreno, F
    Aparicio, F
    Hernández, W
    Páez, J
    IECON'03: THE 29TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, VOLS 1 - 3, PROCEEDINGS, 2003, : 1396 - 1401
  • [49] Real-Time Vision-Based Driver Drowsiness/Fatigue Detection System
    Yao, K. P.
    Lin, W. H.
    Fang, C. Y.
    Wang, J. M.
    Chang, S. L.
    Chen, S. W.
    2010 IEEE 71ST VEHICULAR TECHNOLOGY CONFERENCE, 2010,
  • [50] Real-time classification for autonomous drowsiness detection using eye aspect ratio
    Souto Maior, Caio Bezerra
    das Chagas Moura, Marcio Jose
    Marques Santana, Joao Mateus
    Lins, Isis Didier
    EXPERT SYSTEMS WITH APPLICATIONS, 2020, 158