Machine learning and deep learning techniques for driver fatigue and drowsiness detection: a review

被引:21
|
作者
Abd El-Nabi, Samy [1 ,2 ]
El-Shafai, Walid [1 ,3 ]
El-Rabaie, El-Sayed M. [1 ]
Ramadan, Khalil F. [1 ]
Abd El-Samie, Fathi E. [1 ,4 ]
Mohsen, Saeed [2 ,5 ]
机构
[1] Menoufia Univ, Fac Elect Engn, Dept Elect & Elect Commun Engn, Menoufia 32952, Egypt
[2] King Salman Int Univ KSIU, Fac Comp Sci & Engn, Dept Artificial Intelligence Engn, El Tor 46511, S Sinai, Egypt
[3] Prince Sultan Univ, Comp Sci Dept, Secur Engn Lab, Riyadh 11586, Saudi Arabia
[4] Princess Nourah Bint Abdulrahman Univ, Coll Comp & Informat Sci, Dept Informat Technol, POB 84428, Riyadh 11671, Saudi Arabia
[5] Al Madinah Higher Inst Engn & Technol, Dept Elect & Commun Engn, Giza 12947, Egypt
关键词
Drowsiness; Fatigue; Deep learning; Vehicle accidents; Yawning; Eye closure; Head movements; Facial expressions; Machine learning; MONITORING-SYSTEM; EEG; SLEEPINESS; PERFORMANCE; EXTRACTION; ALGORITHM; KNOWLEDGE; ALGEBRA; SCHEME; WHEEL;
D O I
10.1007/s11042-023-15054-0
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
There are several factors for vehicle accidents during driving such as drivers' negligence, drowsiness, and fatigue. These accidents can be avoided, if drivers are warned in time. Moreover, recent developments in computer vision and artificial intelligence (AI) have helped to monitor drivers and alert them in case they are not concentrating on driving. The AI techniques can extract relevant features from expressions of driver's face, such as eye closure, yawning, and head movements to infer the level of sleepiness. In addition, they can acquire biological signals from the driver's body, and indications from the vehicle behavior. This paper provides a comprehensive review of the detection techniques of drowsiness and fatigue of drivers using machine learning (ML) and deep learning (DL). The current techniques for this application are classified into four categories: image- or video-based analysis during the driving, biological signal analysis for drivers, vehicle movement analysis, and hybrid techniques. A review of supervised techniques is presented for detecting fatigue and drowsiness on different datasets, with a comparison of the various techniques in terms of pros and cons. Results are presented in terms of accuracy of detection for each technique. The results are discussed according to the recent problems and challenges in this field. The paper also highlights the applicability and reliability of the different techniques. Furthermore, some suggestions are presented for the future work in the field of driver drowsiness detection (DDD).
引用
收藏
页码:9441 / 9477
页数:37
相关论文
共 50 条
  • [1] Machine learning and deep learning techniques for driver fatigue and drowsiness detection: a review
    Samy Abd El-Nabi
    Walid El-Shafai
    El-Sayed M. El-Rabaie
    Khalil F. Ramadan
    Fathi E. Abd El-Samie
    Saeed Mohsen
    Multimedia Tools and Applications, 2024, 83 : 9441 - 9477
  • [2] Advanced detection techniques for driver drowsiness: a comprehensive review of machine learning, deep learning, and physiological approaches
    Kamboj M.
    Kadian K.
    Dwivedi V.
    Wary A.
    Ojha S.
    Multimedia Tools and Applications, 2024, 83 (42) : 90619 - 90682
  • [3] A Review on Deep Learning Techniques for EEG-Based Driver Drowsiness Detection Systems
    Latreche, Imene
    Slatnia, Sihem
    Kazar, Okba
    Barka, Ezedin
    Harous, Saad
    Informatica (Slovenia), 2024, 48 (03): : 359 - 378
  • [4] Deep Review of Machine Learning Techniques on Detection of Drowsiness Using EEG Signal
    Venkata Phanikrishna, B.
    Jaya Prakash, Allam
    Suchismitha, Chinara
    IETE JOURNAL OF RESEARCH, 2023, 69 (06) : 3104 - 3119
  • [5] Driver Drowsiness Detection by Applying Deep Learning Techniques to Sequences of Images
    Magan, Elena
    Sesmero, M. Paz
    Alonso-Weber, Juan Manuel
    Sanchis, Araceli
    APPLIED SCIENCES-BASEL, 2022, 12 (03):
  • [6] Driver drowsiness detection using Behavioral measures and machine learning techniques: A review of state-of-art techniques
    Ngxande, Mkhuseli
    Tapamo, Jules-Raymond
    Burke, Michael
    2017 PATTERN RECOGNITION ASSOCIATION OF SOUTH AFRICA AND ROBOTICS AND MECHATRONICS (PRASA-ROBMECH), 2017, : 156 - 161
  • [7] Detection of driver drowsiness using transfer learning techniques
    Prajwal Mate
    Ninad Apte
    Manish Parate
    Sanjeev Sharma
    Multimedia Tools and Applications, 2024, 83 : 35553 - 35582
  • [8] A Machine Learning Based Approach to Driver Drowsiness Detection
    Misal, Swapnil
    Nair, Binoy B.
    INFORMATION, COMMUNICATION AND COMPUTING TECHNOLOGY, ICICCT 2018, 2019, 835 : 150 - 159
  • [9] Detection of driver drowsiness using transfer learning techniques
    Mate, Prajwal
    Apte, Ninad
    Parate, Manish
    Sharma, Sanjeev
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (12) : 35553 - 35582
  • [10] A Deep-Learning Approach to Driver Drowsiness Detection
    Ahmed, Mohammed Imran Basheer
    Alabdulkarem, Halah
    Alomair, Fatimah
    Aldossary, Dana
    Alahmari, Manar
    Alhumaidan, Munira
    Alrassan, Shoog
    Rahman, Atta
    Youldash, Mustafa
    Zaman, Gohar
    SAFETY, 2023, 9 (03)