Vision-based method for detecting driver drowsiness and distraction in driver monitoring system

被引:78
|
作者
Jo, Jaeik [1 ]
Lee, Sung Joo [1 ,2 ]
Jung, Ho Gi
Park, Kang Ryoung [3 ]
Kim, Jaihie [1 ]
机构
[1] Yonsei Univ, Sch Elect & Elect Engn, Seoul 120749, South Korea
[2] Hanyang Univ, Sch Mech Engn, Seoul 133791, South Korea
[3] Dongguk Univ, Div Elect & Elect Engn, Seoul 100715, South Korea
基金
新加坡国家研究基金会;
关键词
driver monitoring systems; drowsy driver detection; drowsiness; distractions; inattention; blink detection; machine learning; computer vision; feature selection; HEAD POSE ESTIMATION; FATIGUE DETECTION; GAZE;
D O I
10.1117/1.3657506
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Most driver-monitoring systems have attempted to detect either driver drowsiness or distraction, although both factors should be considered for accident prevention. Therefore, we propose a new driver-monitoring method considering both factors. We make the following contributions. First, if the driver is looking ahead, drowsiness detection is performed; otherwise, distraction detection is performed. Thus, the computational cost and eye-detection error can be reduced. Second, we propose a new eye-detection algorithm that combines adaptive boosting, adaptive template matching, and blob detection with eye validation, thereby reducing the eye-detection error and processing time significantly, which is hardly achievable using a single method. Third, to enhance eye-detection accuracy, eye validation is applied after initial eye detection, using a support vector machine based on appearance features obtained by principal component analysis (PCA) and linear discriminant analysis (LDA). Fourth, we propose a novel eye state-detection algorithm that combines appearance features obtained using PCA and LDA, with statistical features such as the sparseness and kurtosis of the histogram from the horizontal edge image of the eye. Experimental results showed that the detection accuracies of the eye region and eye states were 99 and 97%, respectively. Both driver drowsiness and distraction were detected with a success rate of 98%. (C) 2011 Society of Photo-Optical Instrumentation Engineers (SPIE). [DOI: 10.1117/1.3657506]
引用
收藏
页数:24
相关论文
共 50 条
  • [1] A survey on vision-based driver distraction analysis
    Li, Wanli
    Huang, Jing
    Xie, Guoqi
    Karray, Fakhri
    Li, Renfa
    [J]. JOURNAL OF SYSTEMS ARCHITECTURE, 2021, 121
  • [2] A FPGA based driver drowsiness detecting system
    Wang, F
    Qin, HB
    [J]. 2005 IEEE INTERNATIONAL CONFERENCE ON VEHICULAR ELECTRONICS AND SAFETY PROCEEDINGS, 2005, : 358 - 363
  • [3] Vision-based methods for driver monitoring
    Wahlstrom, E
    Masoud, O
    Papanikolopoulos, N
    [J]. 2003 IEEE INTELLIGENT TRANSPORTATION SYSTEMS PROCEEDINGS, VOLS. 1 & 2, 2003, : 903 - 908
  • [4] Real-Time Vision-Based Driver Drowsiness/Fatigue Detection System
    Yao, K. P.
    Lin, W. H.
    Fang, C. Y.
    Wang, J. M.
    Chang, S. L.
    Chen, S. W.
    [J]. 2010 IEEE 71ST VEHICULAR TECHNOLOGY CONFERENCE, 2010,
  • [5] Vision Based System for Driver Drowsiness Detection
    Alshaqaqi, Belal
    Baquhaizel, Abdullah Salem
    Ouis, Mohamed El Amine
    Boumehed, Meriem
    Ouamri, Abdelaziz
    Keche, Mokhtar
    [J]. 2013 11TH INTERNATIONAL SYMPOSIUM ON PROGRAMMING AND SYSTEMS (ISPS), 2013, : 103 - 108
  • [6] Computer vision-based recognition of driver distraction: A review
    Moslemi, Negar
    Soryani, Mohsen
    Azmi, Reza
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (24):
  • [7] Driver Drowsiness Monitoring System
    Raju, J. V. V. S. N.
    Rakesh, P.
    Neelima, N.
    [J]. INTELLIGENT MANUFACTURING AND ENERGY SUSTAINABILITY, ICIMES 2019, 2020, 169 : 675 - 683
  • [8] Vision-Based Instant Measurement System for Driver Fatigue Monitoring
    Tsai, Yin-Cheng
    Lai, Peng-Wen
    Huang, Po-Wei
    Lin, Tzu-Min
    Wu, Bing-Fei
    [J]. IEEE ACCESS, 2020, 8 : 67342 - 67353
  • [9] Mercury: A Vision-Based Framework for Driver Monitoring
    Borghi, Guido
    Pini, Stefano
    Vezzani, Roberto
    Cucchiara, Rita
    [J]. INTELLIGENT HUMAN SYSTEMS INTEGRATION 2020, 2020, 1131 : 104 - 110
  • [10] Detecting Driver Drowsiness Using Computer Vision Techniques
    Vural, Esra
    Cetin, Muejdat
    Ercil, Aytuel
    Littlewort, Gwen
    Bartlett, Marian
    Movellan, Javier
    [J]. 2008 IEEE 16TH SIGNAL PROCESSING, COMMUNICATION AND APPLICATIONS CONFERENCE, VOLS 1 AND 2, 2008, : 549 - +