Real-Time Gaze Estimator Based on Driver's Head Orientation for Forward Collision Warning System

被引:77
|
作者
Lee, Sung Joo [1 ]
Jo, Jaeik [1 ]
Jung, Ho Gi [2 ]
Park, Kang Ryoung [3 ,4 ]
Kim, Jaihie [1 ]
机构
[1] Yonsei Univ, Sch Elect & Elect Engn, Biometr Engn Res Ctr, Seoul 120749, South Korea
[2] Mando Corp, Yongin 446901, South Korea
[3] Dongguk Univ, Div Elect & Elect Engn, Seoul 100715, South Korea
[4] Dongguk Univ, Biometr Engn Res Ctr, Seoul 100715, South Korea
基金
新加坡国家研究基金会;
关键词
Driver monitoring system; forward collision warning (FCW) system; gaze estimation; head orientation estimation; precrash system; POSE ESTIMATION; VISUAL-ATTENTION; TRACKING; VISION;
D O I
10.1109/TITS.2010.2091503
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
This paper presents a vision-based real-time gaze zone estimator based on a driver's head orientation composed of yaw and pitch. Generally, vision-based methods are vulnerable to the wearing of eyeglasses and image variations between day and night. The proposed method is novel in the following four ways: First, the proposed method can work under both day and night conditions and is robust to facial image variation caused by eyeglasses because it only requires simple facial features and not specific features such as eyes, lip corners, and facial contours. Second, an ellipsoidal face model is proposed instead of a cylindrical face model to exactly determine a driver's yaw. Third, we propose new features-the normalized mean and the standard deviation of the horizontal edge projection histogram-to reliably and rapidly estimate a driver's pitch. Fourth, the proposed method obtains an accurate gaze zone by using a support vector machine. Experimental results from 200 000 images showed that the root mean square errors of the estimated yaw and pitch angles are below 7 under both daylight and nighttime conditions. Equivalent results were obtained for drivers with glasses or sunglasses, and 18 gaze zones were accurately estimated using the proposed gaze estimation method.
引用
收藏
页码:254 / 267
页数:14
相关论文
共 50 条
  • [1] A fusion system for real-time forward collision warning in automobiles
    Srinivasa, N
    Chen, Y
    Daniell, C
    [J]. 2003 IEEE INTELLIGENT TRANSPORTATION SYSTEMS PROCEEDINGS, VOLS. 1 & 2, 2003, : 457 - 462
  • [2] Real-time Lane Detection and Forward Collision Warning System Based on Stereo Vision
    Song, Wenjie
    Fu, Mengyin
    Yang, Yi
    Wang, Meiling
    Wang, Xinyu
    Kornhauser, Alain
    [J]. 2017 28TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV 2017), 2017, : 493 - 498
  • [3] Real-Time Sleep Detection and Warning System to Ensure Driver's Safety Based on EEG
    Saleab, Michael S.
    Abd El Ghany, Mohamed A.
    Toma, Ramez M.
    Hofmann, Klaus
    [J]. 2016 IEEE 19TH INTERNATIONAL SYMPOSIUM ON DESIGN AND DIAGNOSTICS OF ELECTRONIC CIRCUITS & SYSTEMS (DDECS), 2016, : 231 - 236
  • [4] Real-Time Forward Collision Warning system using nested Kalman filter for monocular camera
    Lim, Qun
    He, Yichang
    Tan, U-Xuan
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2018, : 868 - 873
  • [5] Real-Time Feed-Forward Neural Network-Based Forward Collision Warning System Under Cloud Communication Environment
    Lee, Donghoun
    Kim, Sunghoon
    Tak, Sehyun
    Yeo, Hwasoo
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2019, 20 (12) : 4390 - 4404
  • [6] Real-time Vehicle Detection and Tracking Algorithm for Forward Vehicle Collision Warning
    Chang, Jung-Woo
    Kang, Suk-Ju
    [J]. JOURNAL OF SEMICONDUCTOR TECHNOLOGY AND SCIENCE, 2018, 18 (05) : 547 - 559
  • [7] A Fused Data Based Real-Time Collision Warning System for Ferries in the Yangtze River
    Liu, Xiaojia
    Zhang, Ke
    Xue, Han
    Li, Yingtang
    [J]. JOURNAL OF MARINE SCIENCE AND TECHNOLOGY-TAIWAN, 2022, 30 (06): : 287 - 302
  • [8] Development of AtoN Real-time Video Surveillance System Based on the AIS Collision Warning
    Wang, Yongtao
    [J]. 2019 5TH INTERNATIONAL CONFERENCE ON TRANSPORTATION INFORMATION AND SAFETY (ICTIS 2019), 2019, : 393 - 398
  • [9] A forward collision warning system based on self-learning algorithm of driver characteristics
    Wang, Chang
    Sun, Qinyu
    Li, Zhen
    Zhang, Hongjia
    Fu, Rui
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2020, 38 (02) : 1519 - 1530
  • [10] A Real-Time Forward Collision Warning Technique Incorporating Detection and Depth Estimation Networks
    Wang, Huai-Mu
    Lin, Huei-Yung
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 1966 - 1971