"Owl' and "Lizard': patterns of head pose and eye pose in driver gaze classification

被引:60
|
作者
Fridman, Lex [1 ]
Lee, Joonbum [1 ]
Reimer, Bryan [1 ]
Victor, Trent [2 ]
机构
[1] MIT, Cambridge, MA 02142 USA
[2] Chalmers Univ Technol, SAFER, SE-41296 Gothenburg, Sweden
关键词
pose estimation; gaze tracking; driver information systems; video signal processing; image classification; head pose pattern estimation; eye pose pattern estimation; driver gaze classification; inexpensive gaze tracking; vehicle interfaces; future advanced driver assistance systems; monocular video; lizard pattern; owl pattern;
D O I
10.1049/iet-cvi.2015.0296
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Accurate, robust, inexpensive gaze tracking in the car can help keep a driver safe by facilitating the more effective study of how to improve (i) vehicle interfaces and (ii) the design of future advanced driver assistance systems. In this study, the authors estimate head pose and eye pose from monocular video using methods developed extensively in prior work and ask two new interesting questions. First, how much better can they classify driver gaze using head and eye pose versus just using head pose? Second, are there individual-specific gaze strategies that strongly correlate with how much gaze classification improves with the addition of eye pose information? The authors answer these questions by evaluating data drawn from an on-road study of 40 drivers. The main insight of the study is conveyed through the analogy of an owl' and lizard' which describes the degree to which the eyes and the head move when shifting gaze. When the head moves a lot (owl'), not much classification improvement is attained by estimating eye pose on top of head pose. On the other hand, when the head stays still and only the eyes move (lizard'), classification accuracy increases significantly from adding in eye pose. The authors characterise how that accuracy varies between people, gaze strategies, and gaze regions.
引用
收藏
页码:308 / 314
页数:7
相关论文
共 50 条
  • [1] Head Pose-free Eye Gaze Prediction for Driver Attention Study
    Wang, Yafei
    Zhao, Tongtong
    Ding, Xueyan
    Bian, Jiming
    Fu, Xianping
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP), 2017, : 42 - 46
  • [2] Head Pose and Gaze Direction Tracking for Detecting a Drowsy Driver
    Choi, In-Ho
    Kim, Yong-Guk
    [J]. 2014 INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP), 2014, : 241 - 244
  • [3] Combining Head Pose and Eye Location Information for Gaze Estimation
    Valenti, Roberto
    Sebe, Nicu
    Gevers, Theo
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (02) : 802 - 815
  • [4] An eye model for uncalibrated eye gaze estimation under variable head pose
    Hnatow, Justin
    Savakis, Andreas
    [J]. BIOMETRIC TECHNOLOGY FOR HUMAN IDENTIFICATION IV, 2007, 6539
  • [5] Driver Gaze Zone Estimation via Head Pose Fusion Assisted Supervision and Eye Region Weighted Encoding
    Yang, Yirong
    Liu, Chunsheng
    Chang, Faliang
    Lu, Yansha
    Liu, Hui
    [J]. IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2021, 67 (04) : 275 - 284
  • [6] Human Computer Interaction with Head Pose, Eye Gaze and Body Gestures
    Wang, Kang
    Zhao, Rui
    Ji, Qiang
    [J]. PROCEEDINGS 2018 13TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2018), 2018, : 789 - 789
  • [7] Analyzing the Relationship Between Head Pose and Gaze to Model Driver Visual Attention
    Jha, Sumit
    Busso, Carlos
    [J]. 2016 IEEE 19TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2016, : 2157 - 2162
  • [8] A Probabilistic Model for Visual Driver Gaze Approximation from Head Pose Estimation
    Shirpour, Mohsen
    Beauchemin, Steven S.
    Bauer, Michael A.
    [J]. 2020 IEEE 3RD CONNECTED AND AUTOMATED VEHICLES SYMPOSIUM (CAVS), 2020,
  • [9] Gaze Tracking by Joint Head and Eye Pose Estimation Under Free Head Movement
    Cristina, Stefania
    Camilleri, Kenneth P.
    [J]. 2019 27TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2019,
  • [10] Visual Analysis of Eye State and Head Pose for Driver Alertness Monitoring
    Mbouna, Ralph Oyini
    Kong, Seong G.
    Chun, Myung-Geun
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2013, 14 (03) : 1462 - 1469