DGAZE: Driver Gaze Mapping on Road

被引:10
|
作者
Dua, Isha [1 ]
John, Thrupthi Ann [1 ]
Gupta, Riya [1 ]
Jawahar, C., V [1 ]
机构
[1] IIIT, Ctr Visual Informat Technol, KCIS, Hyderabad, India
关键词
D O I
10.1109/IROS45743.2020.9341782
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Driver gaze mapping is crucial to estimate driver attention and determine which objects the driver is focusing on while driving. We introduce DGAZE, the first large-scale driver gaze mapping dataset. Unlike previous works, our dataset does not require expensive wearable eye-gaze trackers and instead relies on mobile phone cameras for data collection. The data was collected in a lab setting designed to mimic real driving conditions and has point and object-level annotation. It consists of 227,178 road-driver image pairs collected from 20 drivers and contains 103 unique objects on the road belonging to 7 classes: cars, pedestrians, traffic signals, motorbikes, auto-rickshaws, buses and signboards. We also present I-DGAZE, a fused convolutional neural network for predicting driver gaze on the road, which was trained on the DGAZE dataset. Our architecture combines facial features such as face location and head pose along with the image of the left eye to get optimum results. Our model achieves an error of 186.89 pixels on the road view of resolution 1920 x 1080 pixels. We compare our model with state-of-the-art eye gaze works and present extensive ablation results.
引用
收藏
页码:5946 / 5953
页数:8
相关论文
共 50 条
  • [1] Correlating driver gaze with the road scene for driver assistance systems
    Fletcher, L
    Loy, G
    Barnes, N
    Zelinsky, A
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2005, 52 (01) : 71 - 84
  • [2] Driver gaze tracking and eyes off the road detection
    Badgujar P.
    Selmokar P.
    Materials Today: Proceedings, 2023, 72 : 1863 - 1868
  • [3] DGaze: CNN-Based Gaze Prediction in Dynamic Scenes
    Hu, Zhiming
    Li, Sheng
    Zhang, Congyi
    Yi, Kangrui
    Wang, Guoping
    Manocha, Dinesh
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2020, 26 (05) : 1902 - 1911
  • [4] Driver Gaze Tracking and Eyes Off the Road Detection System
    Vicente, Francisco
    Huang, Zehua
    Xiong, Xuehan
    De la Torre, Fernando
    Zhang, Wende
    Levi, Dan
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2015, 16 (04) : 2014 - 2027
  • [5] Influence of Road Geometry on Driver's Gaze Behavior on Motorways
    Hristov, Borislav
    XXII INTERNATIONAL SCIENTIFIC CONFERENCE: CONSTRUCTION THE FORMATION OF LIVING ENVIRONMENT (FORM-2019), 2019, 97
  • [6] Context sensitive driver assistance based on gaze - Road scene correlation
    Fletcher, Luke
    Zelinsky, Alexander
    EXPERIMENTAL ROBOTICS, 2008, 39 : 287 - +
  • [7] Driver Inattention Detection based on Eye Gaze-Road Event Correlation
    Fletcher, Luke
    Zelinsky, Alexander
    INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2009, 28 (06): : 774 - 801
  • [8] Appearance-based Driver's Gaze Mapping Using a Dash Camera
    Sonom-Ochir, Ulziibayar
    Karungaru, Stephen
    Terada, Kenji
    Ayush, Altangerel
    2022 JOINT 12TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS AND 23RD INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS (SCIS&ISIS), 2022,
  • [9] Effect of road markings and road signs quality on driving behaviour, driver's gaze patterns and driver's cognitive load at night-time
    Fiolic, Mario
    Babic, Darko
    Babic, Dario
    Tomasovic, Sanja
    TRANSPORTATION RESEARCH PART F-TRAFFIC PSYCHOLOGY AND BEHAVIOUR, 2023, 99 : 306 - 318
  • [10] Look Both Ways: Self-supervising Driver Gaze Estimation and Road Scene Saliency
    Kasahara, Isaac
    Stent, Simon
    Park, Hyun Soo
    COMPUTER VISION, ECCV 2022, PT XIII, 2022, 13673 : 126 - 142