DGAZE: Driver Gaze Mapping on Road

被引:10
|
作者
Dua, Isha [1 ]
John, Thrupthi Ann [1 ]
Gupta, Riya [1 ]
Jawahar, C., V [1 ]
机构
[1] IIIT, Ctr Visual Informat Technol, KCIS, Hyderabad, India
关键词
D O I
10.1109/IROS45743.2020.9341782
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Driver gaze mapping is crucial to estimate driver attention and determine which objects the driver is focusing on while driving. We introduce DGAZE, the first large-scale driver gaze mapping dataset. Unlike previous works, our dataset does not require expensive wearable eye-gaze trackers and instead relies on mobile phone cameras for data collection. The data was collected in a lab setting designed to mimic real driving conditions and has point and object-level annotation. It consists of 227,178 road-driver image pairs collected from 20 drivers and contains 103 unique objects on the road belonging to 7 classes: cars, pedestrians, traffic signals, motorbikes, auto-rickshaws, buses and signboards. We also present I-DGAZE, a fused convolutional neural network for predicting driver gaze on the road, which was trained on the DGAZE dataset. Our architecture combines facial features such as face location and head pose along with the image of the left eye to get optimum results. Our model achieves an error of 186.89 pixels on the road view of resolution 1920 x 1080 pixels. We compare our model with state-of-the-art eye gaze works and present extensive ablation results.
引用
收藏
页码:5946 / 5953
页数:8
相关论文
共 50 条
  • [21] Improving Driver Gaze Prediction With Reinforced Attention
    Lv, Kai
    Sheng, Hao
    Xiong, Zhang
    Li, Wei
    Zheng, Liang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 4198 - 4207
  • [22] Recognition of driver gaze direction based on PCA
    Lu Yu-feng
    Wang Zeng-cai
    Liu Xue-Zhong
    Yang Xiu-Jian
    DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES B-APPLICATIONS & ALGORITHMS, 2007, 14 : 1057 - 1060
  • [23] Self-calibrated driver gaze estimation via gaze pattern learning
    Yuan, Guoliang
    Wang, Yafei
    Yan, Huizhu
    Fu, Xianping
    KNOWLEDGE-BASED SYSTEMS, 2022, 235
  • [24] Analysis of Driver Gaze and Attention to Traffic Signs
    Shabani, Shabnam
    Beauchemin, Steven
    Bauer, Michael
    JOURNAL OF ADVANCED TRANSPORTATION, 2022, 2022
  • [25] THE RESEARCH OF DRIVER'S GAZE AT THE TRAFFIC SIGNS
    Hudak, Martin
    Madlenak, Radovan
    CBU INTERNATIONAL CONFERENCE PROCEEDINGS 2016: INNOVATIONS IN SCIENCE AND EDUCATION, 2016, 4 : 896 - 899
  • [26] Predicting driver behaviour at intersections based on driver gaze and traffic light recognition
    Rahman, Md Junaedur
    Beauchemin, Steven S.
    Bauer, Michael A.
    IET INTELLIGENT TRANSPORT SYSTEMS, 2020, 14 (14) : 2083 - 2091
  • [27] ROAD SAFETY AND DRIVER BEHAVIOR
    FOOT, HC
    CHAPMAN, AJ
    ERGONOMICS, 1982, 25 (10) : 863 - 865
  • [28] ROAD ACCIDENTS AND UNFIT DRIVER
    不详
    BRITISH MEDICAL JOURNAL, 1978, 2 (6150): : 1471 - 1473
  • [29] DRIVER EDUCATION AND HAZARDS OF THE ROAD
    HARMAN, C
    AMERICAN JOURNAL OF PUBLIC HEALTH, 1981, 71 (02) : 171 - 171
  • [30] The driver, the road, the rules ... and the rest? A systems-based approach to young driver road safety
    Scott-Parker, B.
    Goode, N.
    Salmon, P.
    ACCIDENT ANALYSIS AND PREVENTION, 2015, 74 : 297 - 305