DGAZE: Driver Gaze Mapping on Road

被引:10
|
作者
Dua, Isha [1 ]
John, Thrupthi Ann [1 ]
Gupta, Riya [1 ]
Jawahar, C., V [1 ]
机构
[1] IIIT, Ctr Visual Informat Technol, KCIS, Hyderabad, India
关键词
D O I
10.1109/IROS45743.2020.9341782
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Driver gaze mapping is crucial to estimate driver attention and determine which objects the driver is focusing on while driving. We introduce DGAZE, the first large-scale driver gaze mapping dataset. Unlike previous works, our dataset does not require expensive wearable eye-gaze trackers and instead relies on mobile phone cameras for data collection. The data was collected in a lab setting designed to mimic real driving conditions and has point and object-level annotation. It consists of 227,178 road-driver image pairs collected from 20 drivers and contains 103 unique objects on the road belonging to 7 classes: cars, pedestrians, traffic signals, motorbikes, auto-rickshaws, buses and signboards. We also present I-DGAZE, a fused convolutional neural network for predicting driver gaze on the road, which was trained on the DGAZE dataset. Our architecture combines facial features such as face location and head pose along with the image of the left eye to get optimum results. Our model achieves an error of 186.89 pixels on the road view of resolution 1920 x 1080 pixels. We compare our model with state-of-the-art eye gaze works and present extensive ablation results.
引用
收藏
页码:5946 / 5953
页数:8
相关论文
共 50 条
  • [31] Driver's Gaze Prediction in Dynamic Automotive Scenes
    Schwehr, Julian
    Willert, Volker
    2017 IEEE 20TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2017,
  • [32] Driver Behavior in Road Tunnels Association with Driver Stress and Performance
    Miller, Erika E.
    Boyle, Linda Ng
    TRANSPORTATION RESEARCH RECORD, 2015, (2518) : 60 - 67
  • [33] Assessing Driver Gaze Location in a Dynamic Vehicle Environment
    Lochbihler, Aidan
    Wallace, Bruce
    Van Benthem, Kathleen
    Herdman, Chris
    Sloan, Will
    Brightman, Kirsten
    Knoefel, Frank
    Marshall, Shawn
    2023 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE, I2MTC, 2023,
  • [34] Driver's Gaze Zone Estimation by Transfer Learning
    Tayibnapis, Iman Rahmansyah
    Choi, Min-Kook
    Kwon, Soon
    2018 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2018,
  • [35] A Driver Gaze Estimation Method Based on Deep Learning
    Shah, Sayyed Mudassar
    Sun, Zhaoyun
    Zaman, Khalid
    Hussain, Altaf
    Shoaib, Muhammad
    Pei, Lili
    SENSORS, 2022, 22 (10)
  • [36] Driver's Distraction Detection based on Gaze Estimation
    Maralappanavar, Shweta
    Behera, ReenaKumari
    Mudenagudi, Uma
    2016 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATIONS AND INFORMATICS (ICACCI), 2016, : 2489 - 2494
  • [37] Appearance-Based Gaze Estimation for Driver Monitoring
    Nikan, Soodeh
    Upadhyay, Devesh
    GAZE MEETS MACHINE LEARNING WORKSHOP, VOL 210, 2022, 210 : 127 - 139
  • [38] An Extensive Analysis of Different Approaches to Driver Gaze Classification
    Camberg, Simone
    Huellermeier, Eyke
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (11) : 16435 - 16448
  • [39] Recognition of a Driver's Gaze for Vehicle Headlamp Control
    Oh, Jae Hyun
    Kwak, Nojun
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2012, 61 (05) : 2008 - 2017
  • [40] Gaze-Dependent Tone Mapping
    Mantiuk, Radoslaw
    Markowski, Mateusz
    IMAGE ANALYSIS AND RECOGNITION, 2013, 7950 : 426 - 433