Gaze estimation using convolutional neural networks

被引:0
|
作者
Karmi, Rawdha [1 ]
Rahmany, Ines [1 ]
Khlifa, Nawres [2 ]
机构
[1] Univ Kairouan, Fac Sci & Tech, Kairouan, Tunisia
[2] Univ Tunis El Manar, ISTMT, Lab Biophys & Technol Med, Tunis, Tunisia
关键词
Gaze estimation; Eye tracking; Deep learning; CNN;
D O I
10.1007/s11760-023-02723-8
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Numerous investigations on gaze estimate techniques for analyzing human behavior have been made in recent years, the majority of which have focused on gaze tracking techniques. This article proposes a new method for gaze estimation. The proposed system is divided into three phases: (i) estimation of head position using convolutional neural networks (CNN) (VGG16, Resnet50, InceptionV3), (ii) detection of eyes area using Viola Jones' algorithm, and in phase (iii) gaze estimation using three different models: pre-trained CNN, CNN from scratch, as well as bilinear convolutional neural networks. Columbia gaze database is used in the validation experiments. The results obtained from our novel gaze estimation method exhibit significantly improved accuracy compared to the existing approaches in the same field, which are limited in number.
引用
收藏
页码:389 / 398
页数:10
相关论文
共 50 条
  • [1] Gaze estimation using convolutional neural networks
    Rawdha Karmi
    Ines Rahmany
    Nawres Khlifa
    [J]. Signal, Image and Video Processing, 2024, 18 : 389 - 398
  • [2] On Generalizing Driver Gaze Zone Estimation using Convolutional Neural Networks
    Vora, Sourabh
    Rangesh, Akshay
    Trivedi, Mohan M.
    [J]. 2017 28TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV 2017), 2017, : 849 - 854
  • [3] Multiview Multitask Gaze Estimation With Deep Convolutional Neural Networks
    Lian, Dongze
    Hu, Lina
    Luo, Weixin
    Xu, Yanyu
    Duan, Lixin
    Yu, Jingyi
    Gao, Shenghua
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (10) : 3010 - 3023
  • [4] Convolutional Neural Networks for eye detection in remote gaze estimation systems
    Jerry, Chi Ling Lam
    Eizenman, Moshe
    [J]. IMECS 2008: INTERNATIONAL MULTICONFERENCE OF ENGINEERS AND COMPUTER SCIENTISTS, VOLS I AND II, 2008, : 601 - 606
  • [5] ESTIMATION OF GAZE REGION USING TWO DIMENSIONAL PROBABILISTIC MAPS CONSTRUCTED USING CONVOLUTIONAL NEURAL NETWORKS
    Jha, Sumit
    Busso, Carlos
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 3792 - 3796
  • [6] Driver Gaze Zone Estimation Using Convolutional Neural Networks: A General Framework and Ablative Analysis
    Vora, Sourabh
    Rangesh, Akshay
    Trivedi, Mohan Manubhai
    [J]. IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2018, 3 (03): : 254 - 265
  • [7] Gaze Estimation with Multi-scale Attention-based Convolutional Neural Networks
    Zhang, Yuanyuan
    Li, Jing
    Ouyang, Gaoxiang
    [J]. 2023 29TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND MACHINE VISION IN PRACTICE, M2VIP 2023, 2023,
  • [8] Appearance-based Gaze Estimation with Multi-Modal Convolutional Neural Networks
    Wang, Fei
    Wang, Yan
    Li, Teng
    [J]. INTERNATIONAL SYMPOSIUM ON ARTIFICIAL INTELLIGENCE AND ROBOTICS 2021, 2021, 11884
  • [9] Vegetation Cover Estimation Using Convolutional Neural Networks
    Ghazal, Mohammed Asaad
    Mahmoud, Ali
    Aslantas, Ali
    Soliman, Ahmed
    Shalaby, Ahmed
    Benediktsson, Jon Atli
    El-Baz, Ayman
    [J]. IEEE ACCESS, 2019, 7 : 132563 - 132576
  • [10] Epicentral Region Estimation Using Convolutional Neural Networks
    Cruz, Leonel
    Tous, Ruben
    Otero, Beatriz
    Alvarado, Leonardo
    Mus, Sergi
    Rojas, Otilio
    [J]. MACHINE LEARNING, OPTIMIZATION, AND DATA SCIENCE (LOD 2021), PT I, 2022, 13163 : 541 - 552