GFNet: Gaze Focus Network using Attention for Gaze Estimation

被引:0
|
作者
Hu, Daosong [1 ]
Huang, Kai [1 ]
机构
[1] Sun Yat Sen Univ, Sch Comp Sci & Engn, Guangzhou, Peoples R China
关键词
Gaze estimation; Eye tracking; Convolutional neural network; Gaze focus; EYE GAZE;
D O I
10.1109/ICME55011.2023.00409
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Gaze estimation can be applied to human visual attention understanding. The current methods mainly obtain gaze mapping from facial or eye images, and most of them only focus on gaze point or gaze direction estimation. In this paper, we propose a multitask gaze focus network for gaze point and gaze direction estimation. Focus attention layer is used to guide the generation of facial features. By connecting eye and face features, feature similarity is used to get attention weights, and make it tend to eyes position. We propose four loss functions to constrain the network in 2D and 3D spaces. The combination of eye position constraint and focus attention layer ensures the accuracy of gaze point estimation. Gaze focus is used to obtain gaze depth. Through comprehensive experiments, the advantages of proposed method in gaze tracking are verified. In addition, the application prospect of proposed method in depth-overlapping is proved.
引用
收藏
页码:2399 / 2404
页数:6
相关论文
共 50 条
  • [1] Visual Focus of Attention in Non-calibrated Environments using Gaze Estimation
    Asteriadis, Stylianos
    Karpouzis, Kostas
    Kollias, Stefanos
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2014, 107 (03) : 293 - 316
  • [2] Visual Focus of Attention in Non-calibrated Environments using Gaze Estimation
    Stylianos Asteriadis
    Kostas Karpouzis
    Stefanos Kollias
    [J]. International Journal of Computer Vision, 2014, 107 : 293 - 316
  • [3] Gaze Estimation by Attention Using a Two-Stream Regression Network
    Karazor, Ahmet
    Bayar, Alperen Enes
    Topal, Cihan
    Cevikalp, Hakan
    [J]. 2023 31ST SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, SIU, 2023,
  • [4] EG-Net: Appearance-based eye gaze estimation using an efficient gaze network with attention mechanism
    Wu, Xinmei
    Li, Lin
    Zhu, Haihong
    Zhou, Gang
    Li, Linfeng
    Su, Fei
    He, Shen
    Wang, Yanggang
    Long, Xue
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238
  • [5] Gaze Estimation Based on Attention Mechanism Combined With Temporal Network
    Ren, Guojing
    Zhang, Yang
    Feng, Qingjuan
    [J]. IEEE ACCESS, 2023, 11 : 107150 - 107159
  • [6] Gaze Estimation Using Residual Neural Network
    Wong, En Teng
    Yean, Seanglidet
    Hu, Qingyao
    Lee, Bu Sung
    Liu, Jigang
    Deepu, Rajan
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING AND COMMUNICATIONS WORKSHOPS (PERCOM WORKSHOPS), 2019, : 411 - 414
  • [7] The focus of expansion attracts attention and eye gaze
    Fukuchi, Masaki
    Tsuchiya, Naotsugu
    Koch, Christof
    [J]. NEUROSCIENCE RESEARCH, 2009, 65 : S59 - S60
  • [8] Gaze Estimation Using Neural Network And Logistic Regression
    Xia, Yifan
    Liang, Baosheng
    Li, Zhaotong
    Gao, Song
    [J]. COMPUTER JOURNAL, 2022, 65 (08): : 2034 - 2043
  • [9] Connecting Gaze, Scene, and Attention: Generalized Attention Estimation via Joint Modeling of Gaze and Scene Saliency
    Chong, Eunji
    Ruiz, Nataniel
    Wang, Yongxin
    Zhang, Yun
    Rozga, Agata
    Rehg, James M.
    [J]. COMPUTER VISION - ECCV 2018, PT V, 2018, 11209 : 397 - 412
  • [10] Perception of Direct Gaze Does Not Require Focus of Attention
    Takemasa Yokoyama
    Hiroki Sakai
    Yasuki Noguchi
    Shinichi Kita
    [J]. Scientific Reports, 4