GFNet: Gaze Focus Network using Attention for Gaze Estimation

被引:0
|
作者
Hu, Daosong [1 ]
Huang, Kai [1 ]
机构
[1] Sun Yat Sen Univ, Sch Comp Sci & Engn, Guangzhou, Peoples R China
关键词
Gaze estimation; Eye tracking; Convolutional neural network; Gaze focus; EYE GAZE;
D O I
10.1109/ICME55011.2023.00409
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Gaze estimation can be applied to human visual attention understanding. The current methods mainly obtain gaze mapping from facial or eye images, and most of them only focus on gaze point or gaze direction estimation. In this paper, we propose a multitask gaze focus network for gaze point and gaze direction estimation. Focus attention layer is used to guide the generation of facial features. By connecting eye and face features, feature similarity is used to get attention weights, and make it tend to eyes position. We propose four loss functions to constrain the network in 2D and 3D spaces. The combination of eye position constraint and focus attention layer ensures the accuracy of gaze point estimation. Gaze focus is used to obtain gaze depth. Through comprehensive experiments, the advantages of proposed method in gaze tracking are verified. In addition, the application prospect of proposed method in depth-overlapping is proved.
引用
收藏
页码:2399 / 2404
页数:6
相关论文
共 50 条
  • [31] Video attention prediction using gaze saliency
    Yanxiang Chen
    Gang Tao
    Qiangqiang Xie
    Minglong Song
    [J]. Multimedia Tools and Applications, 2019, 78 : 26867 - 26884
  • [32] Video attention prediction using gaze saliency
    Chen, Yanxiang
    Tao, Gang
    Xie, Qiangqiang
    Song, Minglong
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (19) : 26867 - 26884
  • [33] A model of attention and interest using gaze behavior
    Peters, C
    Pelachaud, C
    Bevacqua, E
    Mancini, M
    Poggi, I
    [J]. INTELLIGENT VIRTUAL AGENTS, PROCEEDINGS, 2005, 3661 : 229 - 240
  • [34] Peripheral cues and gaze direction jointly focus attention and inhibition of return
    Hudson, Matthew
    Skarratt, Paul A.
    [J]. COGNITIVE NEUROSCIENCE, 2016, 7 (1-4) : 67 - 73
  • [35] Diverted Gaze Captures Attention Easier Than Direct Gaze
    Chen, Enguang
    Wang, Hailing
    [J]. INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2021, 168 : S194 - S195
  • [36] Tracking Gaze and Visual Focus of Attention of People Involved in Social Interaction
    Masse, Benoit
    Ba, Sileye
    Horaud, Radu
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (11) : 2711 - 2724
  • [37] Robust Validation of Visual Focus of Attention using Adaptive Fusion of Head and Eye Gaze patterns
    Asteriadis, Stylianos
    Karpouzis, Kostas
    Kollias, Stefanos
    [J]. 2011 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCV WORKSHOPS), 2011,
  • [38] Gaze estimation via self-attention augmented convolutions
    Vieira, Gabriel Lefundes
    Oliveira, Luciano
    [J]. 2021 34TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI 2021), 2021, : 49 - 56
  • [39] Monocular 3D gaze estimation using feature discretization and attention mechanism
    Sha, Tong
    Sun, Jinglin
    Pun, Siohang
    Liu, Yu
    [J]. OPTOELECTRONICS LETTERS, 2023, 19 (05) : 301 - 306
  • [40] Monocular 3D gaze estimation using feature discretization and attention mechanism
    Tong Sha
    Jinglin Sun
    Siohang Pun
    Yu Liu
    [J]. Optoelectronics Letters, 2023, 19 : 301 - 306