Markov chain based computational visual attention model that learns from eye tracking data

被引:12
|
作者
Zhong, Ma [1 ]
Zhao Xinbo [2 ]
Zou Xiao-chun [3 ]
Wang, James Z. [4 ]
Wang Wenhu [1 ]
机构
[1] Northwestern Polytech Univ, Lab Contemporary Design & Integrated Mfg Technol, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Sch Comp Sci & Engn, Xian 710072, Peoples R China
[3] Northwestern Polytech Univ, Sch Elect & Informat, Xian 710072, Peoples R China
[4] Clemson Univ, Sch Comp, Clemson, SC 29634 USA
基金
中国国家自然科学基金;
关键词
Attention model; Eye tracking; Markov chain; Saliency; Human fixations; FEATURES;
D O I
10.1016/j.patrec.2014.06.002
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Computational visual attention models are a topic of increasing importance in computer understanding of images. Most existing attention models are based on bottom-up computation that often does not match actual human attention. To address this problem, we propose a novel visual attention model that is learned from actual eye tracking data. We use a Markov chain to model the relationship between the image feature and the saliency, then train a support vector regression (SVR) from true eye tracking data to predict the transition probabilities of the Markov chain. Finally, a saliency map predicting user's attention is obtained from the stationary distribution of this chain. Our experimental evaluations on several benchmark datasets demonstrate that the results of the proposed approach are comparable with or outperform the state-of-art models on prediction of human eye fixations and interest region detection. (C) 2014 Elsevier B.V. All rights reserved.
引用
收藏
页码:1 / 10
页数:10
相关论文
共 50 条
  • [1] Revisiting Visual Attention Identification Based on Eye Tracking Data Analytics
    Zhang, Yingxue
    Chen, Zhenzhong
    [J]. 2016 30TH ANNIVERSARY OF VISUAL COMMUNICATION AND IMAGE PROCESSING (VCIP), 2016,
  • [2] Classification of Autism Spectrum Disorder Severity Using Eye Tracking Data Based on Visual Attention Model
    Revers, Mirian C.
    Oliveira, Jessica S.
    Franco, Felipe O.
    Portolese, Joana
    Cardoso, Thiago, V
    Silva, Andreia F.
    Machado-Lima, Ariane
    Nunes, Fatima L. S.
    Brentani, Helena
    [J]. 2021 IEEE 34TH INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS (CBMS), 2021, : 142 - 147
  • [3] Emotional Attention: From Eye Tracking to Computational Modeling
    Fan, Shaojing
    Shen, Zhiqi
    Jiang, Ming
    Koenig, Bryan L. L.
    Kankanhalli, Mohan S. S.
    Zhao, Qi
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (02) : 1682 - 1699
  • [4] REFINING A REGION BASED ATTENTION MODEL USING EYE TRACKING DATA
    Liang, Zhen
    Fu, Hong
    Chi, Zheru
    Feng, Dagan
    [J]. 2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 1105 - 1108
  • [5] Visual Attention in Objective Image Quality Assessment: Based on Eye-Tracking Data
    Liu, Hantao
    Heynderickx, Ingrid
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2011, 21 (07) : 971 - 982
  • [6] A Visual Attention Model Based on Eye Tracking in 3D Scene Maps
    Yang, Bincheng
    Li, Hongwei
    [J]. ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2021, 10 (10)
  • [7] Computational sensor for visual tracking with attention
    Brajovic, V
    Kanade, T
    [J]. IEEE JOURNAL OF SOLID-STATE CIRCUITS, 1998, 33 (08) : 1199 - 1207
  • [8] Visual Attention Model Based Object Tracking
    Ma, Lili
    Cheng, Jian
    Liu, Jing
    Wang, Jinqiao
    Lu, Hanging
    [J]. ADVANCES IN MULTIMEDIA INFORMATION PROCESSING-PCM 2010, PT II, 2010, 6298 : 483 - 493
  • [9] Visual attention based ROI maps from gaze tracking data
    Nguyen, A
    Chandran, V
    Sridharan, S
    [J]. ICIP: 2004 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1- 5, 2004, : 3495 - 3498
  • [10] Visual saliency model based on crowdsourcing eye tracking data and its application in visual design
    Shiwei Cheng
    Jing Fan
    Yilin Hu
    [J]. Personal and Ubiquitous Computing, 2023, 27 : 613 - 630