A model of proto-object based saliency

被引:71
|
作者
Russell, Alexander F. [1 ]
Mihalas, Stefan [2 ,3 ]
von der Heydt, Rudiger [2 ,3 ]
Niebur, Ernst [2 ,3 ]
Etienne-Cummings, Ralph [1 ]
机构
[1] Johns Hopkins Univ, Dept Elect & Comp Engn, Baltimore, MD 21218 USA
[2] Johns Hopkins Univ, Dept Neurosci, Baltimore, MD 21218 USA
[3] Johns Hopkins Univ, Zanvyl Krieger Mind Brain Inst, Baltimore, MD 21218 USA
基金
美国国家科学基金会;
关键词
Attention; Saliency; Gestalt; Proto-object; LATERAL INTRAPARIETAL AREA; SELECTIVE VISUAL-ATTENTION; SUPERIOR COLLICULUS; NEURONAL-ACTIVITY; RECEPTIVE-FIELDS; EYE-MOVEMENTS; REPRESENTATION; MECHANISMS; CORTEX; FIGURE;
D O I
10.1016/j.visres.2013.10.005
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Organisms use the process of selective attention to optimally allocate their computational resources to the instantaneously most relevant subsets of a visual scene, ensuring that they can parse the scene in real time. Many models of bottom-up attentional selection assume that elementary image features, like intensity, color and orientation, attract attention. Gestalt psychologists, however, argue that humans perceive whole objects before they analyze individual features. This is supported by recent psychophysical studies that show that objects predict eye-fixations better than features. In this report we present a neurally inspired algorithm of object based, bottom-up attention. The model rivals the performance of state of the art non-biologically plausible feature based algorithms (and outperforms biologically plausible feature based algorithms) in its ability to predict perceptual saliency (eye fixations and subjective interest points) in natural scenes. The model achieves this by computing saliency as a function of proto-objects that establish the perceptual organization of the scene. All computational mechanisms of the algorithm have direct neural correlates, and our results provide evidence for the interface theory of attention. (C) 2013 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1 / 15
页数:15
相关论文
共 50 条
  • [41] Fast object classification method based on saliency detection
    Yang Chao
    Wang Zhennan
    Jiang Xuepu
    Yu Hongyan
    Liu Sai
    Deng Liangzhu
    [J]. 2018 11TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID), VOL 1, 2018, : 374 - 377
  • [42] Saliency and depth-based unsupervised object segmentation
    He, Hu
    [J]. IET IMAGE PROCESSING, 2016, 10 (11) : 893 - 899
  • [43] Salient Object Extraction Based on Region Saliency Ratio
    Han, Zhongmin
    Liu, Zhi
    Zhang, Zhaoyang
    Lu, Yu
    Li, Weiwei
    Yan, Hongbo
    [J]. PROCEEDINGS OF THE 8TH IEEE/ACIS INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION SCIENCE, 2009, : 611 - +
  • [44] Saliency prediction based on object recognition and gaze analysis
    Ishikawa, Tomoki
    Yakoh, Takahiro
    [J]. ELECTRONICS AND COMMUNICATIONS IN JAPAN, 2021, 104 (02)
  • [45] Object tracking algorithm based on contextual visual saliency
    Fu Bao
    Peng XianRong
    [J]. 8TH INTERNATIONAL SYMPOSIUM ON ADVANCED OPTICAL MANUFACTURING AND TESTING TECHNOLOGY: OPTICAL TEST, MEASUREMENT TECHNOLOGY, AND EQUIPMENT, 2016, 9684
  • [46] Object Tracking Based on Saliency and Adaptive Background Constraint
    Wang, Jing
    Huang, Weichao
    [J]. PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 6533 - 6538
  • [47] Object detection system based on multimodel saliency maps
    Guo, Ya'nan
    Luo, Chongfan
    Ma, Yide
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2017, 26 (02)
  • [48] Saliency and Object Detection
    Kong, Phutphalla
    Mancas, Matei
    Kheang, Seng
    Gosselin, Bernard
    [J]. PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE (ICPRAI 2018), 2018, : 523 - 528
  • [49] Saliency Based Object Detection and Enhancements in Static Images
    Yousaf, Rehan Mehmood
    Rehman, Saad
    Dawood, Hassan
    Ping, Guo
    Mehmood, Zahid
    Azam, Shoaib
    Khan, Abdullah Aman
    [J]. INFORMATION SCIENCE AND APPLICATIONS 2017, ICISA 2017, 2017, 424 : 114 - 123
  • [50] SALIENCY BASED JOINT TOPIC DISCOVERY FOR OBJECT CATEGORIZATION
    Li, Zhidong
    Wang, Yang
    Geers, Glenn
    Chen, Jing
    Yang, Jun
    Laird, John
    [J]. 2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 4581 - 4584