A model of proto-object based saliency

被引:71
|
作者
Russell, Alexander F. [1 ]
Mihalas, Stefan [2 ,3 ]
von der Heydt, Rudiger [2 ,3 ]
Niebur, Ernst [2 ,3 ]
Etienne-Cummings, Ralph [1 ]
机构
[1] Johns Hopkins Univ, Dept Elect & Comp Engn, Baltimore, MD 21218 USA
[2] Johns Hopkins Univ, Dept Neurosci, Baltimore, MD 21218 USA
[3] Johns Hopkins Univ, Zanvyl Krieger Mind Brain Inst, Baltimore, MD 21218 USA
基金
美国国家科学基金会;
关键词
Attention; Saliency; Gestalt; Proto-object; LATERAL INTRAPARIETAL AREA; SELECTIVE VISUAL-ATTENTION; SUPERIOR COLLICULUS; NEURONAL-ACTIVITY; RECEPTIVE-FIELDS; EYE-MOVEMENTS; REPRESENTATION; MECHANISMS; CORTEX; FIGURE;
D O I
10.1016/j.visres.2013.10.005
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Organisms use the process of selective attention to optimally allocate their computational resources to the instantaneously most relevant subsets of a visual scene, ensuring that they can parse the scene in real time. Many models of bottom-up attentional selection assume that elementary image features, like intensity, color and orientation, attract attention. Gestalt psychologists, however, argue that humans perceive whole objects before they analyze individual features. This is supported by recent psychophysical studies that show that objects predict eye-fixations better than features. In this report we present a neurally inspired algorithm of object based, bottom-up attention. The model rivals the performance of state of the art non-biologically plausible feature based algorithms (and outperforms biologically plausible feature based algorithms) in its ability to predict perceptual saliency (eye fixations and subjective interest points) in natural scenes. The model achieves this by computing saliency as a function of proto-objects that establish the perceptual organization of the scene. All computational mechanisms of the algorithm have direct neural correlates, and our results provide evidence for the interface theory of attention. (C) 2013 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1 / 15
页数:15
相关论文
共 50 条
  • [1] Proto-Object Based Saliency Model With Texture Detection Channel
    Uejima, Takeshi
    Niebur, Ernst
    Etienne-Cummings, Ralph
    [J]. FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2020, 14
  • [2] A proto-object based saliency model in three-dimensional space
    Hu, Brian
    Kane-Jackson, Ralinkae
    Niebur, Ernst
    [J]. VISION RESEARCH, 2016, 119 : 42 - 49
  • [3] How is Motion Integrated into a Proto-Object Based Visual Saliency Model?
    Molin, Jamal Lottier
    Etienne-Cummings, Ralph
    Niebur, Ernst
    [J]. 2015 49TH ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS (CISS), 2015,
  • [4] Proto-Object Based Visual Saliency Model with a Motion-Sensitive Channel
    Molin, Jamal Lottier
    Russell, Alexander F.
    Mihalas, Stefan
    Niebur, Ernst
    Etienne-Cummings, Ralph
    [J]. 2013 IEEE BIOMEDICAL CIRCUITS AND SYSTEMS CONFERENCE (BIOCAS), 2013, : 25 - 28
  • [5] The influence of stereopsis on visual saliency in a proto-object based model of selective attention
    Uejima, Takeshi
    Mancinelli, Elena
    Niebur, Ernst
    Etienne-Cummings, Ralph
    [J]. VISION RESEARCH, 2023, 212
  • [6] Proto-Object Based Saliency Model with Second-Order Texture Feature
    Uejima, Takeshi
    Niebur, Ernst
    Etienne-Cummings, Ralph
    [J]. 2018 IEEE BIOMEDICAL CIRCUITS AND SYSTEMS CONFERENCE (BIOCAS): ADVANCED SYSTEMS FOR ENHANCING HUMAN HEALTH, 2018, : 599 - 602
  • [7] Proto-object based saliency for event-driven cameras
    Iacono, Massimiliano
    D'Angelo, Giulia
    Glover, Arren
    Tikhanoft, Vadim
    Niebur, Ernst
    Bartolozzi, Chiara
    [J]. 2019 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2019, : 805 - 812
  • [8] A Neuromorphic Proto-Object Based Dynamic Visual Saliency Model With a Hybrid FPGA Implementation
    Molin, Jamal Lottier
    Thakur, Chetan Singh
    Niebur, Ernst
    Etienne-Cummings, Ralph
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, 2021, 15 (03) : 580 - 594
  • [9] A proto-object based visual attention model
    Orabona, Francesco
    Metta, Giorgio
    Sandini, Giulio
    [J]. ATTENTION IN COGNITIVE SYSTEMS: THEORIES AND SYSTEMS FROM AN INTERDISCIPLINARY VIEWPOINT, 2007, 4840 : 198 - +
  • [10] Live Demonstration: Real-time Implementation of Proto-Object Based Visual Saliency Model
    Narayanan, Sathyaprakash
    Bethi, Yeshwanth
    Lottiert, Jamal
    Nieburt, Ernst
    Etienne-Cummings, Ralph
    Thakur, Chetan Singh
    [J]. 2019 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2019,