Image Signature: Highlighting Sparse Salient Regions

被引:662
|
作者
Hou, Xiaodi [1 ]
Harel, Jonathan [2 ]
Koch, Christof [3 ,4 ]
机构
[1] CALTECH, Dept Computat & Neural Syst, Pasadena, CA 91125 USA
[2] CALTECH, Dept Elect Engn, Pasadena, CA 91125 USA
[3] CALTECH, Dept Biol & Computat & Neural Syst, Pasadena, CA 91125 USA
[4] Korea Univ, Dept Brain & Cognit Engn, Seoul 136713, South Korea
基金
新加坡国家研究基金会;
关键词
Saliency; visual attention; change blindness; sign function; sparse signal analysis; ATTENTION; SCENE; RECONSTRUCTION; PHASE;
D O I
10.1109/TPAMI.2011.146
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We introduce a simple image descriptor referred to as the image signature. We show, within the theoretical framework of sparse signal mixing, that this quantity spatially approximates the foreground of an image. We experimentally investigate whether this approximate foreground overlaps with visually conspicuous image locations by developing a saliency algorithm based on the image signature. This saliency algorithm predicts human fixation points best among competitors on the Bruce and Tsotsos [1] benchmark data set and does so in much shorter running time. In a related experiment, we demonstrate with a change blindness data set that the distance between images induced by the image signature is closer to human perceptual distance than can be achieved using other saliency algorithms, pixel-wise, or GIST [2] descriptor methods.
引用
收藏
页码:194 / 201
页数:8
相关论文
共 50 条
  • [21] Detection Methods of Salient Regions in Super-Resolution Based on Sparse Representation
    Berk, Omer
    Ozdemir, Gulcihan
    Toreyin, Behcet Ugur
    Capar, Abdulkerim
    [J]. 2019 MEDICAL TECHNOLOGIES CONGRESS (TIPTEKNO), 2019, : 397 - 400
  • [22] Image retrieval using wavelet-based salient regions
    Jian, M. W.
    Dong, J. Y.
    Ma, J.
    [J]. IMAGING SCIENCE JOURNAL, 2011, 59 (04): : 219 - 231
  • [23] Blind Image Deblurring via Salient Structure Detection and Sparse Representation
    Cai, Yu
    Pan, Jinshan
    Su, Zhixun
    [J]. IMAGE AND VIDEO TECHNOLOGY (PSIVT 2017), 2018, 10799 : 283 - 299
  • [24] Can Salient Interest Regions Resume Emotional Impact of an Image?
    Gbehounou, Syntyche
    Lecellier, Francois
    Fernandez-Maloigne, Christine
    Courboulay, Vincent
    [J]. COMPUTER ANALYSIS OF IMAGES AND PATTERNS, PT I, 2013, 8047 : 515 - 522
  • [25] Sparse and Redundant Modeling of Image Content Using an Image-Signature-Dictionary
    Aharon, Michal
    Elad, Michael
    [J]. SIAM JOURNAL ON IMAGING SCIENCES, 2008, 1 (03): : 228 - 247
  • [26] Image auto-annotation using a statistical model with salient regions
    Tang, Jiayu
    Hare, Jonathon S.
    Lewis, Paul H.
    [J]. 2006 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO - ICME 2006, VOLS 1-5, PROCEEDINGS, 2006, : 525 - +
  • [27] Image-to-Image Translation on Defined Highlighting Regions by Semi-Supervised Semantic Segmentation
    Chang, Ching-Yu
    Ye, Chun-Ting
    Wei, Tzer-Jen
    [J]. 2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [28] Finding salient regions in images - Nonparametric clustering for image segmentation and grouping
    Pauwels, EJ
    Frederix, G
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 1999, 75 (1-2) : 73 - 85
  • [29] Wavelet-based salient regions and their spatial distribution for image retrieval
    Jian, Muwei
    Dong, Junyu
    Jiang, Rong
    [J]. 2007 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-5, 2007, : 2194 - +
  • [30] Salient Object Detection based on Sparse Representation with Image-Specific Prior
    Seo, Yana
    Yoo, Chang D.
    [J]. 18TH IEEE INTERNATIONAL SYMPOSIUM ON CONSUMER ELECTRONICS (ISCE 2014), 2014,