Image Signature: Highlighting Sparse Salient Regions

被引:663
|
作者
Hou, Xiaodi [1 ]
Harel, Jonathan [2 ]
Koch, Christof [3 ,4 ]
机构
[1] CALTECH, Dept Computat & Neural Syst, Pasadena, CA 91125 USA
[2] CALTECH, Dept Elect Engn, Pasadena, CA 91125 USA
[3] CALTECH, Dept Biol & Computat & Neural Syst, Pasadena, CA 91125 USA
[4] Korea Univ, Dept Brain & Cognit Engn, Seoul 136713, South Korea
基金
新加坡国家研究基金会;
关键词
Saliency; visual attention; change blindness; sign function; sparse signal analysis; ATTENTION; SCENE; RECONSTRUCTION; PHASE;
D O I
10.1109/TPAMI.2011.146
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We introduce a simple image descriptor referred to as the image signature. We show, within the theoretical framework of sparse signal mixing, that this quantity spatially approximates the foreground of an image. We experimentally investigate whether this approximate foreground overlaps with visually conspicuous image locations by developing a saliency algorithm based on the image signature. This saliency algorithm predicts human fixation points best among competitors on the Bruce and Tsotsos [1] benchmark data set and does so in much shorter running time. In a related experiment, we demonstrate with a change blindness data set that the distance between images induced by the image signature is closer to human perceptual distance than can be achieved using other saliency algorithms, pixel-wise, or GIST [2] descriptor methods.
引用
收藏
页码:194 / 201
页数:8
相关论文
共 50 条
  • [1] Sparse representation of salient regions for no-reference image quality assessment
    Feng, Tianpeng
    Deng, Dexiang
    Yan, Jia
    Zhang, Weixia
    Shi, Wenxuan
    Zou, Lian
    [J]. INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2016, 13 : 1 - 11
  • [2] Image categorization using a semantic hierarchy model with sparse set of salient regions
    Chunping Liu
    Yang Zheng
    Shengrong Gong
    [J]. Frontiers of Computer Science, 2013, 7 : 838 - 851
  • [3] Image categorization using a semantic hierarchy model with sparse set of salient regions
    Liu, Chunping
    Zheng, Yang
    Gong, Shengrong
    [J]. FRONTIERS OF COMPUTER SCIENCE, 2013, 7 (06) : 838 - 851
  • [4] Image categorization using a semantic hierarchy model with sparse set of salient regions
    Chunping LIU
    Yang ZHENG
    Shengrong GONG
    [J]. Frontiers of Computer Science, 2013, 7 (06) - 851
  • [5] Scene Classification with a Sparse Set of Salient Regions
    Borji, Ali
    Itti, Laurent
    [J]. 2011 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2011, : 1902 - 1908
  • [6] Image authentication based on salient regions of image
    Arya, Utkarsh
    Singh, Ghanapriya
    Singhal, Rishabh
    Kumar, Saroj
    Usmaan, Huzaifa
    [J]. 2017 INTERNATIONAL ELECTRICAL ENGINEERING CONGRESS (IEECON), 2017,
  • [7] Salient regions for query by image content
    Hare, JS
    Lewis, PH
    [J]. IMAGE AND VIDEO RETRIEVAL, PROCEEDINGS, 2004, 3115 : 317 - 325
  • [8] Detection and description of image salient regions
    Chen, Xiu-Xin
    Jia, Ke-Bin
    Sun, Xiao-Rong
    [J]. Beijing Gongye Daxue Xuebao/Journal of Beijing University of Technology, 2012, 38 (09): : 1343 - 1347
  • [9] Infrared and Visible Image Fusion for Highlighting Salient Targets in the Night Scene
    Zhan, Weida
    Wang, Jiale
    Jiang, Yichun
    Chen, Yu
    Zheng, Tingyuan
    Hong, Yang
    [J]. ENTROPY, 2022, 24 (12)
  • [10] A probabilistic definition of salient regions for image matching
    Maybank, S. J.
    [J]. NEUROCOMPUTING, 2013, 120 : 4 - 14