Image Signature: Highlighting Sparse Salient Regions

被引:662
|
作者
Hou, Xiaodi [1 ]
Harel, Jonathan [2 ]
Koch, Christof [3 ,4 ]
机构
[1] CALTECH, Dept Computat & Neural Syst, Pasadena, CA 91125 USA
[2] CALTECH, Dept Elect Engn, Pasadena, CA 91125 USA
[3] CALTECH, Dept Biol & Computat & Neural Syst, Pasadena, CA 91125 USA
[4] Korea Univ, Dept Brain & Cognit Engn, Seoul 136713, South Korea
基金
新加坡国家研究基金会;
关键词
Saliency; visual attention; change blindness; sign function; sparse signal analysis; ATTENTION; SCENE; RECONSTRUCTION; PHASE;
D O I
10.1109/TPAMI.2011.146
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We introduce a simple image descriptor referred to as the image signature. We show, within the theoretical framework of sparse signal mixing, that this quantity spatially approximates the foreground of an image. We experimentally investigate whether this approximate foreground overlaps with visually conspicuous image locations by developing a saliency algorithm based on the image signature. This saliency algorithm predicts human fixation points best among competitors on the Bruce and Tsotsos [1] benchmark data set and does so in much shorter running time. In a related experiment, we demonstrate with a change blindness data set that the distance between images induced by the image signature is closer to human perceptual distance than can be achieved using other saliency algorithms, pixel-wise, or GIST [2] descriptor methods.
引用
收藏
页码:194 / 201
页数:8
相关论文
共 50 条
  • [31] Invariant salient regions based image retrieval under viewpoint and illumination variations
    Shao, Ling
    Brady, Michael
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2006, 17 (06) : 1256 - 1272
  • [32] CONTENT-BASED IMAGE RETRIEVAL USING COLOR FEATURES OF SALIENT REGIONS
    An, Jaehyun
    Lee, Sang Hwa
    Cho, Nam Ik
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 3042 - 3046
  • [33] On image retrieval using salient regions with vector-spaces and latent semantics
    Hare, JS
    Lewis, PH
    [J]. IMAGE AND VIDEO RETRIEVAL, PROCEEDINGS, 2005, 3568 : 540 - 549
  • [34] Salient feature multimodal image fusion with a joint sparse model and multiscale dictionary learning
    Zhang, Chengfang
    Feng, Ziliang
    Gao, Zhisheng
    Jin, Xin
    Yan, Dan
    Yi, Liangzhong
    [J]. OPTICAL ENGINEERING, 2020, 59 (05)
  • [35] Multi-operator image retargeting with visual quality preservation of salient regions
    Tang, Zhenhua
    Yao, Jiemei
    Zhang, Qian
    Luo, Yuanting
    [J]. MULTIMEDIA SYSTEMS, 2023, 29 (02) : 811 - 829
  • [36] Studying the effect of optimizing image quality in salient regions at the expense of background content
    Alers, Hani
    Redi, Judith
    Liu, Hantao
    Heynderickx, Ingrid
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2013, 22 (04)
  • [37] Web image mining based on modeling concept-sensitive salient regions
    Liu, Jing
    Liu, Qingshan
    Wang, Jinqiao
    Lu, Hanqing
    Ma, Songde
    [J]. 2006 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO - ICME 2006, VOLS 1-5, PROCEEDINGS, 2006, : 505 - +
  • [38] A new similarity measure with deformation detection of visual salient regions for image retargeting
    Li, Canlin
    Zhu, Fubao
    Su, Rijian
    [J]. International Journal of Multimedia and Ubiquitous Engineering, 2014, 9 (07): : 1 - 14
  • [39] Multi-operator image retargeting with visual quality preservation of salient regions
    Zhenhua Tang
    Jiemei Yao
    Qian Zhang
    Yuanting Luo
    [J]. Multimedia Systems, 2023, 29 : 811 - 829
  • [40] A Novel Unsupervised Color Image Fuzzy Classification Scheme Based Salient Regions
    Zhang, Mingxin
    Shang, Zhaowei
    Shen, Junyi
    [J]. INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2008, 8 (01): : 170 - 178