Bottom-Up Saliency Detection Model Based on Human Visual Sensitivity and Amplitude Spectrum

被引:124
|
作者
Fang, Yuming [1 ]
Lin, Weisi [1 ]
Lee, Bu-Sung [1 ]
Lau, Chiew-Tong [1 ]
Chen, Zhenzhong [2 ]
Lin, Chia-Wen [3 ]
机构
[1] Nanyang Technol Univ, Sch Comp Engn, Singapore 639798, Singapore
[2] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
[3] Natl Tsing Hua Univ, Dept Elect Engn, Hsinchu 30013, Taiwan
关键词
Amplitude spectrum; Fourier transform; human visual sensitivity; saliency detection; visual attention; GUIDED SEARCH; TOP-DOWN; ATTENTION; COLOR; IMAGE; GUIDANCE; SCENE;
D O I
10.1109/TMM.2011.2169775
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the wide applications of saliency information in visual signal processing, many saliency detection methods have been proposed. However, some key characteristics of the human visual system (HVS) are still neglected in building these saliency detection models. In this paper, we propose a new saliency detection model based on the human visual sensitivity and the amplitude spectrum of quaternion Fourier transform (QFT). We use the amplitude spectrum of QFT to represent the color, intensity, and orientation distributions for image patches. The saliency value for each image patch is calculated by not only the differences between the QFT amplitude spectrum of this patch and other patches in the whole image, but also the visual impacts for these differences determined by the human visual sensitivity. The experiment results show that the proposed saliency detection model outperforms the state-of-the-art detection models. In addition, we apply our proposed model in the application of image retargeting and achieve better performance over the conventional algorithms.
引用
收藏
页码:187 / 198
页数:12
相关论文
共 50 条
  • [31] Bottom-up saliency detection with sparse representation of learnt texture atoms
    Xu, Mai
    Jiang, Lai
    Ye, Zhaoting
    Wang, Zulin
    PATTERN RECOGNITION, 2016, 60 : 348 - 360
  • [32] Optimization of Bottom-up Saliency Detection through Gram Polynomial Decimation
    Ullah, Shan
    Choudhry, Aadil Jaleel
    Badshah, Amir
    PROCEEDINGS OF 2018 15TH INTERNATIONAL BHURBAN CONFERENCE ON APPLIED SCIENCES AND TECHNOLOGY (IBCAST), 2018, : 330 - 333
  • [33] A Novel Bottom-Up Saliency Detection Method for Video With Dynamic Background
    Chen, Chenglizhao
    Li, Yunxiao
    Li, Shuai
    Qin, Hong
    Hao, Aimin
    IEEE SIGNAL PROCESSING LETTERS, 2018, 25 (02) : 154 - 158
  • [34] Boosting Bottom-up and Top-down Visual Features for Saliency Estimation
    Borji, Ali
    2012 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2012, : 438 - 445
  • [35] Psychophysical tests of the hypothesis of a bottom-up saliency map in primary visual cortex
    Zhaoping, Li
    May, Keith A.
    PLOS COMPUTATIONAL BIOLOGY, 2007, 3 (04) : 616 - 633
  • [36] Combining Top-down and Bottom-up Visual Saliency for Firearms Localization
    Ardizzone, Edoardo
    Gallea, Roberto
    La Cascia, Marco
    Mazzola, Giuseppe
    2014 INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND MULTIMEDIA APPLICATIONS (SIGMAP), 2014, : 25 - 32
  • [37] A Survey of Bottom-up Visual Saliency Methods in Wireless Multimedia Sensor Networks
    Ngau, Christopher Wing Hong
    Ang, Li-Minn
    Seng, Kah Phooi
    2009 INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS, VOL 2, PROCEEDINGS, 2009, : 335 - 338
  • [38] Implementation of Visual Attention System Using Artificial Retina Chip and Bottom-Up Saliency Map Model
    Kim, Bumhwi
    Okuno, Hirotsugu
    Yagi, Tetsuya
    Lee, Minho
    NEURAL INFORMATION PROCESSING, PT III, 2011, 7064 : 416 - +
  • [39] Tag-Saliency: Combining bottom-up and top-down information for saliency detection
    Zhu, Guokang
    Wang, Qi
    Yuan, Yuan
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2014, 118 : 40 - 49
  • [40] Analyzing bottom-up saliency in natural movies
    Vig, E.
    Dorr, M.
    Barth, E.
    PERCEPTION, 2010, 39 : 35 - 35