Bottom-Up Saliency Detection Model Based on Human Visual Sensitivity and Amplitude Spectrum

被引:124
|
作者
Fang, Yuming [1 ]
Lin, Weisi [1 ]
Lee, Bu-Sung [1 ]
Lau, Chiew-Tong [1 ]
Chen, Zhenzhong [2 ]
Lin, Chia-Wen [3 ]
机构
[1] Nanyang Technol Univ, Sch Comp Engn, Singapore 639798, Singapore
[2] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
[3] Natl Tsing Hua Univ, Dept Elect Engn, Hsinchu 30013, Taiwan
关键词
Amplitude spectrum; Fourier transform; human visual sensitivity; saliency detection; visual attention; GUIDED SEARCH; TOP-DOWN; ATTENTION; COLOR; IMAGE; GUIDANCE; SCENE;
D O I
10.1109/TMM.2011.2169775
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the wide applications of saliency information in visual signal processing, many saliency detection methods have been proposed. However, some key characteristics of the human visual system (HVS) are still neglected in building these saliency detection models. In this paper, we propose a new saliency detection model based on the human visual sensitivity and the amplitude spectrum of quaternion Fourier transform (QFT). We use the amplitude spectrum of QFT to represent the color, intensity, and orientation distributions for image patches. The saliency value for each image patch is calculated by not only the differences between the QFT amplitude spectrum of this patch and other patches in the whole image, but also the visual impacts for these differences determined by the human visual sensitivity. The experiment results show that the proposed saliency detection model outperforms the state-of-the-art detection models. In addition, we apply our proposed model in the application of image retargeting and achieve better performance over the conventional algorithms.
引用
收藏
页码:187 / 198
页数:12
相关论文
共 50 条
  • [1] Bottom-Up Saliency Detection Model Based on Amplitude Spectrum
    Fang, Yuming
    Lin, Weisi
    Lee, Bu-Sung
    Lau, Chiew Tong
    Lin, Chia-Wen
    ADVANCES IN MULTIMEDIA MODELING, PT I, 2011, 6523 : 370 - +
  • [2] Bottom-up Model of Visual Saliency: A Viewpoint based on Efficient Coding Hypothesis
    Zhu, Hao
    Han, Biao
    PROCEEDINGS OF THE 2014 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2014, : 2136 - 2141
  • [3] A saliency-based bottom-up visual attention model for dynamic scenes analysis
    Ramirez-Moreno, David F.
    Schwartz, Odelia
    Ramirez-Villegas, Juan F.
    BIOLOGICAL CYBERNETICS, 2013, 107 (02) : 141 - 160
  • [4] A saliency-based bottom-up visual attention model for dynamic scenes analysis
    David F. Ramirez-Moreno
    Odelia Schwartz
    Juan F. Ramirez-Villegas
    Biological Cybernetics, 2013, 107 : 141 - 160
  • [5] Biologically inspired saliency map model for bottom-up visual attention
    Park, SJ
    Shin, JK
    Lee, M
    BIOLOGICALLY MOTIVATED COMPUTER VISION, PROCEEDINGS, 2002, 2525 : 418 - 426
  • [6] A New Bottom-Up Method for Saliency Detection
    Ma, Xiaolong
    Xie, Xudong
    Lam, Kin-Man
    Zhong, Yisheng
    2013 IEEE 17TH INTERNATIONAL SYMPOSIUM ON CONSUMER ELECTRONICS (ISCE), 2013, : 97 - +
  • [7] Bottom-up saliency detection for attention determination
    Shuzhi Sam Ge
    Hongsheng He
    Zhengchen Zhang
    Machine Vision and Applications, 2013, 24 : 103 - 116
  • [8] Bottom-up saliency detection for attention determination
    Ge, Shuzhi Sam
    He, Hongsheng
    Zhang, Zhengchen
    MACHINE VISION AND APPLICATIONS, 2013, 24 (01) : 103 - 116
  • [9] Ray Saliency: Bottom-Up Visual Saliency for a Rotating and Zooming Camera
    Warnell, Garrett
    David, Philip
    Chellappa, Rama
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2016, 116 (02) : 174 - 189
  • [10] Ray Saliency: Bottom-Up Visual Saliency for a Rotating and Zooming Camera
    Garrett Warnell
    Philip David
    Rama Chellappa
    International Journal of Computer Vision, 2016, 116 : 174 - 189