Bottom-Up Saliency Detection Model Based on Human Visual Sensitivity and Amplitude Spectrum

被引:124
|
作者
Fang, Yuming [1 ]
Lin, Weisi [1 ]
Lee, Bu-Sung [1 ]
Lau, Chiew-Tong [1 ]
Chen, Zhenzhong [2 ]
Lin, Chia-Wen [3 ]
机构
[1] Nanyang Technol Univ, Sch Comp Engn, Singapore 639798, Singapore
[2] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
[3] Natl Tsing Hua Univ, Dept Elect Engn, Hsinchu 30013, Taiwan
关键词
Amplitude spectrum; Fourier transform; human visual sensitivity; saliency detection; visual attention; GUIDED SEARCH; TOP-DOWN; ATTENTION; COLOR; IMAGE; GUIDANCE; SCENE;
D O I
10.1109/TMM.2011.2169775
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the wide applications of saliency information in visual signal processing, many saliency detection methods have been proposed. However, some key characteristics of the human visual system (HVS) are still neglected in building these saliency detection models. In this paper, we propose a new saliency detection model based on the human visual sensitivity and the amplitude spectrum of quaternion Fourier transform (QFT). We use the amplitude spectrum of QFT to represent the color, intensity, and orientation distributions for image patches. The saliency value for each image patch is calculated by not only the differences between the QFT amplitude spectrum of this patch and other patches in the whole image, but also the visual impacts for these differences determined by the human visual sensitivity. The experiment results show that the proposed saliency detection model outperforms the state-of-the-art detection models. In addition, we apply our proposed model in the application of image retargeting and achieve better performance over the conventional algorithms.
引用
收藏
页码:187 / 198
页数:12
相关论文
共 50 条
  • [41] Weber's Law Based Center-Surround Hypothesis for Bottom-Up Saliency Detection
    Lin, Lili
    Zhou, Wenhui
    Zhang, Hua
    NEURAL INFORMATION PROCESSING, PT III, 2011, 7064 : 592 - +
  • [42] Fixation prediction with a combined model of bottom-up saliency and vanishing point
    Feng, Mengyang
    Borji, Ali
    Lu, Huchuan
    2016 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2016), 2016,
  • [43] Ground mobile target detection based on bottom-up and top-down saliency combination
    Li Shuxin
    Zhang Zhilong
    Li Biao
    FOURTH SEMINAR ON NOVEL OPTOELECTRONIC DETECTION TECHNOLOGY AND APPLICATION, 2018, 10697
  • [44] Emergence of bottom-up saliency in a spiking model of V1
    Botond Szatmáry
    Micah Richer
    Jayram Moorkanikara Nageswaran
    Csaba Petre
    Filip Piekniewski
    Sach Sokol
    Eugene M Izhikevich
    BMC Neuroscience, 14 (Suppl 1)
  • [45] Bottom-up visual attention for virtual human animation
    Peters, C
    O' Sullivan, C
    16TH INTERNATIONAL CONFERENCE ON COMPUTER ANIMATION AND SOCIAL AGENTS, PROCEEDINGS, 2003, : 111 - 117
  • [46] A Visual Attention Based Object Detection Model beyond Top-Down and Bottom-up Mechanism
    Zhang, Du-Zhen
    Liu, Chuan-Cai
    4TH ANNUAL INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND APPLICATIONS (ITA 2017), 2017, 12
  • [47] Bottom-Up Saliency Estimation Based on Redundancy Reduction and Global Contrast
    缪小冬
    李舜酩
    沈峘
    李爱婷
    Transactions of Nanjing University of Aeronautics and Astronautics, 2014, 31 (06) : 660 - 667
  • [48] Saliency Based on Human Visual Sensitivity and Phase Spectrum of the Quaternion Fourier Transform
    Buzatu, Oana Loredana
    Savin, Alexandra
    2013 INTERNATIONAL SYMPOSIUM ON SIGNALS, CIRCUITS AND SYSTEMS (ISSCS), 2013,
  • [49] Significance of Bottom-up Attributes in Video Saliency Detection Without Cognitive Bias
    Hosseinkhani, Jila
    Joslin, Chris
    PROCEEDINGS OF 2018 IEEE 17TH INTERNATIONAL CONFERENCE ON COGNITIVE INFORMATICS & COGNITIVE COMPUTING (ICCI*CC 2018), 2018, : 606 - 613
  • [50] BOTTOM-UP SALIENCY MEETS TOP-DOWN SEMANTICS FOR OBJECT DETECTION
    Sawada, Tomoya
    Lee, Teng-Yok
    Mizuno, Masahiro
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 729 - 733