Saliency Detection for Stereoscopic Images

被引:139
|
作者
Fang, Yuming [1 ]
Wang, Junle [2 ]
Narwaria, Manish [2 ]
Le Callet, Patrick [2 ]
Lin, Weisi [3 ]
机构
[1] Jiangxi Univ Finance & Econ, Sch Informat Technol, Nanchang 330032, Peoples R China
[2] Univ Nantes, LUNAM Univ, F-44306 Nantes 3, France
[3] Nanyang Technol Univ, Sch Comp Engn, Singapore 639798, Singapore
关键词
Stereoscopic image; 3D image; stereoscopic saliency detection; visual attention; human visual acuity; VISUAL-ATTENTION MODEL; COMPRESSED DOMAIN; DEPTH; VIDEO; OBSERVERS; CONTRAST; BIAS;
D O I
10.1109/TIP.2014.2305100
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Many saliency detection models for 2D images have been proposed for various multimedia processing applications during the past decades. Currently, the emerging applications of stereoscopic display require new saliency detection models for salient region extraction. Different from saliency detection for 2D images, the depth feature has to be taken into account in saliency detection for stereoscopic images. In this paper, we propose a novel stereoscopic saliency detection framework based on the feature contrast of color, luminance, texture, and depth. Four types of features, namely color, luminance, texture, and depth, are extracted from discrete cosine transform coefficients for feature contrast calculation. A Gaussian model of the spatial distance between image patches is adopted for consideration of local and global contrast calculation. Then, a new fusion method is designed to combine the feature maps to obtain the final saliency map for stereoscopic images. In addition, we adopt the center bias factor and human visual acuity, the important characteristics of the human visual system, to enhance the final saliency map for stereoscopic images. Experimental results on eye tracking databases show the superior performance of the proposed model over other existing methods.
引用
下载
收藏
页码:2625 / 2636
页数:12
相关论文
共 50 条
  • [21] STEREOSCOPIC IMAGE RETARGETING BASED ON 3D SALIENCY DETECTION
    Wang, Junle
    Fang, Yuming
    Narwaria, Manish
    Lin, Weisi
    Le Callet, Patrick
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [22] Disparity tuning guided stereoscopic saliency detection for eye fixation prediction
    Liu, Di
    Chen, Zhenzhong
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2018, 57 : 218 - 227
  • [23] Salient object detection and classification for stereoscopic images
    Kai Kang
    Yang Cao
    Jing Zhang
    Zengfu Wang
    Multimedia Tools and Applications, 2016, 75 : 1443 - 1457
  • [24] Salient object detection and classification for stereoscopic images
    Kang, Kai
    Cao, Yang
    Zhang, Jing
    Wang, Zengfu
    MULTIMEDIA TOOLS AND APPLICATIONS, 2016, 75 (03) : 1443 - 1457
  • [25] Saliency detection on sampled images for tag ranking
    Guo, Jingfan
    Ren, Tongwei
    Huang, Lei
    Bei, Jia
    MULTIMEDIA SYSTEMS, 2019, 25 (01) : 35 - 47
  • [26] SALIENCY TARGET DETECTION IN POLARIMETRIC SAR IMAGES
    Wang, Haipeng
    Xu, Feng
    2016 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2016, : 1038 - 1041
  • [27] An Eye Fixation Database for Saliency Detection in Images
    Ramanathan, Subramanian
    Katti, Harish
    Sebe, Nicu
    Kankanhalli, Mohan
    Chua, Tat-Seng
    COMPUTER VISION-ECCV 2010, PT IV, 2010, 6314 : 30 - +
  • [28] A Hierarchical Saliency Detection Approach for Bokeh Images
    Che, Zhaohui
    Zhai, Guangtao
    Min, Xiongkuo
    2015 IEEE 17TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2015,
  • [29] RETRIEVING IMAGES COMBINING SALIENCY DETECTION WITH IRM
    Huang, Shao
    Wang, Weiqiang
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 517 - 521
  • [30] Encoding based Saliency Detection for Videos and Images
    Mauthner, Thomas
    Possegger, Horst
    Waltner, Georg
    Bischof, Horst
    2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 2494 - 2502