Saliency Detection for Stereoscopic Images

被引:139
|
作者
Fang, Yuming [1 ]
Wang, Junle [2 ]
Narwaria, Manish [2 ]
Le Callet, Patrick [2 ]
Lin, Weisi [3 ]
机构
[1] Jiangxi Univ Finance & Econ, Sch Informat Technol, Nanchang 330032, Peoples R China
[2] Univ Nantes, LUNAM Univ, F-44306 Nantes 3, France
[3] Nanyang Technol Univ, Sch Comp Engn, Singapore 639798, Singapore
关键词
Stereoscopic image; 3D image; stereoscopic saliency detection; visual attention; human visual acuity; VISUAL-ATTENTION MODEL; COMPRESSED DOMAIN; DEPTH; VIDEO; OBSERVERS; CONTRAST; BIAS;
D O I
10.1109/TIP.2014.2305100
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Many saliency detection models for 2D images have been proposed for various multimedia processing applications during the past decades. Currently, the emerging applications of stereoscopic display require new saliency detection models for salient region extraction. Different from saliency detection for 2D images, the depth feature has to be taken into account in saliency detection for stereoscopic images. In this paper, we propose a novel stereoscopic saliency detection framework based on the feature contrast of color, luminance, texture, and depth. Four types of features, namely color, luminance, texture, and depth, are extracted from discrete cosine transform coefficients for feature contrast calculation. A Gaussian model of the spatial distance between image patches is adopted for consideration of local and global contrast calculation. Then, a new fusion method is designed to combine the feature maps to obtain the final saliency map for stereoscopic images. In addition, we adopt the center bias factor and human visual acuity, the important characteristics of the human visual system, to enhance the final saliency map for stereoscopic images. Experimental results on eye tracking databases show the superior performance of the proposed model over other existing methods.
引用
下载
收藏
页码:2625 / 2636
页数:12
相关论文
共 50 条
  • [41] RETRIEVING IMAGES USING SALIENCY DETECTION AND GRAPH MATCHING
    Huang, Shao
    Wang, Weiqiang
    Zhang, Hui
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 3087 - 3091
  • [42] A unified saliency detection framework for visible and infrared images
    Zhang, Xufan
    Wang, Yong
    Yan, Jun
    Chen, Zhenxing
    Wang, Dianhong
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (25-26) : 17331 - 17348
  • [43] OBJECT-AWARE SALIENCY DETECTION FOR CONSUMER IMAGES
    Tang, Hao
    2012 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2012), 2012, : 1097 - 1100
  • [44] Saliency and Gist Features for Target Detection in Satellite Images
    Li, Zhicheng
    Itti, Laurent
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (07) : 2017 - 2029
  • [45] Saliency detection for panoramic landscape images of outdoor scenes
    Han, Byeong-Ju
    Sim, Jae-Young
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2017, 49 : 27 - 37
  • [46] ARTIFACT DETECTION IN GAMUT MAPPED IMAGES USING SALIENCY
    Raja, Kiran B.
    Pedersen, Marius
    2013 COLOUR AND VISUAL COMPUTING SYMPOSIUM (CVCS), 2013,
  • [47] Contrast and Distribution based Saliency Detection in Infrared Images
    Li, Lu
    Zheng, Yu
    Zhou, Fugen
    2015 IEEE 17TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2015,
  • [48] Saliency based Artificial Object Detection for Satellite Images
    Ke, Shidong
    Ding, Xiaoying
    Yang, Daiqin
    Chen, Zhenzhong
    Fang, Yuming
    VISUAL INFORMATION PROCESSING AND COMMUNICATION VI, 2015, 9410
  • [49] SEDMI: Saliency based edge detection in multispectral images
    Dinh, Cuong V.
    Leitner, Raimund
    Paclik, Pavel
    Loog, Marco
    Duin, Robert P. W.
    IMAGE AND VISION COMPUTING, 2011, 29 (08) : 546 - 556
  • [50] Learning-Based Saliency Detection of Face Images
    Ren, Yun
    Wang, Zulin
    Xu, Mai
    IEEE ACCESS, 2017, 5 : 6502 - 6514