Saliency Detection for Stereoscopic Images

被引:139
|
作者
Fang, Yuming [1 ]
Wang, Junle [2 ]
Narwaria, Manish [2 ]
Le Callet, Patrick [2 ]
Lin, Weisi [3 ]
机构
[1] Jiangxi Univ Finance & Econ, Sch Informat Technol, Nanchang 330032, Peoples R China
[2] Univ Nantes, LUNAM Univ, F-44306 Nantes 3, France
[3] Nanyang Technol Univ, Sch Comp Engn, Singapore 639798, Singapore
关键词
Stereoscopic image; 3D image; stereoscopic saliency detection; visual attention; human visual acuity; VISUAL-ATTENTION MODEL; COMPRESSED DOMAIN; DEPTH; VIDEO; OBSERVERS; CONTRAST; BIAS;
D O I
10.1109/TIP.2014.2305100
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Many saliency detection models for 2D images have been proposed for various multimedia processing applications during the past decades. Currently, the emerging applications of stereoscopic display require new saliency detection models for salient region extraction. Different from saliency detection for 2D images, the depth feature has to be taken into account in saliency detection for stereoscopic images. In this paper, we propose a novel stereoscopic saliency detection framework based on the feature contrast of color, luminance, texture, and depth. Four types of features, namely color, luminance, texture, and depth, are extracted from discrete cosine transform coefficients for feature contrast calculation. A Gaussian model of the spatial distance between image patches is adopted for consideration of local and global contrast calculation. Then, a new fusion method is designed to combine the feature maps to obtain the final saliency map for stereoscopic images. In addition, we adopt the center bias factor and human visual acuity, the important characteristics of the human visual system, to enhance the final saliency map for stereoscopic images. Experimental results on eye tracking databases show the superior performance of the proposed model over other existing methods.
引用
下载
收藏
页码:2625 / 2636
页数:12
相关论文
共 50 条
  • [1] SALIENCY DETECTION FOR STEREOSCOPIC IMAGES
    Fang, Yuming
    Wang, Junle
    Narwaria, Manish
    Le Callet, Patrick
    Lin, Weisi
    2013 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (IEEE VCIP 2013), 2013,
  • [2] Saliency Detection Model for Stereoscopic Panoramic Images
    Qiu Miaomiao
    Chai Xiongli
    Shao Feng
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (08)
  • [3] LEARNING VISUAL SALIENCY FOR STEREOSCOPIC IMAGES
    Fang, Yuming
    Lin, Weisi
    Fang, Zhijun
    Lei, Jianjun
    Le Callet, Patrick
    Yuan, Feiniu
    2014 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (ICMEW), 2014,
  • [4] Saliency-Based Sharpness Mismatch Detection For Stereoscopic Omnidirectional Images
    Croci, Simone
    Knorr, Sebastian
    Smolic, Aljosa
    14TH EUROPEAN CONFERENCE ON VISUAL MEDIA PRODUCTION (CVMP), 2017,
  • [5] Unsupervised Saliency Detection of Rail Surface Defects Using Stereoscopic Images
    Niu, Menghui
    Song, Kechen
    Huang, Liming
    Wang, Qi
    Yan, Yunhui
    Meng, Qinggang
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (03) : 2271 - 2281
  • [6] Deep Visual Saliency on Stereoscopic Images
    Anh-Duc Nguyen
    Kim, Jongyoo
    Oh, Heeseok
    Kim, Haksub
    Lin, Weisi
    Lee, Sanghoon
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (04) : 1939 - 1953
  • [7] A Novel Saliency Model for Stereoscopic Images
    Cheng, Hao
    Zhang, Jian
    An, Ping
    Liu, Zhi
    2015 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA), 2015, : 54 - 60
  • [8] Saliency detection in stereoscopic images using adaptive Gaussian Kernel and Gabor filter
    Rakesh, Y.
    Krishna, K. Sri Rama
    SOFT COMPUTING, 2019, 23 (08) : 2485 - 2498
  • [9] A New Saliency Detection Method for Stereoscopic Images Using Contrast and Prior Knowledge
    Cho, Sang-Hyun
    Kang, Hang-Bong
    PROGRESS IN PATTERN RECOGNITION IMAGE ANALYSIS, COMPUTER VISION, AND APPLICATIONS, CIARP 2014, 2014, 8827 : 778 - 786
  • [10] Saliency Detection for Stereoscopic 3D Images in the Quaternion Frequency Domain
    Cai, Xingyu
    Zhou, Wujie
    Cen, Gang
    Qiu, Weiwei
    3D RESEARCH, 2018, 9 (02):