Saliency Detection for Stereoscopic Images

被引:139
|
作者
Fang, Yuming [1 ]
Wang, Junle [2 ]
Narwaria, Manish [2 ]
Le Callet, Patrick [2 ]
Lin, Weisi [3 ]
机构
[1] Jiangxi Univ Finance & Econ, Sch Informat Technol, Nanchang 330032, Peoples R China
[2] Univ Nantes, LUNAM Univ, F-44306 Nantes 3, France
[3] Nanyang Technol Univ, Sch Comp Engn, Singapore 639798, Singapore
关键词
Stereoscopic image; 3D image; stereoscopic saliency detection; visual attention; human visual acuity; VISUAL-ATTENTION MODEL; COMPRESSED DOMAIN; DEPTH; VIDEO; OBSERVERS; CONTRAST; BIAS;
D O I
10.1109/TIP.2014.2305100
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Many saliency detection models for 2D images have been proposed for various multimedia processing applications during the past decades. Currently, the emerging applications of stereoscopic display require new saliency detection models for salient region extraction. Different from saliency detection for 2D images, the depth feature has to be taken into account in saliency detection for stereoscopic images. In this paper, we propose a novel stereoscopic saliency detection framework based on the feature contrast of color, luminance, texture, and depth. Four types of features, namely color, luminance, texture, and depth, are extracted from discrete cosine transform coefficients for feature contrast calculation. A Gaussian model of the spatial distance between image patches is adopted for consideration of local and global contrast calculation. Then, a new fusion method is designed to combine the feature maps to obtain the final saliency map for stereoscopic images. In addition, we adopt the center bias factor and human visual acuity, the important characteristics of the human visual system, to enhance the final saliency map for stereoscopic images. Experimental results on eye tracking databases show the superior performance of the proposed model over other existing methods.
引用
下载
收藏
页码:2625 / 2636
页数:12
相关论文
共 50 条
  • [31] Fall Detection Based on Deep Saliency Images
    Li, Hongjun
    Ding, Yupeng
    Li, Chaobo
    Zhou, Ze
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE (ICPRAI 2018), 2018, : 455 - 460
  • [32] Convolutional Neural Network for Saliency Detection in Images
    Misaghi, Hooman
    Moghadam, Reza Askari
    Madani, Kurosh
    2018 6TH IRANIAN JOINT CONGRESS ON FUZZY AND INTELLIGENT SYSTEMS (CFIS), 2018, : 17 - 19
  • [33] Saliency detection on sampled images for tag ranking
    Jingfan Guo
    Tongwei Ren
    Lei Huang
    Jia Bei
    Multimedia Systems, 2019, 25 : 35 - 47
  • [34] Stereoscopic video saliency detection based on spatiotemporal correlation and depth confidence optimization
    Zhang, Ping
    Liu, Jingwen
    Wang, Xiaoyang
    Pu, Tian
    Fei, Chun
    Guo, Zhengkui
    NEUROCOMPUTING, 2020, 377 : 256 - 268
  • [35] Stereoscopic Image Saliency Detection Optimization: A Multi-Cue-Driven Approach
    Niu, Yuzhen
    Chen, Jianer
    Ke, Xiao
    Chen, Junhao
    IEEE ACCESS, 2019, 7 : 19835 - 19847
  • [36] 3D saliency guided deep quality predictor for no-reference stereoscopic images
    Messai, Oussama
    Chetouani, Aladine
    Hachouf, Fella
    Seghir, Zianou Ahmed
    NEUROCOMPUTING, 2022, 478 : 22 - 36
  • [37] Using Saliency-Weighted Disparity Statistics for Objective Visual Comfort Assessment of Stereoscopic Images
    Zhang, Wenlan
    Luo, Ting
    Jiang, Gangyi
    Jiang, Qiuping
    Ying, Hongwei
    Lu, Jing
    3D RESEARCH, 2016, 7 (02):
  • [38] A two-stage approach to saliency detection in images
    Wang, Zheshen
    Li, Baoxin
    2008 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-12, 2008, : 965 - 968
  • [39] A unified saliency detection framework for visible and infrared images
    Xufan Zhang
    Yong Wang
    Jun Yan
    Zhenxing Chen
    Dianhong Wang
    Multimedia Tools and Applications, 2020, 79 : 17331 - 17348
  • [40] Anomaly detection in Sonar images: application of saliency filters
    Bazzarello, Lorenzo
    Pulpito, Osvaldo
    Cannarsa, Francesco
    Bresciani, Matteo
    Costanzi, Riccardo
    Acito, Nicola
    Diani, Marco
    Corsini, Giovanni
    Caiti, Andrea
    2022 IEEE INTERNATIONAL WORKSHOP ON METROLOGY FOR THE SEA LEARNING TO MEASURE SEA HEALTH PARAMETERS (METROSEA), 2022, : 220 - 224