Quality Assessment of Stereoscopic 3D Image Compression by Binocular Integration Behaviors

被引:182
|
作者
Lin, Yu-Hsun [1 ]
Wu, Ja-Ling [2 ]
机构
[1] Natl Taiwan Univ, Grad Inst Networking & Multimedia, Taipei 106, Taiwan
[2] Dept Comp Sci & Informat Engn, Commun & Multimedia Lab, Taipei 106, Japan
关键词
Stereo 3D image; HEVC; color plus depth 3D images; binocular frequency integration; PSNR; SSIM; MS-SSIM; VIF; VSNR; WSNR; UQI; frequency integrated metric (FI-metric); quality assessment; human visual system (HVS); stereopsis; binocular vision; ventral stream; dorsal stream; STRUCTURAL SIMILARITY; VIDEO; MODEL; INFORMATION; MASKING; VISION;
D O I
10.1109/TIP.2014.2302686
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The objective approaches of 3D image quality assessment play a key role for the development of compression standards and various 3D multimedia applications. The quality assessment of 3D images faces more new challenges, such as asymmetric stereo compression, depth perception, and virtual view synthesis, than its 2D counterparts. In addition, the widely used 2D image quality metrics (e.g., PSNR and SSIM) cannot be directly applied to deal with these newly introduced challenges. This statement can be verified by the low correlation between the computed objective measures and the subjectively measured mean opinion scores (MOSs), when 3D images are the tested targets. In order to meet these newly introduced challenges, in this paper, besides traditional 2D image metrics, the binocular integration behaviors-the binocular combination and the binocular frequency integration, are utilized as the bases for measuring the quality of stereoscopic 3D images. The effectiveness of the proposed metrics is verified by conducting subjective evaluations on publicly available stereoscopic image databases. Experimental results show that significant consistency could be reached between the measured MOS and the proposed metrics, in which the correlation coefficient between them can go up to 0.88. Furthermore, we found that the proposed metrics can also address the quality assessment of the synthesized color-plus-depth 3D images well. Therefore, it is our belief that the binocular integration behaviors are important factors in the development of objective quality assessment for 3D images.
引用
收藏
页码:1527 / 1542
页数:16
相关论文
共 50 条
  • [41] INTEGRATION OF STEREOSCOPIC DSA AND 3D MRI FOR IMAGE-GUIDED NEUROSURGERY
    PETERS, TM
    HENRI, CJ
    MUNGER, P
    TAKAHASHI, AM
    EVANS, AC
    DAVEY, B
    OLIVIER, A
    [J]. COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 1994, 18 (04) : 289 - 299
  • [42] Effects of Image Quality Attributes on Stereoscopic 3D LCD TV
    Kim, Kyoung Tae
    Kim, Yu-Noon
    Lee, Yoon Gyoo
    Kang, Yoo Jin
    Kim, Han Eol
    Kim, Ga Hee
    Kim, Choon-Woo
    [J]. IDW'10: PROCEEDINGS OF THE 17TH INTERNATIONAL DISPLAY WORKSHOPS, VOLS 1-3, 2010, : 1421 - 1424
  • [43] The Subjective Quality of Stereoscopic 3D Video Following Display Stream Compression
    Mohona, Sanjida Sharmin
    Au, Domenic
    Allison, Robert S.
    Wilcox, Laurie M.
    [J]. 2023 IEEE 25TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, MMSP, 2023,
  • [44] Perceived quality measurement of stereoscopic 3D images based on sparse representation and binocular combination
    Zhou, Wujie
    Zhou, Yang
    Qiu, Weiwei
    Luo, Ting
    Zhai, Zhinian
    [J]. DIGITAL SIGNAL PROCESSING, 2019, 93 : 128 - 137
  • [45] SYNTHESIS OF AN AUTO-STEREOSCOPIC 3-D IMAGE FROM BINOCULAR STEREOSCOPIC IMAGES
    OSHIMA, K
    OKOSHI, T
    [J]. APPLIED OPTICS, 1979, 18 (04): : 469 - 476
  • [46] A 3D Index (ΔX3D) for Evaluating Image Quality of Stereoscopic Displays
    Chang, Yu-Cheng
    Chien, Yu-Yi
    Huang, Yi-Pai
    [J]. JOURNAL OF DISPLAY TECHNOLOGY, 2015, 11 (10): : 814 - 820
  • [47] Stereoscopic image quality metrics and compression
    Corley, Paul
    Holliman, Nick
    [J]. STEREOSCOPIC DISPLAYS AND APPLICATIONS XIX, 2008, 6803
  • [48] Survey on stereoscopic 3D image retargeting
    [J]. 1600, Institute of Computing Technology (28):
  • [49] Deep network based stereoscopic image quality assessment via binocular summing and differencing
    Hu, Jinbin
    Wang, Xuejin
    Chai, Xiongli
    Shao, Feng
    Jiang, Qiuping
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2022, 82
  • [50] No-Reference Stereoscopic Image Quality Assessment Considering Binocular Disparity and Fusion Compensation
    Feng Jinhui
    Li, Sumei
    Chang, Yongli
    [J]. 2021 INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2021,