Perceptual Enhancement for Stereoscopic Videos Based on Horopter Consistency

被引:1
|
作者
Wang, Zeyu [1 ]
Jinl, Xiaohan [1 ]
Xuel, Fei [1 ]
Li, Renju [1 ]
Zhal, Hongbin [1 ]
Ikeuchi, Katsushi [2 ]
机构
[1] Peking Univ, Key Lab Machine Percept, Beijing, Peoples R China
[2] Microsoft Res Asia, Beijing, Peoples R China
关键词
horopter consistency; virtual rig modification; perceptual enhancement; stereoscopic videos; image warping;
D O I
10.1145/2993369.2993393
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Audience discomfort, such as eye strain and dizziness, is one of the urgent issues that virtual reality and 3D movie technologies should tackle. Except for inappropriate horizontal and vertical disparity, one major problem is that people's binocular vergence and focal length in the cinema remain inconsistent from normal visual habits. Psychologists discovered the horopter and Panum's fusional area to describe zero-disparity points projected on the retinas based on accommodation-convergence consistency. In this paper, inspired by these concepts, we propose a stereoscopic effect correction system for perceptual enhancement according to fixated region and scene information. As a preprocessing step, tracking and stereo matching algorithms are implemented to prepare cues for further transformation in 3D space. Then in order to accomplish certain visual effects, we describe a geometric framework for disparity refinement and image warping based on parameter adjustment of the virtual stereoscopic rig. For evaluation, subjective experiments have been conducted to prove the effectiveness of our method. Therefore, our work provides a possibility to improve the audience experience from a formerly underexplored perspective.
引用
收藏
页码:15 / 18
页数:4
相关论文
共 50 条
  • [41] Game theory based no-reference perceptual quality assessment for stereoscopic images
    Jiang, Feng
    Bharanitharan, K.
    Barma, Shovan
    Wang, Hailiang
    Zhao, Debin
    JOURNAL OF SUPERCOMPUTING, 2015, 71 (09): : 3337 - 3352
  • [42] Perceptual experience and posttest improvements in perceptual accuracy and consistency
    Jeffrey B. Wagman
    Dawn M. McBride
    Amanda J. Trefzger
    Perception & Psychophysics, 2008, 70 : 1060 - 1067
  • [43] A perceptual stereoscopic image quality assessment method based on human visual system
    School of Electronic Information Engineering, Tianjin University, Tianjin, China
    Guangdianzi Jiguang, 2 (378-386):
  • [44] Reduced Reference Stereoscopic Image Quality Assessment Based on Binocular Perceptual Information
    Qi, Feng
    Zhao, Debin
    Gao, Wen
    IEEE TRANSACTIONS ON MULTIMEDIA, 2015, 17 (12) : 2338 - 2344
  • [45] Perceptual quality assessment of stereoscopic images based on local and global visual characteristics
    Lei Chen
    Jiying Zhao
    Multimedia Tools and Applications, 2019, 78 : 12139 - 12156
  • [46] Perceptual quality assessment of stereoscopic images based on local and global visual characteristics
    Chen, Lei
    Zhao, Jiying
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (09) : 12139 - 12156
  • [47] SSIM-based Binocular Perceptual Model for Quality Assessment of Stereoscopic Images
    Ma, Jian
    An, Ping
    Shen, Liquan
    Li, Kai
    Yang, Jialu
    2017 IEEE VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2017,
  • [48] Game theory based no-reference perceptual quality assessment for stereoscopic images
    Feng Jiang
    K. Bharanitharan
    Shovan Barma
    Hailiang Wang
    Debin Zhao
    The Journal of Supercomputing, 2015, 71 : 3337 - 3352
  • [49] Stereoscopic Perceptual Video Coding Based on Just-Noticeable-Distortion Profile
    Zhang, Lei
    Peng, Qiang
    Wang, Qiong-Hua
    Wu, Xiao
    IEEE TRANSACTIONS ON BROADCASTING, 2011, 57 (02) : 572 - 581
  • [50] Perceptual Consistency as Measured by the Rorschach
    Orange, Arthur A.
    JOURNAL OF PROJECTIVE TECHNIQUES, 1953, 17 (02): : 224 - 228