Perceptual Enhancement for Stereoscopic Videos Based on Horopter Consistency

被引:1
|
作者
Wang, Zeyu [1 ]
Jinl, Xiaohan [1 ]
Xuel, Fei [1 ]
Li, Renju [1 ]
Zhal, Hongbin [1 ]
Ikeuchi, Katsushi [2 ]
机构
[1] Peking Univ, Key Lab Machine Percept, Beijing, Peoples R China
[2] Microsoft Res Asia, Beijing, Peoples R China
关键词
horopter consistency; virtual rig modification; perceptual enhancement; stereoscopic videos; image warping;
D O I
10.1145/2993369.2993393
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Audience discomfort, such as eye strain and dizziness, is one of the urgent issues that virtual reality and 3D movie technologies should tackle. Except for inappropriate horizontal and vertical disparity, one major problem is that people's binocular vergence and focal length in the cinema remain inconsistent from normal visual habits. Psychologists discovered the horopter and Panum's fusional area to describe zero-disparity points projected on the retinas based on accommodation-convergence consistency. In this paper, inspired by these concepts, we propose a stereoscopic effect correction system for perceptual enhancement according to fixated region and scene information. As a preprocessing step, tracking and stereo matching algorithms are implemented to prepare cues for further transformation in 3D space. Then in order to accomplish certain visual effects, we describe a geometric framework for disparity refinement and image warping based on parameter adjustment of the virtual stereoscopic rig. For evaluation, subjective experiments have been conducted to prove the effectiveness of our method. Therefore, our work provides a possibility to improve the audience experience from a formerly underexplored perspective.
引用
收藏
页码:15 / 18
页数:4
相关论文
共 50 条
  • [1] A Depth Adaptation System Based on Perceptual Horopter Effect
    Wu, Chien
    Li, Chung-Te
    Lai, Yen-Chieh
    Chen, Liang-Gee
    2012 IEEE 16TH INTERNATIONAL SYMPOSIUM ON CONSUMER ELECTRONICS (ISCE), 2012,
  • [2] Perceptual quality assessment of 3D videos with stereoscopic degradations
    Silva, Alessandro R.
    Farias, Mylene C. Q.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (1-2) : 1603 - 1623
  • [3] Perceptual quality assessment of 3D videos with stereoscopic degradations
    Alessandro R. Silva
    Mylène C. Q. Farias
    Multimedia Tools and Applications, 2020, 79 : 1603 - 1623
  • [4] Perceptual enhancement of suprathreshold luminance modulation in stereoscopic patterns
    Maehara, Goro
    Murakami, Ikuya
    JOURNAL OF VISION, 2020, 20 (12): : 1 - 11
  • [5] Perceptual Oriented Depth Cue Enhancement For Stereoscopic View Synthesis
    Chen, Yi-Chun
    Chang, Tian-Sheuan
    2016 3DTV-CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO (3DTV-CON), 2016,
  • [6] Depth perceptual quality assessment for symmetrically and asymmetrically distorted stereoscopic 3D videos
    Zhang, Yun
    Liu, Xiangkai
    Liu, Huanhua
    Fan, Chunling
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2019, 78 : 293 - 305
  • [7] Saliency Prediction on Stereoscopic Videos
    Kim, Haksub
    Lee, Sanghoon
    Bovik, Alan Conrad
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (04) : 1476 - 1490
  • [8] Depth Mapping for Stereoscopic Videos
    Tao Yan
    Rynson W. H. Lau
    Yun Xu
    Liusheng Huang
    International Journal of Computer Vision, 2013, 102 : 293 - 307
  • [9] Depth Mapping for Stereoscopic Videos
    Yan, Tao
    Lau, Rynson W. H.
    Xu, Yun
    Huang, Liusheng
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2013, 102 (1-3) : 293 - 307
  • [10] Subjective Quality Estimation Based on Neural Networks for Stereoscopic Videos
    Malekmohamadi, H.
    Fernando, W. A. C.
    Danish, E.
    Kondoz, A. M.
    2014 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2014, : 109 - 110