Perceptual Enhancement for Stereoscopic Videos Based on Horopter Consistency

被引:1
|
作者
Wang, Zeyu [1 ]
Jinl, Xiaohan [1 ]
Xuel, Fei [1 ]
Li, Renju [1 ]
Zhal, Hongbin [1 ]
Ikeuchi, Katsushi [2 ]
机构
[1] Peking Univ, Key Lab Machine Percept, Beijing, Peoples R China
[2] Microsoft Res Asia, Beijing, Peoples R China
关键词
horopter consistency; virtual rig modification; perceptual enhancement; stereoscopic videos; image warping;
D O I
10.1145/2993369.2993393
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Audience discomfort, such as eye strain and dizziness, is one of the urgent issues that virtual reality and 3D movie technologies should tackle. Except for inappropriate horizontal and vertical disparity, one major problem is that people's binocular vergence and focal length in the cinema remain inconsistent from normal visual habits. Psychologists discovered the horopter and Panum's fusional area to describe zero-disparity points projected on the retinas based on accommodation-convergence consistency. In this paper, inspired by these concepts, we propose a stereoscopic effect correction system for perceptual enhancement according to fixated region and scene information. As a preprocessing step, tracking and stereo matching algorithms are implemented to prepare cues for further transformation in 3D space. Then in order to accomplish certain visual effects, we describe a geometric framework for disparity refinement and image warping based on parameter adjustment of the virtual stereoscopic rig. For evaluation, subjective experiments have been conducted to prove the effectiveness of our method. Therefore, our work provides a possibility to improve the audience experience from a formerly underexplored perspective.
引用
收藏
页码:15 / 18
页数:4
相关论文
共 50 条
  • [21] ASYMMETRIC CODING OF STEREOSCOPIC 3D BASED ON PERCEPTUAL SIGNIFICANCE
    Fezza, Sid Ahmed
    Larabi, Mohamed-Chaker
    Faraoun, Kamel Mohamed
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 5656 - 5660
  • [22] Perceptual straightening of natural videos
    Henaff, Olivier J.
    Goris, Robbe L. T.
    Simoncelli, Eero P.
    NATURE NEUROSCIENCE, 2019, 22 (06) : 984 - +
  • [23] Stereoscopic Visual Perceptual Learning in Seniors
    Erbes, Sabine
    Michelson, Georg
    GERIATRICS, 2021, 6 (03)
  • [24] Perceptual straightening of natural videos
    Olivier J. Hénaff
    Robbe L. T. Goris
    Eero P. Simoncelli
    Nature Neuroscience, 2019, 22 : 984 - 991
  • [25] AdvIT: Adversarial Frames Identifier Based on Temporal Consistency In Videos
    Xiao, Chaowei
    Deng, Ruizhi
    Li, Bo
    Lee, Taesung
    Edwards, Benjamin
    Yi, Jinfeng
    Song, Dawn
    Liu, Mingyan
    Molloy, Ian
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 3967 - 3976
  • [26] Attention-based LSTM with Semantic Consistency for Videos Captioning
    Guo, Zhao
    Gao, Lianli
    Song, Jingkuan
    Xu, Xing
    Shao, Jie
    Shen, Heng Tao
    MM'16: PROCEEDINGS OF THE 2016 ACM MULTIMEDIA CONFERENCE, 2016, : 357 - 361
  • [27] PERSONALITY, PERCEPTUAL DEFENSE, AND STEREOSCOPIC PERCEPTION
    DAVIS, JM
    JOURNAL OF ABNORMAL AND SOCIAL PSYCHOLOGY, 1959, 58 (03): : 398 - 402
  • [28] A perceptual approach for stereoscopic rendering optimization
    Bulbul, Abdullah
    Cipiloglu, Zeynep
    Capin, Tolga
    COMPUTERS & GRAPHICS-UK, 2010, 34 (02): : 145 - 157
  • [29] Learning to Explore Saliency for Stereoscopic Videos Via Component-Based Interaction
    Zhang, Qiudan
    Wang, Xu
    Wang, Shiqi
    Sun, Zhenhao
    Kwong, Sam
    Jiang, Jianmin
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 5722 - 5736
  • [30] Content-based subjective quality prediction in stereoscopic videos with machine learning
    Malekmohamadi, H.
    Fernando, W. A. C.
    Kondoz, A. M.
    ELECTRONICS LETTERS, 2012, 48 (21) : 1344 - 1345