Perceptual Enhancement for Stereoscopic Videos Based on Horopter Consistency

被引:1
|
作者
Wang, Zeyu [1 ]
Jinl, Xiaohan [1 ]
Xuel, Fei [1 ]
Li, Renju [1 ]
Zhal, Hongbin [1 ]
Ikeuchi, Katsushi [2 ]
机构
[1] Peking Univ, Key Lab Machine Percept, Beijing, Peoples R China
[2] Microsoft Res Asia, Beijing, Peoples R China
关键词
horopter consistency; virtual rig modification; perceptual enhancement; stereoscopic videos; image warping;
D O I
10.1145/2993369.2993393
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Audience discomfort, such as eye strain and dizziness, is one of the urgent issues that virtual reality and 3D movie technologies should tackle. Except for inappropriate horizontal and vertical disparity, one major problem is that people's binocular vergence and focal length in the cinema remain inconsistent from normal visual habits. Psychologists discovered the horopter and Panum's fusional area to describe zero-disparity points projected on the retinas based on accommodation-convergence consistency. In this paper, inspired by these concepts, we propose a stereoscopic effect correction system for perceptual enhancement according to fixated region and scene information. As a preprocessing step, tracking and stereo matching algorithms are implemented to prepare cues for further transformation in 3D space. Then in order to accomplish certain visual effects, we describe a geometric framework for disparity refinement and image warping based on parameter adjustment of the virtual stereoscopic rig. For evaluation, subjective experiments have been conducted to prove the effectiveness of our method. Therefore, our work provides a possibility to improve the audience experience from a formerly underexplored perspective.
引用
收藏
页码:15 / 18
页数:4
相关论文
共 50 条
  • [31] Efficient Streaming of Stereoscopic Depth-Based 3D Videos
    Temel, Dogancan
    Aabed, Mohammed
    Solh, Mashhour
    AlRegib, Ghassan
    VISUAL INFORMATION PROCESSING AND COMMUNICATION IV, 2013, 8666
  • [32] HUMAN ACTION RECOGNITION IN STEREOSCOPIC VIDEOS BASED ON BAG OF FEATURES AND DISPARITY PYRAMIDS
    Iosifidis, Alexandros
    Tefas, Anastasios
    Nikolaidis, Nikos
    Pitas, Ioannis
    2014 PROCEEDINGS OF THE 22ND EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2014, : 1317 - 1321
  • [33] QUALITY PREDICTION OF ASYMMETRICALLY COMPRESSED STEREOSCOPIC VIDEOS
    Wang, Jiheng
    Wang, Shiqi
    Wang, Zhou
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 3427 - 3431
  • [34] A new approach to spatial compression of stereoscopic videos
    de Andrade, Leonardo A.
    Zingarelli, Matheus R. U.
    Silva, Rodolfo R.
    Goularte, Rudinei
    MULTIMEDIA TOOLS AND APPLICATIONS, 2014, 71 (03) : 1673 - 1697
  • [35] Depth Personalization and Streaming of Stereoscopic Sports Videos
    Calagari, Kiana
    Elgamal, Tarek
    Diab, Khaled
    Templin, Krzysztof
    Didyk, Piotr
    Matusik, Wojciech
    Hefeeda, Mohamed
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2016, 12 (03)
  • [36] A new approach to spatial compression of stereoscopic videos
    Leonardo A. de Andrade
    Matheus R. U. Zingarelli
    Rodolfo R. Silva
    Rudinei Goularte
    Multimedia Tools and Applications, 2014, 71 : 1673 - 1697
  • [37] Reduced reference metric for compressed stereoscopic videos
    Malekmohamadi, H.
    Fernando, W. A. C.
    Kondoz, A. M.
    ELECTRONICS LETTERS, 2013, 49 (11) : 701 - 702
  • [38] Color image enhancement based on perceptual sharpening
    Baldrich, R
    Vanrell, M
    Benavente, R
    Salvatella, A
    2003 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL 3, PROCEEDINGS, 2003, : 401 - 404
  • [39] Perceptual Watermarking for Stereoscopic 3D Image Based on Visual Discomfort
    Ji, Sang-Keun
    Kang, Ji-Hyeon
    Lee, Heung-Kyu
    INFORMATION SCIENCE AND APPLICATIONS 2017, ICISA 2017, 2017, 424 : 323 - 330
  • [40] Perceptual stereoscopic images quality assessment method based on visual adaptable characteristics
    Zheng, Zhi
    Liu, Yun
    Liu, Yun
    OPTICAL ENGINEERING, 2019, 58 (07)