Is a no-reference necessary and sufficient metric for video frame and stereo view interpolation possible?

被引:0
|
作者
Ramachandra, Vikas [1 ]
Nguyen, Truong Q. [2 ]
机构
[1] Qualcomm Inc, Multimedia R&D, San Diego, CA 92121 USA
[2] Univ Calif San Diego, La Jolla, CA 92093 USA
关键词
Stereo; disparity estimation; motion estimation; metrics; correspondence; disparity; view interpolation; consistency; occlusion; no reference;
D O I
10.1117/12.839942
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
This paper explores a novel metric which can check the consistency and correctness of a disparity map, and hence validate an interpolated view (or video frame for motion compensated frame interpolation) from the estimated correspondences between two or more input views. The proposed reprojection error metric (REM) is shown to be sufficient for the regions where the observed 3D scene has no occlusions. The metric is completely automatic requiring no human input. We also explain how the metric can be extended to be useful for 3D scenes (or videos) with occlusions. However, the proposed metric does not satisfy necessary conditions. We discuss the issues which arise during the design of a necessary metric, and argue that necessary metrics which work in finite time cannot be designed for checking the validity of a method which performs disparity estimation.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] Novel No-Reference Video Quality Assessment Metric with Estimation of Dynamic Range Distortion
    Kim, Yo-Han
    Han, Junghyun
    Kim, Hyuntai
    Shin, Jitae
    12TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY: ICT FOR GREEN GROWTH AND SUSTAINABLE DEVELOPMENT, VOLS 1 AND 2, 2010, : 1689 - 1692
  • [42] Self-Training-based No-Reference SSIM Estimation for Single Video Frame
    Wu, Zhenyu
    Hu, Hong
    PROCEEDINGS OF THE 2016 IEEE REGION 10 CONFERENCE (TENCON), 2016, : 1415 - 1418
  • [43] No-reference Objective Stereo Video Quality Assessment based on Visual Attention and Edge Difference
    Zhao, Wei
    Ye, Long
    Wang, Jingling
    Zhang, Qin
    2015 IEEE ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC), 2015, : 523 - 526
  • [44] Lightweight Quality Metric Based on No-Reference Bitstream for H.264/AVC Video
    Kim, Yo-Han
    Shin, Jitae
    Kim, Hokyom
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2012, 6 (05): : 1388 - 1399
  • [46] A METRIC FOR NO-REFERENCE VIDEO QUALITY ASSESSMENT FOR HD TV DELIVERY BASED ON SALIENCY MAPS
    Boujut, H.
    Benois-Pineau, J.
    Ahmed, T.
    Hadar, O.
    Bonnet, P.
    2011 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2011,
  • [47] VHDL Implementation of a No-Reference Video Quality Metric Using the Levenberg-Marquardt Method
    de Oliveira, Marcelo
    da Silva, Wyllian Bezerra
    Ono Fonseca, Keiko Veronica
    Prado Pohl, Alexandre de Almeida
    2014 IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING (BMSB), 2014,
  • [48] No-Reference Video Monitoring Image Blur Metric Based on Local Gradient Structure Similarity
    Chen, Shurong
    Jiao, Huijuan
    ARTIFICIAL INTELLIGENCE AND COMPUTATIONAL INTELLIGENCE, PT II, 2011, 7003 : 328 - 335
  • [49] A Novel No-Reference Metric for Estimating the Impact of Frame Freezing Artifacts on Perceptual Quality of Streamed Videos
    Usman, Muhammad Arslan
    Usman, Muhammad Rehan
    Shin, Soo Young
    IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (09) : 2344 - 2359
  • [50] Multi-view video coding using view interpolation and reference picture selection
    Kitahara, Masaki
    Kimata, Hideaki
    Shimizu, Shinya
    Kamikura, Kazuto
    Yashima, Yoshiyuki
    Yamamoto, Kenji
    Yendo, Tomohiro
    Fujii, Toshiaki
    Tanimoto, Masayuki
    2006 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO - ICME 2006, VOLS 1-5, PROCEEDINGS, 2006, : 97 - 100