Is a no-reference necessary and sufficient metric for video frame and stereo view interpolation possible?

被引:0
|
作者
Ramachandra, Vikas [1 ]
Nguyen, Truong Q. [2 ]
机构
[1] Qualcomm Inc, Multimedia R&D, San Diego, CA 92121 USA
[2] Univ Calif San Diego, La Jolla, CA 92093 USA
关键词
Stereo; disparity estimation; motion estimation; metrics; correspondence; disparity; view interpolation; consistency; occlusion; no reference;
D O I
10.1117/12.839942
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
This paper explores a novel metric which can check the consistency and correctness of a disparity map, and hence validate an interpolated view (or video frame for motion compensated frame interpolation) from the estimated correspondences between two or more input views. The proposed reprojection error metric (REM) is shown to be sufficient for the regions where the observed 3D scene has no occlusions. The metric is completely automatic requiring no human input. We also explain how the metric can be extended to be useful for 3D scenes (or videos) with occlusions. However, the proposed metric does not satisfy necessary conditions. We discuss the issues which arise during the design of a necessary metric, and argue that necessary metrics which work in finite time cannot be designed for checking the validity of a method which performs disparity estimation.
引用
收藏
页数:6
相关论文
共 50 条
  • [31] No-reference Video Quality Metric based on the Packet Delay Variation Parameter
    Begazo, Dante Coaquira
    Rodriguez, Demostenes Zegarra
    Ramirez, Miguel Arjona
    2016 IEEE INTERNATIONAL SYMPOSIUM ON CONSUMER ELECTRONICS - 20TH IEEE ISCE, 2016, : 83 - 84
  • [32] A new objective quality metric for frame interpolation used in video compression
    Yang, Kai-Chieh
    Huang, Ai-Mei
    Nguyen, Truong Q.
    Guest, Clark C.
    Das, Pankaj K.
    IEEE TRANSACTIONS ON BROADCASTING, 2008, 54 (03) : 680 - 690
  • [33] New objective quality metric for frame interpolation using in video compression
    Yang, Kai-Chieh
    Huang, Ai-Mei
    Nguyen, Truong
    Guest, Clark C.
    Das, Pankaj K.
    2007 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-7, 2007, : 741 - 744
  • [34] No-Reference Video Quality Assessment with Frame-Level Hybrid Parameters for Mobile Video Services
    Wei, Bowen
    Zhang, Yuan
    2016 2ND IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATIONS (ICCC), 2016, : 490 - 494
  • [35] No-Reference Metric Design With Machine Learning for Local Video Compression Artifact Level
    Vink, Jelte Peter
    de Haan, Gerard
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2011, 5 (02) : 297 - 308
  • [36] A fast stereoscopic frame estimation and interpolation algorithm in compressed stereo video streams
    Luo, Y
    Zhang, ZY
    SECOND INTERNATION CONFERENCE ON IMAGE AND GRAPHICS, PTS 1 AND 2, 2002, 4875 : 80 - 86
  • [37] Distortion-based No-Reference quality metric for video transmission over IP
    Battisti, Federica
    Carli, Marco
    Liu, Yiwei
    Neri, Alessandro
    Paudyal, Pradip
    2015 INTERNATIONAL SYMPOSIUM ON SIGNALS, CIRCUITS AND SYSTEMS (ISSCS), 2015,
  • [38] A Generic Method to Improve No-Reference Image Blur Metric Accuracy in Video Contents
    Liu, Yankai
    Song, Li
    Xie, Rong
    Zhang, Wenjun
    2017 IEEE VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2017,
  • [39] No-Reference Video Quality Assessment Metric Using Spatiotemporal Features Through LSTM
    Kwong, Ngai-Wing
    Tsang, Sik-Ho
    Chan, Yui-Lam
    Lun, Daniel Pak-Kong
    Lee, Tsz-Kwan
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY (IWAIT) 2021, 2021, 11766
  • [40] A No-reference Quality Assessment Metric for Point Cloud Based on Captured Video Sequences
    Fan, Yu
    Zhang, Zicheng
    Sun, Wei
    Min, Xiongkuo
    Liu, Ning
    Zhou, Quan
    He, Jun
    Wang, Qiyuan
    Zhai, Guangtao
    2022 IEEE 24TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2022,