Is a no-reference necessary and sufficient metric for video frame and stereo view interpolation possible?

被引:0
|
作者
Ramachandra, Vikas [1 ]
Nguyen, Truong Q. [2 ]
机构
[1] Qualcomm Inc, Multimedia R&D, San Diego, CA 92121 USA
[2] Univ Calif San Diego, La Jolla, CA 92093 USA
关键词
Stereo; disparity estimation; motion estimation; metrics; correspondence; disparity; view interpolation; consistency; occlusion; no reference;
D O I
10.1117/12.839942
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
This paper explores a novel metric which can check the consistency and correctness of a disparity map, and hence validate an interpolated view (or video frame for motion compensated frame interpolation) from the estimated correspondences between two or more input views. The proposed reprojection error metric (REM) is shown to be sufficient for the regions where the observed 3D scene has no occlusions. The metric is completely automatic requiring no human input. We also explain how the metric can be extended to be useful for 3D scenes (or videos) with occlusions. However, the proposed metric does not satisfy necessary conditions. We discuss the issues which arise during the design of a necessary metric, and argue that necessary metrics which work in finite time cannot be designed for checking the validity of a method which performs disparity estimation.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] NO-REFERENCE TEMPORAL QUALITY METRIC FOR VIDEO IMPAIRED BY FRAME FREEZING ARTEFACTS
    Huynh-Thu, Quan
    Ghanbari, Mohammed
    2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, : 2221 - +
  • [2] A NO-REFERENCE AUTOENCODER VIDEO QUALITY METRIC
    Martinez, Helard B.
    Farias, Mylene C. Q.
    Hines, Andrew
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 1755 - 1759
  • [3] A Novel No-Reference Video Quality Metric for Evaluating Temporal Jerkiness due to Frame Freezing
    Xue, Yuanyi
    Erkin, Beril
    Wang, Yao
    IEEE TRANSACTIONS ON MULTIMEDIA, 2015, 17 (01) : 134 - 139
  • [4] No-reference quality metric for degraded and enhanced video
    Caviedes, JE
    Oberti, F
    VISUAL COMMUNICATIONS AND IMAGE PROCESSING 2003, PTS 1-3, 2003, 5150 : 621 - 632
  • [5] A Perceptual Quality Metric for Video Frame Interpolation
    Hou, Qiqi
    Ghildyal, Abhijay
    Liu, Feng
    COMPUTER VISION - ECCV 2022, PT XV, 2022, 13675 : 234 - 253
  • [6] Objective No-reference Stereo Video Quality Assessment Research
    Li, Yan
    Yang, Yu
    PROCEEDINGS OF 3RD INTERNATIONAL CONFERENCE ON MULTIMEDIA TECHNOLOGY (ICMT-13), 2013, 84 : 1228 - 1233
  • [7] Video Frame Interpolation With Stereo Event and Intensity Cameras
    Ding, Chao
    Lin, Mingyuan
    Zhang, Haijian
    Liu, Jianzhuang
    Yu, Lei
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 9187 - 9202
  • [8] Stereo video coding based on frame estimation and interpolation
    Luo, Y
    Zhang, ZY
    An, P
    IEEE TRANSACTIONS ON BROADCASTING, 2003, 49 (01) : 14 - 21
  • [9] A No-Reference Video Quality Assessment Metric Based On ROI
    Jia, Lixiu
    Zhong, Xuefei
    Tu, Yan
    Niu, Wenjuan
    IMAGE QUALITY AND SYSTEM PERFORMANCE XII, 2015, 9396
  • [10] No-reference artifacts measurements based video quality metric
    Vranjes, Mario
    Bajcinovci, Viliams
    Grbic, Ratko
    Vajak, Denis
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2019, 78 : 345 - 358