No-Reference Multi-Level Video Quality Assessment Metric for 3D-Synthesized Videos

被引:1
|
作者
Wang, Guangcheng [1 ]
Huang, Baojin [2 ]
Gu, Ke [3 ]
Liu, Yuchen [3 ]
Liu, Hongyan [3 ]
Shi, Quan [1 ]
Zhai, Guangtao [4 ]
Zhang, Wenjun [4 ]
机构
[1] Nantong Univ, Sch Transportat & Civil Engn, Nantong 226019, Peoples R China
[2] Wuhan Univ, Natl Engn Res Ctr Multimedia Software, Sch Comp Sci, Wuhan 430072, Peoples R China
[3] Beijing Univ Technol, Beijing Artificial Intelligence Inst, Fac Informat Technol,Engn Res Ctr Intelligent Perc, Beijing Lab Smart Environm Protect,Minist Educ, Beijing 100124, Peoples R China
[4] Shanghai Jiao Tong Univ, Inst Image Commun & Informat Proc, Shanghai 200240, Peoples R China
基金
北京市自然科学基金;
关键词
Video quality assessment; 3D-synthesized video; multi-level; temporal flicker distortion; SYNTHESIZED IMAGES; INDEX; VIEWS;
D O I
10.1109/TBC.2024.3396696
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The visual quality of 3D-synthesized videos is closely related to the development and broadcasting of immersive media such as free-viewpoint videos and six degrees of freedom navigation. Therefore, studying the 3D-Synthesized video quality assessment is helpful to promote the popularity of immersive media applications. Inspired by the texture compression, depth compression and virtual view synthesis polluting the visual quality of 3D-synthesized videos at pixel-, structure-and content-levels, this paper proposes a Multi-Level 3D-Synthesized Video Quality Assessment algorithm, namely ML-SVQA, which consists of a quality feature perception module and a quality feature regression module. Specifically, the quality feature perception module firstly extracts motion vector fields of the 3D-synthesized video at pixel-, structure-and content-levels by combining the perception mechanism of human visual system. Then, the quality feature perception module measures the temporal flicker distortion intensity in the no-reference environment by calculating the self-similarity of adjacent motion vector fields. Finally, the quality feature regression module uses the machine learning algorithm to learn the mapping of the developed quality features to the quality score. Experiments constructed on the public IRCCyN/IVC and SIAT synthesized video datasets show that our ML-SVQA is more effective than state-of-the-art image/video quality assessment methods in evaluating the quality of 3D-Synthesized videos.
引用
收藏
页码:654 / 666
页数:13
相关论文
共 50 条
  • [21] Predictive no-reference assessment of video quality
    Vega, Maria Torres
    Mocanu, Decebal Constantin
    Stavrou, Stavros
    Liotta, Antonio
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2017, 52 : 20 - 32
  • [22] No-Reference Video Quality Assessment Metric Using Spatiotemporal Features Through LSTM
    Kwong, Ngai-Wing
    Tsang, Sik-Ho
    Chan, Yui-Lam
    Lun, Daniel Pak-Kong
    Lee, Tsz-Kwan
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY (IWAIT) 2021, 2021, 11766
  • [23] A No-reference Quality Assessment Metric for Point Cloud Based on Captured Video Sequences
    Fan, Yu
    Zhang, Zicheng
    Sun, Wei
    Min, Xiongkuo
    Liu, Ning
    Zhou, Quan
    He, Jun
    Wang, Qiyuan
    Zhai, Guangtao
    2022 IEEE 24TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2022,
  • [24] Predictive no-reference assessment of video quality
    Torres Vega M.
    Mocanu D.C.
    Stavrou S.
    Liotta A.
    Torres Vega, Maria (m.torres.vega@tue.nl), 1600, Elsevier B.V., Netherlands (52): : 20 - 32
  • [25] Novel No-Reference Video Quality Assessment Metric with Estimation of Dynamic Range Distortion
    Kim, Yo-Han
    Han, Junghyun
    Kim, Hyuntai
    Shin, Jitae
    12TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY: ICT FOR GREEN GROWTH AND SUSTAINABLE DEVELOPMENT, VOLS 1 AND 2, 2010, : 1689 - 1692
  • [26] No-reference artifacts measurements based video quality metric
    Vranjes, Mario
    Bajcinovci, Viliams
    Grbic, Ratko
    Vajak, Denis
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2019, 78 : 345 - 358
  • [27] Synthesized View Comparison Method for No-Reference 3D Image Quality Assessment
    Luo, Fangzhou
    Lin, Chaoyi
    Gu, Xiaodong
    Ma, Xiaojun
    NINTH INTERNATIONAL CONFERENCE ON GRAPHIC AND IMAGE PROCESSING (ICGIP 2017), 2018, 10615
  • [28] A NO-REFERENCE AUDIO-VISUAL VIDEO QUALITY METRIC
    Martinez, Helard Becerra
    Farias, Mylene C. Q.
    2014 PROCEEDINGS OF THE 22ND EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2014, : 2125 - 2129
  • [29] A no-reference quality metric for evaluating deinterlaced video frames
    Lam, Eric P.
    Leddy, Christopher A.
    Nash, Stephen R.
    Parks, H. Alan
    INFRARED TECHNOLOGY AND APPLICATIONS XXXII, PTS 1AND 2, 2006, 6206
  • [30] No-reference video quality metric based on artifact measurements
    Farias, MCQ
    Mitra, SK
    2005 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), VOLS 1-5, 2005, : 3593 - 3596