No-Reference Multi-Level Video Quality Assessment Metric for 3D-Synthesized Videos

被引:1
|
作者
Wang, Guangcheng [1 ]
Huang, Baojin [2 ]
Gu, Ke [3 ]
Liu, Yuchen [3 ]
Liu, Hongyan [3 ]
Shi, Quan [1 ]
Zhai, Guangtao [4 ]
Zhang, Wenjun [4 ]
机构
[1] Nantong Univ, Sch Transportat & Civil Engn, Nantong 226019, Peoples R China
[2] Wuhan Univ, Natl Engn Res Ctr Multimedia Software, Sch Comp Sci, Wuhan 430072, Peoples R China
[3] Beijing Univ Technol, Beijing Artificial Intelligence Inst, Fac Informat Technol,Engn Res Ctr Intelligent Perc, Beijing Lab Smart Environm Protect,Minist Educ, Beijing 100124, Peoples R China
[4] Shanghai Jiao Tong Univ, Inst Image Commun & Informat Proc, Shanghai 200240, Peoples R China
基金
北京市自然科学基金;
关键词
Video quality assessment; 3D-synthesized video; multi-level; temporal flicker distortion; SYNTHESIZED IMAGES; INDEX; VIEWS;
D O I
10.1109/TBC.2024.3396696
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The visual quality of 3D-synthesized videos is closely related to the development and broadcasting of immersive media such as free-viewpoint videos and six degrees of freedom navigation. Therefore, studying the 3D-Synthesized video quality assessment is helpful to promote the popularity of immersive media applications. Inspired by the texture compression, depth compression and virtual view synthesis polluting the visual quality of 3D-synthesized videos at pixel-, structure-and content-levels, this paper proposes a Multi-Level 3D-Synthesized Video Quality Assessment algorithm, namely ML-SVQA, which consists of a quality feature perception module and a quality feature regression module. Specifically, the quality feature perception module firstly extracts motion vector fields of the 3D-synthesized video at pixel-, structure-and content-levels by combining the perception mechanism of human visual system. Then, the quality feature perception module measures the temporal flicker distortion intensity in the no-reference environment by calculating the self-similarity of adjacent motion vector fields. Finally, the quality feature regression module uses the machine learning algorithm to learn the mapping of the developed quality features to the quality score. Experiments constructed on the public IRCCyN/IVC and SIAT synthesized video datasets show that our ML-SVQA is more effective than state-of-the-art image/video quality assessment methods in evaluating the quality of 3D-Synthesized videos.
引用
收藏
页码:654 / 666
页数:13
相关论文
共 50 条
  • [1] A No-Reference Video Quality Assessment Metric Based On ROI
    Jia, Lixiu
    Zhong, Xuefei
    Tu, Yan
    Niu, Wenjuan
    IMAGE QUALITY AND SYSTEM PERFORMANCE XII, 2015, 9396
  • [2] No-reference image quality assessment of multi-level residual feature augmentation
    Chunxia Liu
    Yuanlin Zheng
    Kaiyang Liao
    Bing Chen
    Kaidi Wang
    Chongjun Zhong
    Bo Xie
    Yalin Miao
    Signal, Image and Video Processing, 2023, 17 : 1275 - 1283
  • [3] No-reference image quality assessment of multi-level residual feature augmentation
    Liu, Chunxia
    Zheng, Yuanlin
    Liao, Kaiyang
    Chen, Bing
    Wang, Kaidi
    Zhong, Chongjun
    Xie, Bo
    Miao, Yalin
    SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (04) : 1275 - 1283
  • [4] NIQSV plus : A No-Reference Synthesized View Quality Assessment Metric
    Tian, Shishun
    Zhang, Lu
    Morin, Luce
    Deforges, Olivier
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) : 1652 - 1664
  • [5] A NO-REFERENCE AUTOENCODER VIDEO QUALITY METRIC
    Martinez, Helard B.
    Farias, Mylene C. Q.
    Hines, Andrew
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 1755 - 1759
  • [6] A novel objective no-reference metric for digital video quality assessment
    Yang, FZ
    Wan, SA
    Chang, YL
    Wu, HR
    IEEE SIGNAL PROCESSING LETTERS, 2005, 12 (10) : 685 - 688
  • [7] Model and Performance of a No-Reference Quality Assessment Metric for Video Streaming
    Seyedebrahimi, Mirghiasaldin
    Bailey, Colin
    Peng, Xiao-Hong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2013, 23 (12) : 2034 - 2043
  • [8] No-Reference Stereoscopic Image Quality Assessment Based on Multi-Level Representation Network
    Shen L.
    Wang D.
    Xu K.
    Tianjin Daxue Xuebao (Ziran Kexue yu Gongcheng Jishu Ban)/Journal of Tianjin University Science and Technology, 2021, 54 (04): : 356 - 361
  • [9] An Innovative No-Reference Metric for Real-Time 3D Stereoscopic Video Quality Assessment
    Han, Yi
    Yuan, Zhenhui
    Muntean, Gabriel-Miro
    IEEE TRANSACTIONS ON BROADCASTING, 2016, 62 (03) : 654 - 663
  • [10] Learning Based Hybrid No-reference Video Quality Assessment of Compressed Videos
    Fazliani, Yasamin
    Andrade, Ernesto
    Shirani, Shahram
    2019 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2019,