No-Reference Multi-Level Video Quality Assessment Metric for 3D-Synthesized Videos

被引:1
|
作者
Wang, Guangcheng [1 ]
Huang, Baojin [2 ]
Gu, Ke [3 ]
Liu, Yuchen [3 ]
Liu, Hongyan [3 ]
Shi, Quan [1 ]
Zhai, Guangtao [4 ]
Zhang, Wenjun [4 ]
机构
[1] Nantong Univ, Sch Transportat & Civil Engn, Nantong 226019, Peoples R China
[2] Wuhan Univ, Natl Engn Res Ctr Multimedia Software, Sch Comp Sci, Wuhan 430072, Peoples R China
[3] Beijing Univ Technol, Beijing Artificial Intelligence Inst, Fac Informat Technol,Engn Res Ctr Intelligent Perc, Beijing Lab Smart Environm Protect,Minist Educ, Beijing 100124, Peoples R China
[4] Shanghai Jiao Tong Univ, Inst Image Commun & Informat Proc, Shanghai 200240, Peoples R China
基金
北京市自然科学基金;
关键词
Video quality assessment; 3D-synthesized video; multi-level; temporal flicker distortion; SYNTHESIZED IMAGES; INDEX; VIEWS;
D O I
10.1109/TBC.2024.3396696
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The visual quality of 3D-synthesized videos is closely related to the development and broadcasting of immersive media such as free-viewpoint videos and six degrees of freedom navigation. Therefore, studying the 3D-Synthesized video quality assessment is helpful to promote the popularity of immersive media applications. Inspired by the texture compression, depth compression and virtual view synthesis polluting the visual quality of 3D-synthesized videos at pixel-, structure-and content-levels, this paper proposes a Multi-Level 3D-Synthesized Video Quality Assessment algorithm, namely ML-SVQA, which consists of a quality feature perception module and a quality feature regression module. Specifically, the quality feature perception module firstly extracts motion vector fields of the 3D-synthesized video at pixel-, structure-and content-levels by combining the perception mechanism of human visual system. Then, the quality feature perception module measures the temporal flicker distortion intensity in the no-reference environment by calculating the self-similarity of adjacent motion vector fields. Finally, the quality feature regression module uses the machine learning algorithm to learn the mapping of the developed quality features to the quality score. Experiments constructed on the public IRCCyN/IVC and SIAT synthesized video datasets show that our ML-SVQA is more effective than state-of-the-art image/video quality assessment methods in evaluating the quality of 3D-Synthesized videos.
引用
收藏
页码:654 / 666
页数:13
相关论文
共 50 条
  • [41] No-Reference Video Quality Assessment in the Compressed Domain
    Lin, Xiangyu
    Ma, Hanjie
    Luo, Lei
    Chen, Yaowu
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2012, 58 (02) : 505 - 512
  • [42] A SPATIOTEMPORAL NO-REFERENCE VIDEO QUALITY ASSESSMENT MODEL
    Konuk, Baris
    Zerman, Emin
    Nur, Gokce
    Akar, Gozde Bozdagi
    2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, : 54 - 58
  • [43] An Efficient Method for No-Reference Video Quality Assessment
    Agarla, Mirko
    Celona, Luigi
    Schettini, Raimondo
    JOURNAL OF IMAGING, 2021, 7 (03)
  • [44] A novel no-reference video quality assessment algorithm
    Yang, Lin
    Yang, Yingyun
    Ma, Yong
    PROCEEDINGS OF 2018 IEEE 4TH INFORMATION TECHNOLOGY AND MECHATRONICS ENGINEERING CONFERENCE (ITOEC 2018), 2018, : 181 - 187
  • [45] A NO-REFERENCE VISUAL QUALITY METRIC FOR 3D COLOR MESHES
    Zhang, Zicheng
    Sun, Wei
    Min, Xiongkuo
    Wang, Tao
    Lu, Wei
    Zhu, Wenhan
    Zhai, Guangtao
    2021 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2021,
  • [46] FINGERPRINT QUALITY ASSESSMENT USING A NO-REFERENCE IMAGE QUALITY METRIC
    El Abed, Mohamad
    Ninassi, Alexandre
    Charrier, Christophe
    Rosenberger, Christophe
    2013 PROCEEDINGS OF THE 21ST EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2013,
  • [47] ANN based Measurement for No-Reference Video Quality of Experience Metric
    Ajrash, Amal Sufiuh
    Ghani, Rana Fareed
    Al-Jobouri, Laith
    2019 11TH COMPUTER SCIENCE AND ELECTRONIC ENGINEERING (CEEC), 2019, : 128 - 133
  • [48] HYBRID NO-REFERENCE VIDEO QUALITY METRIC BASED ON MULTIWAY PLSR
    Keimel, Christian
    Habigt, Julian
    Diepold, Klaus
    2012 PROCEEDINGS OF THE 20TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2012, : 1244 - 1248
  • [49] A Novel Quality Assessment Metric for Synthesized Virtual View in 3D Video
    Zhang, Yan
    FUZZY SYSTEMS AND DATA MINING III (FSDM 2017), 2017, 299 : 517 - 524
  • [50] NIQSV: A NO REFERENCE IMAGE QUALITY ASSESSMENT METRIC FOR 3D SYNTHESIZED VIEWS
    Tian, Shishun
    Zhang, Lu
    Morin, Luce
    Deforges, Olivier
    2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 1248 - 1252