How to Train No Reference Video Quality Measures for New Coding Standards using Existing Annotated Datasets?

被引:0
|
作者
Tiotsop, Lohic Fotio [1 ]
Mizdos, Tomas [2 ]
Masala, Enrico [1 ]
Barkowsky, Marcus [3 ]
Pocta, Peter [2 ]
机构
[1] Politecn Torino, Dept Control & Comp Engn, Turin, Italy
[2] Univ Zilina, Dept Multimedia & ICT, Zilina, Slovakia
[3] Univ Appl Sci, Deggendorf Inst Technol, Deggendorf, Germany
关键词
subjective experiment; data reuse; video quality; HEVC encoded videos; hybrid model; machine learning; PSNR;
D O I
10.1109/MMSP53017.2021.9733456
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Subjective experiments are important for developing objective Video Quality Measures (VQMs). However, they are time-consuming and resource-demanding. In this context, being able to reuse existing subjective data on previous video coding standards to train models capable of predicting the perceptual quality of video content processed with newer codecs acquires significant importance. This paper investigates the possibility of generating an HEVC encoded Processed Video Sequence (PVS) in such a way that its perceptual quality is as similar as possible to that of an AVC encoded PVS whose quality has already been assessed by human subjects. In this way, the perceptual quality of the newly generated HEVC encoded PVS may be annotated approximately with the Mean Opinion Score (MOS) of the related AVC encoded PVS. To show the effectiveness of our approach, we compared the performance of a simple and low complexity but yet effective no reference hybrid model trained on the data generated with our approach with the same model trained on data collected in the context of a pristine subjective experiment. In addition, we merged seven subjective experiments such that they can be used as one aligned dataset containing either original HEVC bitstreams or the newly generated data explained in our proposed approach. The merging process accounts for the differences in terms of quality scale, chosen assessment method and context influence factors. This yields a large annotated dataset of HEVC sequences that is made publicly available for the design and training of no reference hybrid VQMs for HEVC encoded content.
引用
收藏
页数:6
相关论文
共 8 条
  • [1] How to reuse existing annotated image quality datasets to enlarge available training data with new distortion types
    Mizdos, Tomas
    Barkowsky, Marcus
    Uhrina, Miroslav
    Pocta, Peter
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (18) : 28137 - 28159
  • [2] How to reuse existing annotated image quality datasets to enlarge available training data with new distortion types
    Tomas Mizdos
    Marcus Barkowsky
    Miroslav Uhrina
    Peter Pocta
    [J]. Multimedia Tools and Applications, 2021, 80 : 28137 - 28159
  • [3] FULL REFERENCE VIDEO QUALITY MEASURES IMPROVEMENT USING NEURAL NETWORKS
    Tiotsop, Lohic Fotio
    Servetti, Antonio
    Masala, Enrico
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 2737 - 2741
  • [4] QMET: A New Quality Assessment Metric for No-Reference Video Coding by Using Human Eye Traversal
    Podder, Pallab Kanti
    Paul, Manoranjan
    Murshed, Manzur
    [J]. PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON IMAGE AND VISION COMPUTING NEW ZEALAND (IVCNZ), 2016, : 140 - 145
  • [5] ONLY-REFERENCE VIDEO QUALITY ASSESSMENT FOR VIDEO CODING USING CONVOLUTIONAL NEURAL NETWORK
    Dinh, Khanh Quoc
    Lee, Jongseok
    Kim, Jaehwan
    Park, Youngo
    Choi, Kwang Pyo
    Park, JeongHoon
    [J]. 2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 2496 - 2500
  • [6] Evaluation of reconstruction quality in image vector quantisation using existing and new measures
    Al-Otum, HM
    [J]. IEE PROCEEDINGS-VISION IMAGE AND SIGNAL PROCESSING, 1998, 145 (05): : 349 - 356
  • [7] USING OVERLAPPING SUBJECTIVE DATASETS TO ASSESS THE PERFORMANCE OF OBJECTIVE QUALITY METRICS ON SCALABLE VIDEO CODING AND ERROR CONCEALMENT
    Pitrey, Y.
    Pepion, R.
    Le Callet, P.
    Barkowsky, M.
    [J]. 2012 Fourth International Workshop on Quality of Multimedia Experience (QoMEX), 2012, : 103 - 108
  • [8] Predicting Full-Reference Video Quality Measures using HEVC Bitstream-Based No-Reference Features
    Shahid, Muhammad
    Panasiuk, Joanna
    Van Wallendael, Glenn
    Barkowsky, Marcus
    Lovstrom, Benny
    [J]. 2015 SEVENTH INTERNATIONAL WORKSHOP ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2015,