Overview of Grand Challenge on Neural Network-based Video Coding in ISCAS 2022

被引:0
|
作者
Li, Yue [1 ]
Zhang, Li [1 ]
Xu, Jizheng [1 ]
Zhang, Kai [1 ]
机构
[1] Bytedance Inc, 8910 Univ Ctr Lane, San Diego, CA 92122 USA
关键词
neural network; video coding; grand challenge; ISCAS;
D O I
10.1109/PCS56426.2022.10018069
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recently years have witnessed an increasing interest in the neural network-based video coding, including end2end and hybrid schemes. To foster the research in this emerging field and provide a benchmark, we propose the Grand Challenge on Neural Network-based Video Coding (GC-NNVC) in the ISCAS 2022. In this paper, we review the grand challenge results and share interesting observations resulted from the challenge. This challenge includes two tracks, the hybrid-based and end2end-based. Different neural network-based coding schemes are evaluated according to their coding efficiency and innovations in methodologies in each track. To facilitate a solid comparison with conventional video coding techniques, the decoded sequences are evaluated in YUV 4:2:0 color format and PSNR is adopted as the distortion metric. Compared with the reference software of HEVC, submissions in hybrid track typically exhibit promising BD-rate reduction while submissions from the end2end track perform worse.
引用
收藏
页码:103 / 107
页数:5
相关论文
共 50 条
  • [1] Neural Network-Based Enhancement to Inter Prediction for Video Coding
    Wang, Yang
    Fan, Xiaopeng
    Xiong, Ruiqin
    Zhao, Debin
    Gao, Wen
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (02) : 826 - 838
  • [2] Convolutional Neural Network-Based Motion Compensation Refinement for Video Coding
    Huo, Shuai
    Liu, Dong
    Wu, Feng
    Li, Houqiang
    [J]. 2018 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2018,
  • [3] Convolutional Neural Network-Based Residue Super-Resolution for Video Coding
    Liu, Kang
    Liu, Dong
    Li, Houqiang
    Wu, Feng
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (IEEE VCIP), 2018,
  • [4] Towards Lightweight Neural Network-based Chroma Intra Prediction for Video Coding
    Zou, Chengyi
    Wan, Shuai
    Mrak, Marta
    Blanch, Marc Gorriz
    Herranz, Luis
    Ji, Tiannan
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 1006 - 1010
  • [5] Neural Network-Based Adaptive Polar Coding
    Miloslavskaya, Vera
    Li, Yonghui
    Vucetic, Branka
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 2024, 72 (04) : 1881 - 1894
  • [6] Multi-Scale Convolutional Neural Network-Based Intra Prediction for Video Coding
    Wang, Yang
    Fan, Xiaopeng
    Liu, Shaohui
    Zhao, Debin
    Gao, Wen
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (07) : 1803 - 1815
  • [7] IMAGE CODING WITH NEURAL NETWORK-BASED COLORIZATION
    Lopes, Diogo
    Ascenso, Joao
    Brites, Catarina
    Pereira, Fernando
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 4225 - 4229
  • [8] Neural network-based cross-channel chroma prediction for versatile video coding
    Liang, Fang
    Zhang, Jingde
    [J]. JOURNAL OF SUPERCOMPUTING, 2024, 80 (09): : 12166 - 12185
  • [9] Recurrent Neural Network-Based Video Compression
    Montajabi, Zahra
    Ghassab, Vahid Khorasani
    Bouguila, Nizar
    [J]. 2022 21ST IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, ICMLA, 2022, : 925 - 930
  • [10] CONVOLUTIONAL NEURAL NETWORK-BASED INVERTIBLE HALF-PIXEL INTERPOLATION FILTER FOR VIDEO CODING
    Yan, Ning
    Liu, Dong
    Li, Bin
    Li, Houqiang
    Xu, Tong
    Wu, Feng
    [J]. 2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 201 - 205