Dense Residual Convolutional Neural Network based In-Loop Filter for HEVC

被引:0
|
作者
Wang, Yingbin [1 ]
Zhu, Han [1 ]
Li, Yiming [2 ]
Chen, Zhenzhong [1 ,2 ]
Liu, Shan [3 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan, Hubei, Peoples R China
[2] Wuhan Univ, Sch Comp Sci, Wuhan, Hubei, Peoples R China
[3] Tencent Media Lab, Palo Alto, CA USA
基金
中国国家自然科学基金;
关键词
In-Loop Filtering; High Efficiency Video Coding (HEVC); Video Compression; Convolutional Neural Network (CNN); Image Restoration;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In-loop filtering is a key technique in the state of art video coding standard that plays a significant role in suppressing compression artifacts. Motivated by the latest advances of deep learning, in this paper, we design a dense residual convolutional neural network (DRN) based in-loop filter for High Efficiency Video Coding (HEVC). Taking advantage of both dense shortcuts and residual learning, DRN efficiently exploits the multi-level features to restore the high quality image from the degraded one. Bottleneck layers are employed in DRN in order to adaptively fuse the hierarchical features and saving the computational resources at the same time. Experimental results show that the proposed DRN based in-loop filter can further boost the coding performance, which provides 6.9% BD-rate reduction on average compared to the HEVC baseline. In addition, the proposed DRN outperforms previous CNN based in-loop filters.
引用
收藏
页数:4
相关论文
共 50 条
  • [1] In-Loop Filter with Dense Residual Convolutional Neural Network for VVC
    Chen, Sijia
    Chen, Zhenzhong
    Wang, Yingbin
    Liu, Shan
    [J]. THIRD INTERNATIONAL CONFERENCE ON MULTIMEDIA INFORMATION PROCESSING AND RETRIEVAL (MIPR 2020), 2020, : 153 - 156
  • [2] Residual in Residual Based Convolutional Neural Network In-loop Filter for AVS3
    Lin, Kai
    Jia, Chuanmin
    Zhao, Zhenghui
    Wang, Li
    Wang, Shanshe
    Ma, Siwei
    Gao, Wen
    [J]. 2019 PICTURE CODING SYMPOSIUM (PCS), 2019,
  • [3] Residual Highway Convolutional Neural Networks for in-loop Filtering in HEVC
    Zhang, Yongbing
    Shen, Tao
    Ji, Xiangyang
    Zhang, Yun
    Xiong, Ruiqin
    Dai, Qionghai
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (08) : 3827 - 3841
  • [4] Dense Inception Attention Neural Network for In-Loop Filter
    Xu, Xiaoyu
    Qian, Jian
    Yu, Li
    Wang, Hongkui
    Zeng, Xing
    Li, Zhengang
    Wang, Ning
    [J]. 2019 PICTURE CODING SYMPOSIUM (PCS), 2019,
  • [5] CONVOLUTIONAL NEURAL NETWORK BASED IN-LOOP FILTER FOR VVC INTRA CODING
    Li, Yue
    Zhang, Li
    Zhang, Kai
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 2104 - 2108
  • [6] MULTI-GRADIENT CONVOLUTIONAL NEURAL NETWORK BASED IN-LOOP FILTER FOR VVC
    Huang, Zhijie
    Li, Yunchang
    Sun, Jun
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [7] Recursive Residual Convolutional Neural Network- Based In-Loop Filtering for Intra Frames
    Zhang, Shufang
    Fan, Zenghui
    Ling, Nam
    Jiang, Minqiang
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (07) : 1888 - 1900
  • [8] RESIDUAL CONVOLUTIONAL NEURAL NETWORK BASED IN-LOOP FILTER WITH INTRA AND INTER FRAMES PROCESSED RESPECTIVELY FOR AVS3
    Zhu, Han
    Xu, Xiaozhong
    Liu, Shan
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (ICMEW), 2020,
  • [9] Efficient In-Loop Filtering Based on Enhanced Deep Convolutional Neural Networks for HEVC
    Pan, Zhaoqing
    Yi, Xiaokai
    Zhang, Yun
    Jeon, Byeungwoo
    Kwong, Sam
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 5352 - 5366
  • [10] An Efficient QP Variable Convolutional Neural Network Based In-loop Filter for Intra Coding
    Huang, Zhijie
    Guo, Xiaopeng
    Shang, Mingyu
    Gao, Jie
    Sun, Jun
    [J]. 2021 DATA COMPRESSION CONFERENCE (DCC 2021), 2021, : 33 - 42