Dense Residual Convolutional Neural Network based In-Loop Filter for HEVC

被引:0
|
作者
Wang, Yingbin [1 ]
Zhu, Han [1 ]
Li, Yiming [2 ]
Chen, Zhenzhong [1 ,2 ]
Liu, Shan [3 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan, Hubei, Peoples R China
[2] Wuhan Univ, Sch Comp Sci, Wuhan, Hubei, Peoples R China
[3] Tencent Media Lab, Palo Alto, CA USA
基金
中国国家自然科学基金;
关键词
In-Loop Filtering; High Efficiency Video Coding (HEVC); Video Compression; Convolutional Neural Network (CNN); Image Restoration;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In-loop filtering is a key technique in the state of art video coding standard that plays a significant role in suppressing compression artifacts. Motivated by the latest advances of deep learning, in this paper, we design a dense residual convolutional neural network (DRN) based in-loop filter for High Efficiency Video Coding (HEVC). Taking advantage of both dense shortcuts and residual learning, DRN efficiently exploits the multi-level features to restore the high quality image from the degraded one. Bottleneck layers are employed in DRN in order to adaptively fuse the hierarchical features and saving the computational resources at the same time. Experimental results show that the proposed DRN based in-loop filter can further boost the coding performance, which provides 6.9% BD-rate reduction on average compared to the HEVC baseline. In addition, the proposed DRN outperforms previous CNN based in-loop filters.
引用
收藏
页数:4
相关论文
共 50 条
  • [31] MULTI-MODAL/MULTI-SCALE CONVOLUTIONAL NEURAL NETWORK BASED IN-LOOP FILTER DESIGN FOR NEXT GENERATION VIDEO CODEC
    Kang, Jihong
    Kim, Sungjei
    Lee, Kyoung Mu
    [J]. 2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 26 - 30
  • [32] A Deep Learning Approach for Multi-Frame In-Loop Filter of HEVC
    Li, Tianyi
    Xu, Mai
    Zhu, Ce
    Yang, Ren
    Wang, Zulin
    Guan, Zhenyu
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (11) : 5663 - 5678
  • [33] Group-normalized deep CNN-based in-loop filter for HEVC scalable extension
    Dhanalakshmi, A.
    Nagarajan, G.
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2022, 16 (02) : 437 - 445
  • [34] CONTENT ADAPTIVE IN-LOOP DEPTH MAP FILTER FOR HEVC BASED 3DV CODING
    He, Jianqiang
    Ma, Siwei
    Zhang, Nan
    Gao, Wen
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 2011 - 2015
  • [35] Group-normalized deep CNN-based in-loop filter for HEVC scalable extension
    A. Dhanalakshmi
    G. Nagarajan
    [J]. Signal, Image and Video Processing, 2022, 16 : 437 - 445
  • [36] A Reconfigurable Framework for Neural Network Based Video In-Loop Filtering
    Zhang, Yichi
    Ding, Dandan
    Ma, Zhan
    Li, Zhu
    [J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (06)
  • [37] Multiscale convolutional neural networks for in-loop video restoration
    Misra, Kiran
    Segall, Andrew
    Choi, Byeongdoo
    [J]. 2023 DATA COMPRESSION CONFERENCE, DCC, 2023, : 188 - 197
  • [38] Intra Prediction Using In-Loop Residual Coding for the post-HEVC Standard
    Abdoli, Mohsen
    Henry, Felix
    Brault, Patrice
    Duhamel, Pierre
    Dufaux, Frederic
    [J]. 2017 IEEE 19TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2017,
  • [39] Residual Block Fusion in Low Complexity Neural Network-Based In-loop Filtering for Video Compression
    Shao, Tong
    Shingala, Jay N.
    Shyam, Ajay
    Yin, Peng
    Suneja, Ajat
    Badya, Siddarth P.
    Arora, Arjun
    McCarthy, Sean
    [J]. 2024 DATA COMPRESSION CONFERENCE, DCC, 2024, : 392 - 401
  • [40] Hardware Design of HEVC In-Loop Filter for Ultra-HD Video Encoding
    Park, Seungyong
    Ryoo, Kwangki
    [J]. ADVANCED MULTIMEDIA AND UBIQUITOUS ENGINEERING, MUE/FUTURETECH 2018, 2019, 518 : 405 - 409