DEEP LEARNING BASED HEVC IN-LOOP FILTERING FOR DECODER QUALITY ENHANCEMENT

被引:0
|
作者
Kuanar, Shiba [1 ]
Conly, Christopher [2 ]
Rao, K. R. [1 ]
机构
[1] Univ Texas Arlington, Elect Engn, Arlington, TX 76019 USA
[2] Univ Texas Arlington, Comp Sci & Engn, Arlington, TX 76019 USA
关键词
De-blocking; SAO; CNN; De-conv; Quality;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
High Efficiency Video Coding (HEVC), which is the latest video coding standard currently, achieves up to 50% bit rate reduction compared to previous H.264/AVC standard. While performing the block based video coding, these lossy compression techniques produce various artifacts like blurring, distortion, ringing, and contouring effects on output frames, especially at low bit rates. To reduce those compression artifacts HEVC adopted two post processing filtering technique namely de-blocking filter (DBF) and sample adaptive offset (SAO) on the decoder side. While DBF applies to samples located at block boundaries, SAO nonlinear operation applies adaptively to samples satisfying the gradient based conditions through a lookup table. Again SAO filter corrects the quantization errors by sending edge offset values to decoders. This operation consumes extra signaling bit and becomes an overhead to network. In this paper, we proposed a Convolutional Neural Network (CNN) based architecture for SAO in-loop filtering operation without modifying anything on encoding process. Our experimental results show that our proposed model outperformed previous state-of-the-art models in terms of BD-PSNR (0.408 dB) and BD-BR (3.44%), measured on a widely available standard video sequences.
引用
收藏
页码:164 / 168
页数:5
相关论文
共 50 条
  • [1] Offset-Based In-Loop Filtering With a Deep Network in HEVC
    Lee, So Yoon
    Yang, Yoonmo
    Kim, Dongsin
    Cho, Seunghyun
    Oh, Byung Tae
    [J]. IEEE ACCESS, 2020, 8 : 213958 - 213967
  • [2] Deep learning based HEVC in-loop filter and noise reduction
    Kuanar, Shiba
    Rao, K. R.
    Conly, Christopher
    Gorey, Ninad
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2021, 99
  • [3] Efficient In-Loop Filtering Based on Enhanced Deep Convolutional Neural Networks for HEVC
    Pan, Zhaoqing
    Yi, Xiaokai
    Zhang, Yun
    Jeon, Byeungwoo
    Kwong, Sam
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 5352 - 5366
  • [4] Parallel In-Loop Filtering in HEVC Encoder on GPU
    Wang, Yang
    Guo, Xun
    Fan, Xiaopeng
    Lu, Yan
    Zhao, Debin
    Gao, Wen
    [J]. IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2018, 64 (03) : 276 - 284
  • [5] Implementation of in-loop filter for HEVC decoder on reconfigurable processor
    Liu, Leibo
    Chen, Yingjie
    Deng, Chenchen
    Yin, Shouyi
    Wei, Shaojun
    [J]. IET IMAGE PROCESSING, 2017, 11 (09) : 685 - 692
  • [6] A Deep Learning Approach for Multi-Frame In-Loop Filter of HEVC
    Li, Tianyi
    Xu, Mai
    Zhu, Ce
    Yang, Ren
    Wang, Zulin
    Guan, Zhenyu
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (11) : 5663 - 5678
  • [7] Detection of transcoded HEVC videos based on in-loop filtering and PU partitioning analyses
    Xu, Qiang
    Jiang, Xinghao
    Sun, Tanfeng
    Kot, Alex C.
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2021, 92
  • [8] A Switchable Deep Learning Approach for In-Loop Filtering in Video Coding
    Ding, Dandan
    Kong, Lingyi
    Chen, Guangyao
    Liu, Zoe
    Fang, Yong
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (07) : 1871 - 1887
  • [9] Complexity Reduction of In-Loop Filtering for Compressed Image Restoration in HEVC
    Miyazawa, Kazuyuki
    Murakami, Tokumichi
    Minezawa, Akira
    Sakate, Hiroharu
    [J]. 2012 PICTURE CODING SYMPOSIUM (PCS), 2012, : 413 - 416
  • [10] Residual Highway Convolutional Neural Networks for in-loop Filtering in HEVC
    Zhang, Yongbing
    Shen, Tao
    Ji, Xiangyang
    Zhang, Yun
    Xiong, Ruiqin
    Dai, Qionghai
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (08) : 3827 - 3841