Group-normalized deep CNN-based in-loop filter for HEVC scalable extension

被引:2
|
作者
Dhanalakshmi, A. [1 ,2 ]
Nagarajan, G. [3 ]
机构
[1] Sathyabama Inst Sci & Technol, Sch Elect & Elect, Chennai, Tamil Nadu, India
[2] Panimalar Engn Coll, Dept Comp & Commun Engn, Chennai, Tamil Nadu, India
[3] Sathyabama Inst Sci & Technol, Sch Comp, Dept Comp Sci & Engn, Chennai, Tamil Nadu, India
关键词
SHVC; In-loop filter; Convolutional neural network; Group-normalization; PSNR; Bitrate;
D O I
10.1007/s11760-021-01966-7
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
High Efficiency Video Coding (HEVC) is the recent video coding standard that can compress raw video at a higher compression state. The extension of HEVC, Scalable High Efficiency Video Coding (SHVC), also has the similar compression phenomenon of HEVC in addition to the implementation of multiple single-layer HEVC streams along with the interlayer reference modules, although the layer-based SHVC incurs more artifacts after compression compared to HEVC resulting with severe degradation in the video quality. To ease this, in-loop filter is used to remove artifacts in H.265 video coding standard. Although the artifacts will be more severe for multiple-layered codec SHVC compared to single-layer HEVC. With the development in deep learning, a group-normalized deep convolutional neural network (gDCNN) is proposed for SHVC in-loop filter to enhance the performance. Initially, the troubles that are met while modeling the traditional CNN that includes normalization, learning capability and the loss functions are examined. Following, on the basis of statistical analysis, the proposed gDCNN is introduced to remove the artifacts efficiently. It is achieved by a group-wise normalization approach, a feature extraction and fusion and a precise loss function. The simulation setting shows 4.2% BD-BR decrement with 0.46 dB increment in BD-PSNR.
引用
收藏
页码:437 / 445
页数:9
相关论文
共 37 条
  • [21] DEEP LEARNING BASED HEVC IN-LOOP FILTERING FOR DECODER QUALITY ENHANCEMENT
    Kuanar, Shiba
    Conly, Christopher
    Rao, K. R.
    2018 PICTURE CODING SYMPOSIUM (PCS 2018), 2018, : 164 - 168
  • [22] A CU-level Adaptive Decision Method for CNN-based In-loop Filtering
    Wang, Qi
    Bei, Yue
    Cheng, Zhipeng
    Pan, Xinghao
    Lei, Jian
    Wang, Limin
    Ding, Dandan
    ELEVENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2019), 2020, 11373
  • [23] Efficient In-Loop Filtering Based on Enhanced Deep Convolutional Neural Networks for HEVC
    Pan, Zhaoqing
    Yi, Xiaokai
    Zhang, Yun
    Jeon, Byeungwoo
    Kwong, Sam
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 5352 - 5366
  • [24] CONTENT ADAPTIVE IN-LOOP DEPTH MAP FILTER FOR HEVC BASED 3DV CODING
    He, Jianqiang
    Ma, Siwei
    Zhang, Nan
    Gao, Wen
    2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 2011 - 2015
  • [25] Adaptive Deep Reinforcement Learning-Based In-Loop Filter for VVC
    Huang, Zhijie
    Sun, Jun
    Guo, Xiaopeng
    Shang, Mingyu
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 5439 - 5451
  • [26] A novel in-loop filtering mechanism of HEVC based on 3D sub-bands and CNN processing
    Dacheng Zhang
    Weimin Lei
    Wei Zhang
    Xinyi Chen
    Signal, Image and Video Processing, 2019, 13 : 1045 - 1053
  • [27] A novel in-loop filtering mechanism of HEVC based on 3D sub-bands and CNN processing
    Zhang, Dacheng
    Lei, Weimin
    Zhang, Wei
    Chen, Xinyi
    SIGNAL IMAGE AND VIDEO PROCESSING, 2019, 13 (06) : 1045 - 1053
  • [28] Performance-Complexity Analysis of Adaptive Loop Filter with a CNN-based Classification
    Lim, Wang-Q
    Stallenberger, Bjoern
    Pfaff, Jonathan
    Schwarz, Heiko
    Marpe, Detlev
    Wiegand, Thomas
    2022 PICTURE CODING SYMPOSIUM (PCS), 2022, : 91 - 95
  • [29] An In-loop Filter Based on Low-Complexity CNN Using Residuals in Intra Video Coding
    Li, Daowen
    Yu, Lu
    2019 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2019,
  • [30] An explicit self-attention-based multimodality CNN in-loop filter for versatile video coding
    Jia, Menghu
    Gao, Yanbo
    Li, Shuai
    Yue, Jian
    Ye, Mao
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (29) : 42497 - 42511