PARTITION TREE GUIDED PROGRESSIVE RETHINKING NETWORK FOR IN-LOOP FILTERING OF HEVC

被引:0
|
作者
Wang, Dezhao [1 ]
Xia, Sifeng [1 ]
Yang, Wenhan [1 ]
Hu, Yueyu [1 ]
Liu, Jiaying [1 ]
机构
[1] Peking Univ, Inst Comp Sci & Technol, Beijing, Peoples R China
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
In-Loop Filter; High Efficiency Video Coding (HEVC); Video Compression;
D O I
10.1109/icip.2019.8803253
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
In-Loop filter is a key part in High Efficiency Video Coding (HEVC) which effectively removes the compression artifacts. Recently, many newly proposed methods combine residual learning and dense connection to construct a deeper network for better in-loop filtering performance. However, the long-term dependency between blocks is neglected, and information usually passes between blocks only after dimension compression. To address these issues, we propose the Progressive Rethinking Block (PRB) to deliver long-term memory between the neighboring blocks and allow information to flow without compression, which is similar to human decision mechanism - usually reviewing the complete past memorized experiences to decide in the present, not just based on simple principles summarized before. PRBs further establish the Progressive Rethinking Network (PRN). In addition, we calculate the Multi-scale Mean value of Coding Units (MM-CU) to generate the side information maps which guide the training of the network by novelly telling the network architecture of the entire coding partition tree. Experimental results show that our proposed partition tree guided PRN provides 10.1% BD-rate reduction on average compared to the HEVC baseline.
引用
收藏
页码:2671 / 2675
页数:5
相关论文
共 32 条
  • [1] Offset-Based In-Loop Filtering With a Deep Network in HEVC
    Lee, So Yoon
    Yang, Yoonmo
    Kim, Dongsin
    Cho, Seunghyun
    Oh, Byung Tae
    [J]. IEEE ACCESS, 2020, 8 : 213958 - 213967
  • [2] Combining Progressive Rethinking and Collaborative Learning: A Deep Framework for In-Loop Filtering
    Wang, Dezhao
    Xia, Sifeng
    Yang, Wenhan
    Liu, Jiaying
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 4198 - 4211
  • [3] Dynamic convolutional capsule network for In-loop filtering in HEVC video codec
    Su, LiChao
    Cao, Mengqing
    Yu, Yue
    Chen, Jian
    Yang, XiuZhi
    Wu, Dapeng
    [J]. IET IMAGE PROCESSING, 2023, 17 (02) : 439 - 449
  • [4] Parallel In-Loop Filtering in HEVC Encoder on GPU
    Wang, Yang
    Guo, Xun
    Fan, Xiaopeng
    Lu, Yan
    Zhao, Debin
    Gao, Wen
    [J]. IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2018, 64 (03) : 276 - 284
  • [5] Complexity Reduction of In-Loop Filtering for Compressed Image Restoration in HEVC
    Miyazawa, Kazuyuki
    Murakami, Tokumichi
    Minezawa, Akira
    Sakate, Hiroharu
    [J]. 2012 PICTURE CODING SYMPOSIUM (PCS), 2012, : 413 - 416
  • [6] Residual Highway Convolutional Neural Networks for in-loop Filtering in HEVC
    Zhang, Yongbing
    Shen, Tao
    Ji, Xiangyang
    Zhang, Yun
    Xiong, Ruiqin
    Dai, Qionghai
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (08) : 3827 - 3841
  • [7] DEEP LEARNING BASED HEVC IN-LOOP FILTERING FOR DECODER QUALITY ENHANCEMENT
    Kuanar, Shiba
    Conly, Christopher
    Rao, K. R.
    [J]. 2018 PICTURE CODING SYMPOSIUM (PCS 2018), 2018, : 164 - 168
  • [8] Efficient In-Loop Filtering Based on Enhanced Deep Convolutional Neural Networks for HEVC
    Pan, Zhaoqing
    Yi, Xiaokai
    Zhang, Yun
    Jeon, Byeungwoo
    Kwong, Sam
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 5352 - 5366
  • [9] Multi-stage Attention Convolutional Neural Networks for HEVC In-Loop Filtering
    Lai, Peng-Ren
    Wang, Jia-Shung
    [J]. 2020 2ND IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS 2020), 2020, : 173 - 177
  • [10] A Novel Low Delay In-Loop Filtering WPP Process for Parallel HEVC Encoding
    Gu, Jiawen
    Han, Yuxing
    Wen, Jiangtao
    [J]. 2016 30TH ANNIVERSARY OF VISUAL COMMUNICATION AND IMAGE PROCESSING (VCIP), 2016,