Global-Context Aggregated Intra Prediction Network for Depth Video Coding

被引:2
|
作者
Zhang, Jing [1 ]
Hou, Yonghong [1 ]
Peng, Bo [1 ]
Pan, Zhaoqing [1 ]
Li, Ge [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
关键词
3D-HEVC; depth intra prediction; transformerbased prediction; depth video coding; OPTIMIZATION;
D O I
10.1109/TCSII.2023.3259689
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The huge data volume of 3D video brings great challenges to the storage and deployment of existing multimedia systems. To reduce the redundancy of 3D video, this brief proposes a global-context aggregated intra prediction network (GCAIP-Net) to improve the performance of depth video coding. In contrast with previous studies only exploiting the local context in reference pixels, the proposed GCAIP-Net takes the advantage of the transformer to explore the global context for more accurate prediction. Specifically, a transformer-based prediction module is designed to generate predicted features by modeling long-range dependencies in the spatial domain. The proposed method is integrated into the 3D-HEVC reference software HTM16.2, and extensive experiments show that the proposed method achieves 3.62% BD-rate reduction compared with 3D-HEVC under all-intra configuration.
引用
收藏
页码:3159 / 3163
页数:5
相关论文
共 50 条
  • [1] Fast Depth Video Coding with Intra Prediction on VVC
    Wei, Hongan
    Zhou, Binqian
    Fang, Ying
    Xu, Yiwen
    Zhao, Tiesong
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2020, 14 (07): : 3018 - 3038
  • [2] Neural network based intra prediction for video coding
    Pfaff, J.
    Helle, P.
    Maniry, D.
    Kaltenstadler, S.
    Samek, W.
    Schwarz, H.
    Marpe, D.
    Wiegand, T.
    APPLICATIONS OF DIGITAL IMAGE PROCESSING XLI, 2018, 10752
  • [3] Depth Intra Skip Prediction for 3D Video Coding
    Oh, Kwan-Jung
    Lee, Jaejoon
    Park, Du-Sik
    2012 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2012,
  • [4] ADAPTIVE GEOMETRY-BASED INTRA PREDICTION FOR DEPTH VIDEO CODING
    Kang, Min-Koo
    Lee, Cheon
    Lee, Jin Young
    Ho, Yo-Sung
    2010 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME 2010), 2010, : 1230 - 1235
  • [5] INTRA PREDICTION USING FULLY CONNECTED NETWORK FOR VIDEO CODING
    Li, Jiahao
    Li, Bin
    Xu, Jizheng
    Xiong, Ruiqin
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 1 - 5
  • [6] Enhanced Intra Prediction with Recurrent Neural Network in Video Coding
    Hu, Yueyu
    Yang, Wenhan
    Xia, Sifeng
    Cheng, Wen-Huang
    Liu, Jiaying
    2018 DATA COMPRESSION CONFERENCE (DCC 2018), 2018, : 413 - 413
  • [7] Optimized Spatial Recurrent Network for Intra Prediction in Video Coding
    Hu, Yueyu
    Yang, Wenhan
    Xia, Sifeng
    Liu, Jiaying
    2018 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (IEEE VCIP), 2018,
  • [8] Deep region segmentation-based intra prediction for depth video coding
    Zhang, Jing
    Hou, Yonghong
    Zhang, Zhe
    Jin, Dengchao
    Zhang, Peihan
    Li, Ge
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (25) : 35953 - 35964
  • [9] Deep region segmentation-based intra prediction for depth video coding
    Jing Zhang
    Yonghong Hou
    Zhe Zhang
    Dengchao Jin
    Peihan Zhang
    Ge Li
    Multimedia Tools and Applications, 2022, 81 : 35953 - 35964
  • [10] Joint Intra Coding of Video and Depth Maps
    Klimaszewski, Krzysztof
    Wegner, Krzysztof
    Domanski, Marek
    INTERNATIONAL CONFERENCE ON SIGNALS AND ELECTRONIC SYSTEMS (ICSES '10): CONFERENCE PROCEEDINGS, 2010, : 111 - 114