Inter-subband redundancy prediction using neural network for video coding

被引:0
|
作者
Lee, I [1 ]
Guan, L
机构
[1] Univ Sydney, Sch Elec & Info Eng, Sydney, NSW 2006, Australia
[2] Ryerson Polytech Inst, Dept Elect & Comp Engn, Toronto, ON M5B 2K3, Canada
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
High performance video codec is mandatory for multimedia applications such as video-on-demand and video conferencing. Recent research has proposed numerous video coding techniques to meet the requirement in bandwidth, delay, loss and Quality-of-Service (QoS). In this paper, we present our investigations on inter-subband self-similarity within the wavelet-decomposed video frames using neural networks, and study the performance of applying the spatial network model to all video frames over time. The goal of our proposed method is to restore the highest perceptual quality for video transmitted over a highly congested network. Our contributions in this paper are: (1) A new coding model with neural network based, inter-subband redundancy (ISR) prediction for video coding using wavelet (2) The performance of 1D and 2D ISR prediction, including multiple levels of wavelet decompositions. Our result shows a short-term quality enhancement may be obtained using both 1D and 2D ISR prediction.
引用
收藏
页码:518 / 525
页数:8
相关论文
共 50 条
  • [1] Inter-subband correlation for predictive pyramid coding
    Kuo, CJ
    Lee, CL
    JOURNAL OF INFORMATION SCIENCE AND ENGINEERING, 2001, 17 (05) : 779 - 786
  • [2] Neural Network-Based Enhancement to Inter Prediction for Video Coding
    Wang, Yang
    Fan, Xiaopeng
    Xiong, Ruiqin
    Zhao, Debin
    Gao, Wen
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (02) : 826 - 838
  • [3] INTRA-INTER PREDICTION FOR VERSATILE VIDEO CODING USING A RESIDUAL CONVOLUTIONAL NEURAL NETWORK
    Merkle, Philipp
    Winken, Martin
    Pfaff, Jonathan
    Schwarz, Heiko
    Marpe, Detlev
    Wiegand, Thomas
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 1711 - 1715
  • [4] Spatio-Temporal Convolutional Neural Network for Enhanced Inter Prediction in Video Coding
    Merkle, Philipp
    Winken, Martin
    Pfaff, Jonathan
    Schwarz, Heiko
    Marpe, Detlev
    Wiegand, Thomas
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 4738 - 4752
  • [5] Robust subband video coding with leaky prediction
    Fuldseth, A
    Ramstad, TA
    1996 IEEE DIGITAL SIGNAL PROCESSING WORKSHOP, PROCEEDINGS, 1996, : 57 - 60
  • [6] Image resolution enhancement using inter-subband correlation in wavelet domain
    Piao, Yinji
    Shin, Il-hong
    Park, Hyun Wook
    2007 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-7, 2007, : 445 - 448
  • [7] Neural network based intra prediction for video coding
    Pfaff, J.
    Helle, P.
    Maniry, D.
    Kaltenstadler, S.
    Samek, W.
    Schwarz, H.
    Marpe, D.
    Wiegand, T.
    APPLICATIONS OF DIGITAL IMAGE PROCESSING XLI, 2018, 10752
  • [8] Adaptive Redundancy Scheme For Scalable Video Traffic Using Network Coding
    Baccouch, Hana
    Ageneau, Paul-Louis
    Boukhatem, Nadia
    2016 7TH INTERNATIONAL CONFERENCE ON THE NETWORK OF THE FUTURE (NOF), 2016,
  • [9] INTER PREDICTION USING LAPPED TRANSFORMS FOR ADVANCED VIDEO CODING
    de Oliveira, Rafael Galvao
    Pesquet-Popescu, Beatrice
    Trocan, Maria
    2011 18TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2011,
  • [10] Enhanced Intra Prediction with Recurrent Neural Network in Video Coding
    Hu, Yueyu
    Yang, Wenhan
    Xia, Sifeng
    Cheng, Wen-Huang
    Liu, Jiaying
    2018 DATA COMPRESSION CONFERENCE (DCC 2018), 2018, : 413 - 413