RETINA-INSPIRED SPATIO-TEMPORAL FILTERING FOR DYNAMIC VIDEO CODING

被引:0
|
作者
Doutsi, Effrosyni [1 ,2 ]
Antonini, Marc [1 ]
Tsakalides, Panagiotis [2 ]
机构
[1] Univ Cote dAzur, CNRS, I3S, Nice, France
[2] FORTH, Inst Comp Sci, Iraklion, Greece
关键词
Center-surround filter; dynamic transform; video compression; retina; neuro-inspired filtering; perception-based processing; IMAGE;
D O I
10.1109/ICIP46576.2022.9897355
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The goal of this work is to propose a simple yet efficient way to dynamically transform a sequence of images according to the functional properties of the visual system. To achieve this goal, we extend to video sequences the Retina-Inspired Filter (RIF), which we have recently proposed for still images. Under the assumption that the input signal remains constant for a given time, the RIF decomposition was proven to be invertible, meaning that the image could be perfectly recovered. In this paper, we relax this assumption into a piece-wise constant input and we prove that RIF can be applied to a Group Of Pictures (GOP). Under the condition that a GOP consists of frames without strong pixel motion, we mathematically prove and experimentally show that when RIF is applied to GOP, whatever the size of the GOP is, we are still able to perfectly recover the video frames and at the same time simplify the complexity of the whole process. In addition, we show that while the GOP size increases, the memory cost required to store this amount of frames is sufficiently reduced.
引用
收藏
页码:3321 / 3325
页数:5
相关论文
共 50 条
  • [31] Wyner-Ziv video coding with spatio-temporal side information
    Wang, Yangli
    Jeong, Jechang
    Wu, Chengke
    Xiao, Song
    2007 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-5, 2007, : 132 - +
  • [32] Dynamic Spatio-Temporal Modular Network for Video Question Answering
    Qian, Zi
    Wang, Xin
    Duan, Xuguang
    Chen, Hong
    Zhu, Wenwu
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 4466 - 4477
  • [33] A bio-inspired system for spatio-temporal recognition in static and video imagery
    Khosla, Deepak
    Moore, Christopher K.
    Chelian, Suhas
    INTELLIGENT COMPUTING: THEORY AND APPLICATIONS V, 2007, 6560
  • [34] Spatio-temporal filtering using wavelets
    M. D. Ruiz-Medina
    J. M. Angulo
    Stochastic Environmental Research and Risk Assessment, 2002, 16 : 241 - 266
  • [35] Beamforming using spatio-temporal filtering
    Liu, J
    Kim, K
    Insana, MF
    Brunke, S
    2005 IEEE ULTRASONICS SYMPOSIUM, VOLS 1-4, 2005, : 1216 - 1219
  • [36] Spatio-temporal filtering using wavelets
    Ruiz-Medina, MD
    Angulo, JM
    STOCHASTIC ENVIRONMENTAL RESEARCH AND RISK ASSESSMENT, 2002, 16 (04) : 241 - 266
  • [37] Dynamic Saliency Model Inspired by Middle Temporal Visual Area: A Spatio-Temporal Perspective
    Mahmood, Hassan
    Gilani, Syed Omer
    Islam, Syed Mohammed Shamsul
    Ayaz, Yasar
    2018 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA), 2018, : 324 - 331
  • [38] The Study on Video Enhancement in the Low-Light Environment by Spatio-Temporal Filtering
    Chen, Tsong-Yi
    Chen, Thou-Ho
    Su, Che-Ping
    Chen, Yi-Jun
    ISDA 2008: EIGHTH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS DESIGN AND APPLICATIONS, VOL 3, PROCEEDINGS, 2008, : 561 - 564
  • [39] Adaptive and Recursive Based Spatio-Temporal Filtering for Video Denoising with RWT Transformation
    Shylaja, S. L.
    Kohir, Vinayadatta V.
    2015 ANNUAL IEEE INDIA CONFERENCE (INDICON), 2015,
  • [40] Spatio-temporal coding for wireless communications
    Raleigh, GG
    Cioffi, JM
    IEEE GLOBECOM 1996 - CONFERENCE RECORD, VOLS 1-3: COMMUNICATIONS: THE KEY TO GLOBAL PROSPERITY, 1996, : 1809 - 1814