DeblurSR: Event-Based Motion Deblurring under the Spiking Representation

被引:0
|
作者
Song, Chen [1 ]
Bajaj, Chandrajit [1 ]
Huang, Qixing [1 ]
机构
[1] Univ Texas Austin, Austin, TX 78712 USA
关键词
NETWORKS;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present DeblurSR, a novel motion deblurring approach that converts a blurry image into a sharp video. DeblurSR utilizes event data to compensate for motion ambiguities and exploits the spiking representation to parameterize the sharp output video as a mapping from time to intensity. Our key contribution, the Spiking Representation (SR), is inspired by the neuromorphic principles determining how biological neurons communicate with each other in living organisms. We discuss why the spikes can represent sharp edges and how the spiking parameters are interpreted from the neuromorphic perspective. DeblurSR has higher output quality and requires fewer computing resources than state-of-the-art event-based motion deblurring methods. We additionally show that our approach easily extends to video super-resolution when combined with recent advances in implicit neural representation.
引用
收藏
页码:4900 / 4908
页数:9
相关论文
共 50 条
  • [41] Optical flow estimation from event-based cameras and spiking neural networks
    Cuadrado, Javier
    Rancon, Ulysse
    Cottereau, Benoit R.
    Barranco, Francisco
    Masquelier, Timothee
    [J]. FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [42] Towards Asynchronously Triggered Spiking Neural Network on FPGA for Event-based Vision
    Wu, Zhenyu
    Song, Mo
    So, Hayden Kwok-Hay
    [J]. 2023 INTERNATIONAL CONFERENCE ON FIELD PROGRAMMABLE TECHNOLOGY, ICFPT, 2023, : 292 - 293
  • [43] TactileSGNet: A Spiking Graph Neural Network for Event-based Tactile Object Recognition
    Gu, Fuqiang
    Sng, Weicong
    Taunyazov, Tasbolat
    Soh, Harold
    [J]. 2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 9876 - 9882
  • [44] Event-based backpropagation can compute exact gradients for spiking neural networks
    Wunderlich, Timo C.
    Pehle, Christian
    [J]. SCIENTIFIC REPORTS, 2021, 11 (01)
  • [45] Movement Classification and Segmentation Using Event-Based Sensing and Spiking Neural Networks
    Kirkland, Paul
    Di Caterina, Gaetano
    [J]. 2022 SENSOR SIGNAL PROCESSING FOR DEFENCE CONFERENCE, SSPD, 2022, : 51 - 55
  • [46] On the Event-based Attack-tolerant Control: A Polytopic Representation
    Bezzaoucha Rebai, Souad
    Voos, Holger
    [J]. PROCEEDINGS OF 2019 3RD INTERNATIONAL CONFERENCE ON AUTOMATION, CONTROL AND ROBOTS (ICACR 2019), 2018, : 37 - 43
  • [47] Learning Adaptive Parameter Representation for Event-Based Video Reconstruction
    Gu, Daxin
    Li, Jia
    Zhu, Lin
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 1950 - 1954
  • [48] Climbing neuronal activity as an event-based cortical representation of time
    Reutimann, J
    Yakovlev, V
    Fusi, S
    Senn, W
    [J]. JOURNAL OF NEUROSCIENCE, 2004, 24 (13): : 3295 - 3303
  • [49] Event-LSTM: An Unsupervised and Asynchronous Learning-Based Representation for Event-Based Data
    Annamalai, Lakshmi
    Ramanathan, Vignesh
    Thakur, Chetan Singh
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02): : 4678 - 4685
  • [50] Event-based segmentation of sports video using motion entropy
    Chen, Chen-Yu
    Wang, Jia-Ching
    Wang, Jhing-Fa
    Hu, Yu-Hen
    [J]. ISM 2007: NINTH IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA, PROCEEDINGS, 2007, : 107 - +