Asynchronous Event-Based Fourier Analysis

被引:17
|
作者
Sabatier, Quentin [1 ,2 ,3 ,4 ]
Ieng, Sio-Hoi [1 ,2 ,3 ]
Benosman, Ryad [1 ,2 ,3 ]
机构
[1] UPMC Univ Paris 06, Sorbonne Univ, F-75252 Paris, France
[2] Inst Vis, UMR S 968, F-75012 Paris, France
[3] CNRS, UMR 7210, F-75012 Paris, France
[4] Gensight Biol, F-75012 Paris, France
关键词
Address event representation (AER); event-based processing; fast Fourier transform; neuromorphic vision; SIGNAL; PERFORMANCE; VISION; FFT;
D O I
10.1109/TIP.2017.2661702
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper introduces a method to compute the FFT of a visual scene at a high temporal precision of around 1-mu s output from an asynchronous event-based camera. Event-based cameras allow to go beyond the widespread and ingrained belief that acquiring series of images at some rate is a good way to capture visual motion. Each pixel adapts its own sampling rate to the visual input it receives and defines the timing of its own sampling points in response to its visual input by reacting to changes of the amount of incident light. As a consequence, the sampling process is no longer governed by a fixed timing source but by the signal to be sampled itself, or more precisely by the variations of the signal in the amplitude domain. Event-based cameras acquisition paradigm allows to go beyond the current conventional method to compute the FFT. The event-driven FFT algorithm relies on a heuristic methodology designed to operate directly on incoming gray level events to update incrementally the FFT while reducing both computation and data load. We show that for reasonable levels of approximations at equivalent frame rates beyond the millisecond, the method performs faster and more efficiently than conventional image acquisition. Several experiments are carried out on indoor and outdoor scenes where both conventional and event-driven FFT computation is shown and compared.
引用
收藏
页码:2192 / 2202
页数:11
相关论文
共 50 条
  • [21] Event-based analysis of video
    Zelnik-Manor, L
    Irani, M
    2001 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2001, : 123 - 130
  • [22] Event-LSTM: An Unsupervised and Asynchronous Learning-Based Representation for Event-Based Data
    Annamalai, Lakshmi
    Ramanathan, Vignesh
    Thakur, Chetan Singh
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02): : 4678 - 4685
  • [23] Event-Based Tone Mapping for Asynchronous Time-Based Image Sensor
    Chane, Camille Simon
    Ieng, Sio-Hoi
    Posch, Christoph
    Benosman, Ryad B.
    FRONTIERS IN NEUROSCIENCE, 2016, 10
  • [24] Asynchronous Bioplausible Neuron for Spiking Neural Networks for Event-Based Vision
    Kachole, Sanket
    Sajwani, Hussain
    Naeini, Fariborz Baghaei
    Makris, Dimitrios
    Zweiri, Yahya
    COMPUTER VISION - ECCV 2024, PT LXIV, 2025, 15122 : 399 - 415
  • [25] End-to-End Learning of Representations for Asynchronous Event-Based Data
    Gehrig, Daniel
    Loquercio, Antonio
    Derpanis, Konstantinos G.
    Scaramuzza, Davide
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 5632 - 5642
  • [26] Event-based asynchronous dissipative control for nonhomogeneous Markov jump systems
    Li, Hongchao
    Xu, Zhuo
    Zhou, Tianwei
    Liu, Yang
    TRANSACTIONS OF THE INSTITUTE OF MEASUREMENT AND CONTROL, 2024, 46 (03) : 430 - 441
  • [27] Event-based asynchronous HDR imaging by temporal incident light modulation
    Wu, Yuliang
    Tan, Ganchao
    Chen, Jinze
    Cao, Yang
    Zhai, Wei
    Zha, Zheng
    OPTICS EXPRESS, 2024, 32 (11): : 18527 - 18538
  • [28] EventAugment: Learning Augmentation Policies From Asynchronous Event-Based Data
    Gu, Fuqiang
    Dou, Jiarui
    Li, Mingyan
    Long, Xianlei
    Guo, Songtao
    Chen, Chao
    Liu, Kai
    Jiao, Xianlong
    Li, Ruiyuan
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2024, 16 (04) : 1521 - 1532
  • [29] UNIFORMLY MINIMUM VARIANCE UNBIASED ESTIMATION FOR ASYNCHRONOUS EVENT-BASED CAMERAS
    Fillatre, Lionel
    Antonini, Marc
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 4107 - 4111
  • [30] Asynchronous Event-Based Corner Detection Using Adaptive Time Threshold
    Li, Jinjian
    Su, Li
    Guo, Chuandong
    Wang, Xiangyu
    Hu, Quan
    IEEE SENSORS JOURNAL, 2023, 23 (09) : 9512 - 9522