Embedded Processing Pipeline Exploration For Neuromorphic Event Based Perceptual Systems

被引:0
|
作者
Sengupta, Jonah P. [1 ]
Villemur, Martin [2 ]
Pouliquen, Philippe O. [1 ]
Julian, Pedro [2 ]
Andreou, Andreas G. [1 ]
机构
[1] Johns Hopkins Univ, Dept Elect & Comp Engn, Baltimore, MD 21218 USA
[2] Silicon Austria Labs, Embedded Syst Div, Graz, Austria
关键词
event-based vision processing; embedded computing; neuromorphic hardware; FPGA SoC;
D O I
10.1109/ISCAS48785.2022.9937472
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Event-based vision cameras emulate the functionality of mamalian retina and promise to be a low-latency, energy efficient sensory front-end for machine perception. Despite the large-scale effort to deploy these sensors in a variety of scenarios, a proportionally small amount of effort has been devoted to the design and analysis of embedded architectures that process address events adjacent to the sensor. In this paper, a neuromorphic signal processing pipeline is reported which sparsifies the event stream thereby reducing energy consumption, increasing the signal-to-noise ratio, and improving downstream algorithm performance. It is integrated within a system-on-chip platform that will allow for the prototyping of different standards compliant, hardware modules within a embedded processing framework. We report two such modules which provides adaptive throughput management, spatiotemporal filtering, and programmable feature extraction.
引用
收藏
页码:486 / 490
页数:5
相关论文
共 50 条
  • [21] Design Exploration Methodology for Memristor-Based Spiking Neuromorphic Architectures with the Xnet Event-Driven Simulator
    Bichler, O.
    Roclin, D.
    Gamrat, C.
    Querlioz, D.
    PROCEEDINGS OF THE 2013 IEEE/ACM INTERNATIONAL SYMPOSIUM ON NANOSCALE ARCHITECTURES (NANOARCH), 2013, : 7 - 12
  • [22] Toward Event-Based State Estimation for Neuromorphic Event Cameras
    Liu, Xinhui
    Cheng, Meiqi
    Shi, Dawei
    Shi, Ling
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (07) : 4281 - 4288
  • [23] Design and implementation of video processing controller for pipeline robot based on embedded machine vision
    Song, Zenglu
    Yao, Jin
    Hao, Huadong
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (04): : 2707 - 2718
  • [24] Design and implementation of video processing controller for pipeline robot based on embedded machine vision
    Zenglu Song
    Jin Yao
    Huadong Hao
    Neural Computing and Applications, 2022, 34 : 2707 - 2718
  • [25] Neuromorphic Data Processing for Event-Driven Imagery for Acoustic Measurements
    Zheng, Kevin
    Sorensen, Jack
    DeVilliers, Celeste
    Cattaneo, Alessandro
    Moreu, Fernando
    Taylor, Gregory
    Mascarenas, David
    ROTATING MACHINERY, OPTICAL METHODS & SCANNING LDV METHODS, VOL 6, 2023, : 37 - 41
  • [26] Efficient data processing pipeline for event-based vision datasets: techniques and insights
    Aitsam, Muhammad
    Rodriguez, Alejandro Jimenez
    Di Nuovo, Alessandro
    ENGINEERING RESEARCH EXPRESS, 2024, 6 (04):
  • [27] An Extended Modular Processing Pipeline for Event-Based Vision in Automatic Visual Inspection
    Beck, Moritz
    Maier, Georg
    Flitter, Merle
    Gruna, Robin
    Laengle, Thomas
    Heizmann, Michael
    Beyerer, Juergen
    SENSORS, 2021, 21 (18)
  • [28] Efficient Energy Exploration for Embedded Systems
    Fan, Yang-Hsin
    Wu, Jan-Ou
    Wang, San-Fu
    18TH IEEE INTERNATIONAL SYMPOSIUM ON CONSUMER ELECTRONICS (ISCE 2014), 2014,
  • [29] Retargetable frameworks for embedded systems exploration
    Metrolho, Jose C.
    Silva, Carlos A.
    Couto, Carlos
    Tavares, Adriano
    2006 IEEE International Conference on Industrial Technology, Vols 1-6, 2006, : 2422 - 2426
  • [30] A sensitivity-based design space exploration methodology for embedded systems
    Fornaciari, W
    Sciuto, D
    Silvano, C
    Zaccaria, V
    DESIGN AUTOMATION FOR EMBEDDED SYSTEMS, 2002, 7 (1-2) : 7 - 32