Embedded Processing Pipeline Exploration For Neuromorphic Event Based Perceptual Systems

被引:0
|
作者
Sengupta, Jonah P. [1 ]
Villemur, Martin [2 ]
Pouliquen, Philippe O. [1 ]
Julian, Pedro [2 ]
Andreou, Andreas G. [1 ]
机构
[1] Johns Hopkins Univ, Dept Elect & Comp Engn, Baltimore, MD 21218 USA
[2] Silicon Austria Labs, Embedded Syst Div, Graz, Austria
关键词
event-based vision processing; embedded computing; neuromorphic hardware; FPGA SoC;
D O I
10.1109/ISCAS48785.2022.9937472
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Event-based vision cameras emulate the functionality of mamalian retina and promise to be a low-latency, energy efficient sensory front-end for machine perception. Despite the large-scale effort to deploy these sensors in a variety of scenarios, a proportionally small amount of effort has been devoted to the design and analysis of embedded architectures that process address events adjacent to the sensor. In this paper, a neuromorphic signal processing pipeline is reported which sparsifies the event stream thereby reducing energy consumption, increasing the signal-to-noise ratio, and improving downstream algorithm performance. It is integrated within a system-on-chip platform that will allow for the prototyping of different standards compliant, hardware modules within a embedded processing framework. We report two such modules which provides adaptive throughput management, spatiotemporal filtering, and programmable feature extraction.
引用
收藏
页码:486 / 490
页数:5
相关论文
共 50 条
  • [1] Embedded Processing Pipeline Exploration For Neuromorphic Event Based Perceptual Systems
    Sengupta, Jonah P.
    Villemur, Martin
    Pouliquen, Philippe O.
    Julian, Pedro
    Andreou, Andreas G.
    Proceedings - IEEE International Symposium on Circuits and Systems, 2022, 2022-May : 486 - 490
  • [2] EVENT-DRIVEN SIGNAL PROCESSING WITH NEUROMORPHIC COMPUTING SYSTEMS
    Blouw, Peter
    Eliasmith, Chris
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 8534 - 8538
  • [3] A neuromorphic cortical-layer microchip for spike-based event processing vision systems
    Serrano-Gotarredona, Rafael
    Serrano-Gotarredona, Teresa
    Acosta-Jimenez, Antonio
    Linares-Barranco, Bernabe
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2006, 53 (12) : 2548 - 2566
  • [4] Exploration of Multi-thread Processing on XILKERNEL for FPGA Based Embedded Systems
    Saha, Sangeet
    Chakrabarti, Amlan
    Ghosh, Ranjan
    19TH INTERNATIONAL CONFERENCE ON CONTROL SYSTEMS AND COMPUTER SCIENCE (CSCS 2013), 2013, : 58 - 65
  • [5] On-Chip Interface for Event based Sensor and Spiking Neuromorphic Processing
    Adnan, Md Musabbir
    Shawkat, Mst Shamim Ara
    Febbo, Rocco D.
    Rose, Garrett S.
    2022 IEEE 65TH INTERNATIONAL MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS (MWSCAS 2022), 2022,
  • [6] Event-based Image Processing using a Neuromorphic Vision Sensor
    Garcia Franco, Jesus Armando
    del Valle Padilla, Juan Luis
    Ortega Cisneros, Susana
    2013 IEEE INTERNATIONAL AUTUMN MEETING ON POWER, ELECTRONICS AND COMPUTING (ROPEC), 2013,
  • [7] Decision Making and Perceptual Bistability in Spike-Based Neuromorphic VLSI Systems
    Corradi, Federico
    You, Hongzhi
    Giulioni, Massimiliano
    Indiveri, Giacomo
    2015 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2015, : 2708 - 2711
  • [8] RetinoSim: an Event-based Data Synthesis Tool for Neuromorphic Vision Architecture Exploration
    Sengupta, Jonah P.
    Liu, Susan L.
    Andreou, Andreas G.
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON NEUROMORPHIC SYSTEMS 2022, ICONS 2022, 2022,
  • [9] Stakes of neuromorphic foveation: a promising future for embedded event cameras
    Gruel, Amelie
    Hareb, Dalia
    Grimaldi, Antoine
    Martinet, Jean
    Perrinet, Laurent
    Linares-Barranco, Bernabe
    Serrano-Gotarredona, Teresa
    BIOLOGICAL CYBERNETICS, 2023, 117 (4-5) : 389 - 406
  • [10] Stakes of neuromorphic foveation: a promising future for embedded event cameras
    Amélie Gruel
    Dalia Hareb
    Antoine Grimaldi
    Jean Martinet
    Laurent Perrinet
    Bernabé Linares-Barranco
    Teresa Serrano-Gotarredona
    Biological Cybernetics, 2023, 117 : 389 - 406