Event-Based Attention and Tracking on Neuromorphic Hardware

被引:0
|
作者
Renner, Alpha [1 ,2 ]
Evanusa, Matthew [3 ]
Orchard, Garrick [4 ]
Sandamirskaya, Yulia [1 ,2 ]
机构
[1] UZH, Inst Neuroinformat, Zurich, Switzerland
[2] Swiss Fed Inst Technol, Zurich, Switzerland
[3] Univ Maryland, College Pk, MD 20742 USA
[4] Intel Labs, San Francisco Bay Area, CA USA
关键词
D O I
10.1109/aicas48895.2020.9073789
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a fully event-driven vision and processing system for selective attention and tracking implemented on Intel's neuromorphic research chip, Loihi, directly interfaced with an event-based Dynamic Vision Sensor, DAVIS. The attention mechanism is realized as a recurrent spiking neural network (SNN) that forms sustained activation-bump attractors. The network dynamics support object tracking when distractors are present and when the object slows down or stops.
引用
收藏
页码:132 / 132
页数:1
相关论文
共 50 条
  • [11] Toward Event-Based State Estimation for Neuromorphic Event Cameras
    Liu, Xinhui
    Cheng, Meiqi
    Shi, Dawei
    Shi, Ling
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (07) : 4281 - 4288
  • [12] A High-speed Event-based Object Tracking with Heterogeneous Computing Hardware
    Shi, Chenyang
    Jin, Jing
    Wei, Boyi
    Li, Yuzhen
    Li, Wenzhuo
    Liu, Hanxiao
    Zhang, Yibo
    Luo, Shaobo
    2022 IEEE ASIA PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS, APCCAS, 2022, : 394 - 399
  • [13] Encoding Event-Based Data With a Hybrid SNN Guided Variational Auto-encoder in Neuromorphic Hardware
    Stewart, Kenneth
    Danielescu, Andreea
    Shea, Timothy M.
    Neftci, Emre O.
    PROCEEDINGS OF THE 2022 ANNUAL NEURO-INSPIRED COMPUTATIONAL ELEMENTS CONFERENCE (NICE 2022), 2022, : 88 - 97
  • [14] Neuromorphic vision: From sensors to event-based algorithms
    Lakshmi, Annamalai
    Chakraborty, Anirban
    Thakur, Chetan S.
    WILEY INTERDISCIPLINARY REVIEWS-DATA MINING AND KNOWLEDGE DISCOVERY, 2019, 9 (04)
  • [15] Digital Image Correlation with a Neuromorphic Event-Based Imager
    Meyerhofer, Peter
    Green, Andre
    Cattaneo, Alessandro
    Mascarenas, David
    ROTATING MACHINERY, OPTICAL METHODS & SCANNING LDV METHODS, VOL 6, 2023, : 73 - 79
  • [16] Neuromorphic Event-Based Generalized Time-Based Stereovision
    Ieng, Sio-Hoi
    Carneiro, Joao
    Osswald, Marc
    Benosman, Ryad
    FRONTIERS IN NEUROSCIENCE, 2018, 12
  • [17] EvAn: Neuromorphic Event-Based Sparse Anomaly Detection
    Annamalai, Lakshmi
    Chakraborty, Anirban
    Thakur, Chetan Singh
    FRONTIERS IN NEUROSCIENCE, 2021, 15
  • [18] Event-based tracking of human hands
    Duarte, Laura
    Safeea, Mohammad
    Neto, Pedro
    SENSOR REVIEW, 2021, 41 (04) : 382 - 389
  • [19] Event-based tracking evaluation metric
    Roth, D.
    Koller-Meier, E.
    Rowe, D.
    Moeslund, T. B.
    Van Gool, L.
    2008 IEEE WORKSHOP ON MOTION AND VIDEO COMPUTING, 2008, : 45 - +
  • [20] Neuromorphic Event-Based 3D Pose Estimation
    Valeiras, David Reverter
    Orchard, Garrick
    Ieng, Sio-Hoi
    Benosman, Ryad B.
    FRONTIERS IN NEUROSCIENCE, 2016, 9