Event-Based Attention and Tracking on Neuromorphic Hardware

被引：0
|
作者：
Renner, Alpha [1 ,2 ]
Evanusa, Matthew [3 ]
Orchard, Garrick [4 ]
Sandamirskaya, Yulia [1 ,2 ]
机构：
[1] UZH, Inst Neuroinformat, Zurich, Switzerland
[2] Swiss Fed Inst Technol, Zurich, Switzerland
[3] Univ Maryland, College Pk, MD 20742 USA
[4] Intel Labs, San Francisco Bay Area, CA USA
来源：
2020 2ND IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS 2020) | 2020年
关键词：
D O I：
10.1109/aicas48895.2020.9073789
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
We present a fully event-driven vision and processing system for selective attention and tracking implemented on Intel's neuromorphic research chip, Loihi, directly interfaced with an event-based Dynamic Vision Sensor, DAVIS. The attention mechanism is realized as a recurrent spiking neural network (SNN) that forms sustained activation-bump attractors. The network dynamics support object tracking when distractors are present and when the object slows down or stops.
引用
收藏
页码：132 / 132
页数：1
相关论文
共 50 条
  • [1] Event-based attention and tracking on neuromorphic hardware
    Renner, Alpha
    Evanusa, Matthew
    Sandamirskaya, Yulia
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 1709 - 1716
  • [2] Visual Tracking Using Neuromorphic Asynchronous Event-Based Cameras
    Ni, Zhenjiang
    Ieng, Sio-Hoi
    Posch, Christoph
    Regnier, Stephane
    Benosman, Ryad
    NEURAL COMPUTATION, 2015, 27 (04) : 925 - 953
  • [3] An Event-based Tracking Control Framework for Multirotor Aerial Vehicles using a Dynamic Vision Sensor and Neuromorphic Hardware
    Aspragkathos, Sotirios N.
    Ntouros, Evangelos
    Karras, George C.
    Linares-Barranco, B.
    Serrano-Gotarredona, T.
    Kyriakopoulos, Kostas J.
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 6349 - 6355
  • [4] Neuromorphic Event-Based Spatio-temporal Attention using Adaptive Mechanisms
    Gruel, Amelie
    Vitale, Antonio
    Martinet, Jean
    Magno, Michele
    2022 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS 2022): INTELLIGENT TECHNOLOGY IN THE POST-PANDEMIC ERA, 2022, : 379 - 382
  • [5] Event-Based Hand Detection on Neuromorphic Hardware Using a Sigma Delta Neural Network
    Azzalini, Loic
    Gluege, Stefan
    Struckmeier, Jens
    Sandamirskaya, Yulia
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING-ICANN 2024, PT X, 2024, 15025 : 353 - 364
  • [6] Event-based PID controller fully realized in neuromorphic hardware: a one DoF study
    Stagsted, Rasmus Karnoe
    Vitale, Antonio
    Renner, Alpha
    Larsen, Leon Bonde
    Christensen, Anders Lyhne
    Sandamirskaya, Yulia
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 10939 - 10944
  • [7] Neuromorphic Downsampling of Event-Based Camera Output
    Rizzo, Charles P.
    Schuman, Catherine D.
    Plank, James S.
    PROCEEDINGS OF THE 2023 ANNUAL NEURO-INSPIRED COMPUTATIONAL ELEMENTS CONFERENCE, NICE 2023, 2023, : 26 - 34
  • [8] Neuromorphic Event-based Face Identity Recognition
    Moreira, Goncalo
    Graca, Andre
    Silva, Bruno
    Martins, Pedro
    Batista, Jorge
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 922 - 929
  • [9] Neuromorphic Event-based Line Detection on SpiNNaker
    Gruel, Amelie
    Vincent, Adrien F.
    Martinet, Jean
    Saighi, Sylvain
    2024 IEEE 6TH INTERNATIONAL CONFERENCE ON AI CIRCUITS AND SYSTEMS, AICAS 2024, 2024, : 36 - 40
  • [10] ETLP: event-based three-factor local plasticity for online learning with neuromorphic hardware
    Quintana, Fernando M.
    Perez-Pena, Fernando
    Galindo, Pedro L.
    Neftci, Emre O.
    Chicca, Elisabetta
    Khacef, Lyes
    NEUROMORPHIC COMPUTING AND ENGINEERING, 2024, 4 (03):
12345