Live Demonstration: Neuromorphic Sensory Integration for Combining Sound Source Localization and Collision Avoidance

被引：0
|
作者：
Schoepe, Thorben [1 ,2 ]
Gutierrez-Galan, Daniel [3 ]
Dominguez-Morales, Juan Pedro [3 ]
Jimenez-Fernandez, Angel [3 ]
Linares-Barranco, Alejandro [3 ]
Chicca, Elisabetta [1 ,2 ]
机构：
[1] Bielefeld Univ, Fac Technol, Bielefeld, Germany
[2] Bielefeld Univ, Cognit Interact Technol Ctr Excellence CITEC, Bielefeld, Germany
[3] Univ Seville, Robot & Tech Comp Lab, Seville, Spain
来源：
2020 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS) | 2020年
关键词：
D O I：
暂无
中图分类号：
TM [电工技术]; TN [电子技术、通信技术];
学科分类号：
0808 ; 0809 ;
摘要：
The brain is able to solve complex tasks in real time by combining different sensory cues with previously acquired knowledge. Inspired by the brain, we designed a neuromorphic demonstrator which combines auditory and visual input to find an obstacle free direction closest to the sound source. The system consists of two event-based sensors (the eDVS for vision and the NAS for audition) mounted onto a pan-tilt unit and a spiking neural network implemented on the SpiNNaker platform. By combining the different sensory information, the demonstrator is able to point at a sound source direction while avoiding obstacles in real time.
引用
收藏
页数：1
相关论文
共 20 条
  • [1] Neuromorphic Sensory Integration for Combining Sound Source Localization and Collision Avoidance
    Schoepe, Thorben
    Gutierrez-Galan, Daniel
    Pedro Dominguez-Morales, Juan
    Jimenez-Fernandez, Angel
    Linares-Barranco, Alejandro
    Chicca, Elisabetta
    2019 IEEE BIOMEDICAL CIRCUITS AND SYSTEMS CONFERENCE (BIOCAS 2019), 2019,
  • [2] SENSORY INTEGRATION IN THE CEREBELLUM AND RELATED STRUCTURES DURING SOUND SOURCE LOCALIZATION
    ALTMAN, JA
    BEKHTEREV, NN
    INTERNATIONAL JOURNAL OF NEUROSCIENCE, 1984, 22 (3-4) : 205 - 206
  • [3] Closed-loop sound source localization in neuromorphic systems
    Schoepe, Thorben
    Gutierrez-Galan, Daniel
    Dominguez-Morales, Juan P.
    Greatorex, Hugh
    Jimenez-Fernandez, Angel
    Linares-Barranco, Alejandro
    Chicca, Elisabetta
    NEUROMORPHIC COMPUTING AND ENGINEERING, 2023, 3 (02):
  • [4] Live Demonstration: A Low-power Neuromorphic System for Retinal Implants and Sensory Substitution
    Gaspar, Nora
    Sondhi, Anish
    Evans, Benjamin
    Nikolic, Konstantin
    2015 IEEE BIOMEDICAL CIRCUITS AND SYSTEMS CONFERENCE (BIOCAS), 2015, : 178 - 178
  • [5] A Bio-Inspired Model of Sound Source Localization on Neuromorphic Hardware
    Oess, Timo
    Loehr, Maximilian
    Jarvers, Christian
    Schmid, Daniel
    Neumann, Heiko
    2020 2ND IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS 2020), 2020, : 103 - 107
  • [6] Listen to the Brain-Auditory Sound Source Localization in Neuromorphic Computing Architectures
    Schmid, Daniel
    Oess, Timo
    Neumann, Heiko
    SENSORS, 2023, 23 (09)
  • [7] A Review of Neuromorphic Sound Source Localization and Echolocation-Based Navigation Systems
    Dalmas, Eugenie
    Danneville, Francois
    Elbahhar, Fouzia
    Bocquet, Michael
    Loyez, Christophe
    ELECTRONICS, 2024, 13 (24):
  • [8] Live Demonstration: Real-time neuro-inspired sound source localization and tracking architecture applied to a robotic platform
    Perez-Pena, F.
    Cerezuela-Escudero, E.
    Jimenez-Fernandez, Angel
    Morgado-Estevez, Arturo
    2018 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2018,
  • [9] DEVELOPMENT OF THE SOURCE RECONSTRUCTION SYSTEM BY COMBINING SOUND SOURCE LOCALIZATION AND TIME REVERSAL METHOD
    Lin, S. -C.
    Too, G. -P.
    Tu, C. -W.
    JOURNAL OF MECHANICS, 2018, 34 (01) : 35 - 40
  • [10] Integration of Sound Source Localization and Separation to Improve Dialogue Management on a Robot
    Frechette, Maxime
    Letourneau, Dominic
    Valin, Jean-Marc
    Michaud, Francois
    2012 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2012, : 2358 - 2363
12