Event-based Extraction of Navigation Features from Unsupervised Learning of Optic Flow Patterns

被引:1
|
作者
Fricker, Paul [1 ,2 ]
Chauhan, Tushar [1 ]
Hurter, Christophe [2 ]
Cottereau, Benoit [1 ]
机构
[1] CNRS, Ctr Rech Cerveau & Cognit, UMR5549, Toulouse, France
[2] Ecole Natl Aviat Civile, Toulouse, France
关键词
Optic Flow; Spiking Neural Network; Unsupervised Learning; STDP; VISION SENSORS; SPIKE; NEURONS; POWER;
D O I
10.5220/0010836200003124
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We developed a Spiking Neural Network composed of two layers that processes event-based data captured by a dynamic vision sensor during navigation conditions. The training of the network was performed using a biologically plausible and unsupervised learning rule, Spike-Timing-Dependent Plasticity. With such an approach, neurons in the network naturally become selective to different components of optic flow, and a simple classifier is able to predict self-motion properties from the neural population output spiking activity. Our network has a simple architecture and a restricted number of neurons. Therefore, it is easy to implement on a neuromorphic chip and could be used for embedded applications necessitating low energy consumption.
引用
收藏
页码:702 / 710
页数:9
相关论文
共 50 条
  • [21] A Timescale Invariant STDP-Based Spiking Deep Network for Unsupervised Online Feature Extraction from Event-Based Sensor Data
    Thiele, Johannes C.
    Bichler, Olivier
    Dupret, Antoine
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [22] On event-based optical flow detection
    Brosch, Tobias
    Tschechne, Stephan
    Neumann, Heiko
    FRONTIERS IN NEUROSCIENCE, 2015, 9
  • [23] Secrets of Event-Based Optical Flow
    Shiba, Shintaro
    Aoki, Yoshimitsu
    Gallego, Guillermo
    COMPUTER VISION - ECCV 2022, PT XVIII, 2022, 13678 : 628 - 645
  • [24] Investigation of Event-Based Surfaces for High-Speed Detection, Unsupervised Feature Extraction, and Object Recognition
    Afshar, Saeed
    Hamilton, Tara Julia
    Tapson, Jonathan
    van Schaik, Andre
    Cohen, Gregory
    FRONTIERS IN NEUROSCIENCE, 2019, 12
  • [25] Unsupervised Learning of Event-Based Image Recordings using Spike-Timing-Dependent Plasticity
    Iyer, Laxmi R.
    Basu, Arindam
    2017 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2017, : 1840 - 1846
  • [26] Unsupervised Domain Adaptation for Training Event-Based Networks Using Contrastive Learning and Uncorrelated Conditioning
    Jian, Dayuan
    Rostami, Mohammad
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 18675 - 18685
  • [27] Learning Parse-Free Event-Based Features for Textual Entailment Recognition
    Ofoghi, Bahadorreza
    Yearwood, John
    AI 2010: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2010, 6464 : 184 - 193
  • [28] Learning Event-Based Motion Deblurring
    Jiang, Zhe
    Zhang, Yu
    Zou, Dongqing
    Ren, Jimmy
    Lv, Jiancheng
    Liu, Yebin
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 3317 - 3326
  • [29] A Survey on Event-Based News Narrative Extraction
    Norambuena, Brian Felipe Keith
    Mitra, Tanushree
    North, Chris
    ACM COMPUTING SURVEYS, 2023, 55 (14S)
  • [30] Event-based stochastic learning and optimization
    Cao, Xi-Ren
    WODES 2006: Eighth International Workshop on Discrete Event Systems, Proceedings, 2006, : 398 - 398