Event-based Extraction of Navigation Features from Unsupervised Learning of Optic Flow Patterns

被引:1
|
作者
Fricker, Paul [1 ,2 ]
Chauhan, Tushar [1 ]
Hurter, Christophe [2 ]
Cottereau, Benoit [1 ]
机构
[1] CNRS, Ctr Rech Cerveau & Cognit, UMR5549, Toulouse, France
[2] Ecole Natl Aviat Civile, Toulouse, France
关键词
Optic Flow; Spiking Neural Network; Unsupervised Learning; STDP; VISION SENSORS; SPIKE; NEURONS; POWER;
D O I
10.5220/0010836200003124
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We developed a Spiking Neural Network composed of two layers that processes event-based data captured by a dynamic vision sensor during navigation conditions. The training of the network was performed using a biologically plausible and unsupervised learning rule, Spike-Timing-Dependent Plasticity. With such an approach, neurons in the network naturally become selective to different components of optic flow, and a simple classifier is able to predict self-motion properties from the neural population output spiking activity. Our network has a simple architecture and a restricted number of neurons. Therefore, it is easy to implement on a neuromorphic chip and could be used for embedded applications necessitating low energy consumption.
引用
收藏
页码:702 / 710
页数:9
相关论文
共 50 条
  • [1] Unsupervised Event-based Learning of Optical Flow, Depth, and Egomotion
    Zhu, Alex Zihao
    Yuan, Liangzhe
    Chaney, Kenneth
    Daniilidis, Kostas
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 989 - 997
  • [2] Live Demonstration: Unsupervised Event-based Learning of Optical Flow, Depth and Egomotion
    Zhu, Alex Zihao
    Yuan, Liangzhe
    Chaney, Kenneth
    Daniilidis, Kostas
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 1694 - 1694
  • [3] Unsupervised Learning of Dense Optical Flow, Depth and Egomotion with Event-Based Sensors
    Ye, Chengxi
    Mitrokhin, Anton
    Fermuller, Cornelia
    Yorke, James A.
    Aloimonos, Yiannis
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 5831 - 5838
  • [4] Unsupervised Event-Based Optical Flow Using Motion Compensation
    Zhu, Alex Zihao
    Yuan, Liangzhe
    Chaney, Kenneth
    Daniilidis, Kostas
    COMPUTER VISION - ECCV 2018 WORKSHOPS, PT VI, 2019, 11134 : 711 - 714
  • [5] Event-LSTM: An Unsupervised and Asynchronous Learning-Based Representation for Event-Based Data
    Annamalai, Lakshmi
    Ramanathan, Vignesh
    Thakur, Chetan Singh
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02): : 4678 - 4685
  • [6] Event-Based, Timescale Invariant Unsupervised Online Deep Learning With STDP
    Thiele, Johannes C.
    Bichler, Olivier
    Dupret, Antoine
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2018, 12
  • [7] Unsupervised Learning of Spatio-Temporal Receptive Fields from an Event-Based Vision Sensor
    Barbier, Thomas
    Teuliere, Celine
    Triesch, Jochen
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2020, PT II, 2020, 12397 : 622 - 633
  • [8] Human Sperm Detection and Tracking using Event-based Cameras and Unsupervised Learning
    Sadak, Ferhat
    Gerena, Edison
    Dupont, Charlotte
    Levy, Rachel
    Haliyo, Sinan
    7TH INTERNATIONAL CONFERENCE ON MANIPULATION, AUTOMATION, AND ROBOTICS AT SMALL SCALES, MARSS 2024, 2024, : 49 - +
  • [9] Event-Based Visual Flow
    Benosman, Ryad
    Clercq, Charles
    Lagorce, Xavier
    Ieng, Sio-Hoi
    Bartolozzi, Chiara
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2014, 25 (02) : 407 - 417
  • [10] Time-series event-based prediction: An unsupervised learning framework based on genetic programming
    Kattan, Ahmed
    Fatima, Shaheen
    Arif, Muhammad
    INFORMATION SCIENCES, 2015, 301 : 99 - 123