A Motion-Based Feature for Event-Based Pattern Recognition

被引:38
|
作者
Clady, Xavier [1 ]
Maro, Jean-Matthieu [1 ]
Barre, Sebastien [1 ]
Benosman, Ryad B. [1 ]
机构
[1] UPMC Univ Paris 06, CNRS, INSERM, Inst Vis,Sorbonne Univ, Paris, France
基金
欧盟地平线“2020”;
关键词
neuromorphic sensor; event-driven vision; pattern recognition; motion-based feature; speed-tuned integration time; histogram of oriented optical flow; corner detection; gesture recognition; INTEREST POINT DETECTORS; IMAGE CORNER DETECTION; FUNCTIONAL ARCHITECTURE; PERFORMANCE EVALUATION; COMPACT APPROXIMATION; 3D RECONSTRUCTION; SELECTIVE NEURONS; RECEPTIVE-FIELDS; DRIVEN; DESCRIPTORS;
D O I
10.3389/fnins.2016.00594
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
This paper introduces an event-based luminance-free feature from the output of asynchronous event-based neuromorphic retinas. The feature consists in mapping the distribution of the optical flow along the contours of the moving objects in the visual scene into a matrix. Asynchronous event-based neuromorphic retinas are composed of autonomouspixels, each of them asynchronously generating "spiking" events that encode relative changes in pixels' illumination at high temporal resolutions. The optical flow is computed at each event, and is integrated locally or globally in a speed and direction coordinate frame based grid, using speed-tuned temporal kernels. The latter ensures that the resulting feature equitably represents the distribution of the normal motion along the current moving edges, whatever their respective dynamics. The usefulness and the generality of the proposed feature are demonstrated in pattern recognition applications: local corner detection and global gesture recognition.
引用
收藏
页数:20
相关论文
共 50 条
  • [21] Multi-feature based event recommendation in Event-Based Social Network
    Cao, Jiuxin
    Zhu, Ziqing
    Shi, Liang
    Liu, Bo
    Ma, Zhuo
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2018, 11 (01) : 618 - 633
  • [22] Multi-feature based event recommendation in Event-Based Social Network
    Jiuxin Cao
    Ziqing Zhu
    Liang Shi
    Bo Liu
    Zhuo Ma
    International Journal of Computational Intelligence Systems, 2018, 11 : 618 - 633
  • [23] MOTION-BASED FEATURE CLUSTERING FOR ARTICULATED BODY TRACKING
    Kuehne, Hildegard
    Woerner, Annika
    VISAPP 2009: PROCEEDINGS OF THE FOURTH INTERNATIONAL CONFERENCE ON COMPUTER VISION THEORY AND APPLICATIONS, VOL 1, 2009, : 579 - 584
  • [24] A Study of the Use of Iconic and Metaphoric Gestures with Motion-Based, Static Space-Based, Static Object-Based, and Static Event-Based Statements
    Khatin-Zadeh, Omid
    Farsani, Danyal
    Banaruee, Hassan
    BEHAVIORAL SCIENCES, 2022, 12 (07)
  • [25] An Eulerian Framework for Event-Based Pattern Verification
    Nachamkin, Jason E.
    Jin, Yi
    WEATHER AND FORECASTING, 2017, 32 (06) : 2027 - 2043
  • [26] In the Blink of an Eye: Event-based Emotion Recognition
    Zhang, Haiwei
    Zhang, Jiqing
    Dong, Bo
    Peers, Pieter
    Wu, Wenwei
    Wei, Xiaopeng
    Heide, Felix
    Yang, Xin
    PROCEEDINGS OF SIGGRAPH 2023 CONFERENCE PAPERS, SIGGRAPH 2023, 2023,
  • [27] Neuromorphic Event-based Face Identity Recognition
    Moreira, Goncalo
    Graca, Andre
    Silva, Bruno
    Martins, Pedro
    Batista, Jorge
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 922 - 929
  • [28] An Event-based Hierarchy Model for Object Recognition
    Nan, Ying
    Xiao, Rong
    Gao, Shaobing
    Yan, Rui
    2019 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2019), 2019, : 2342 - 2347
  • [29] Motion-based gesture recognition algorithms for robot manipulation
    Marasović, Tea
    Papić, Vladan
    Marasović, Jadranka
    International Journal of Advanced Robotic Systems, 2015, 12 (05)
  • [30] Motion-based gesture recognition algorithms for robot manipulation
    Marasović, Tea
    Papić, Vladan
    Marasović, Jadranka
    International Journal of Advanced Robotic Systems, 2015, 12