A Motion-Based Feature for Event-Based Pattern Recognition

被引:38
|
作者
Clady, Xavier [1 ]
Maro, Jean-Matthieu [1 ]
Barre, Sebastien [1 ]
Benosman, Ryad B. [1 ]
机构
[1] UPMC Univ Paris 06, CNRS, INSERM, Inst Vis,Sorbonne Univ, Paris, France
基金
欧盟地平线“2020”;
关键词
neuromorphic sensor; event-driven vision; pattern recognition; motion-based feature; speed-tuned integration time; histogram of oriented optical flow; corner detection; gesture recognition; INTEREST POINT DETECTORS; IMAGE CORNER DETECTION; FUNCTIONAL ARCHITECTURE; PERFORMANCE EVALUATION; COMPACT APPROXIMATION; 3D RECONSTRUCTION; SELECTIVE NEURONS; RECEPTIVE-FIELDS; DRIVEN; DESCRIPTORS;
D O I
10.3389/fnins.2016.00594
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
This paper introduces an event-based luminance-free feature from the output of asynchronous event-based neuromorphic retinas. The feature consists in mapping the distribution of the optical flow along the contours of the moving objects in the visual scene into a matrix. Asynchronous event-based neuromorphic retinas are composed of autonomouspixels, each of them asynchronously generating "spiking" events that encode relative changes in pixels' illumination at high temporal resolutions. The optical flow is computed at each event, and is integrated locally or globally in a speed and direction coordinate frame based grid, using speed-tuned temporal kernels. The latter ensures that the resulting feature equitably represents the distribution of the normal motion along the current moving edges, whatever their respective dynamics. The usefulness and the generality of the proposed feature are demonstrated in pattern recognition applications: local corner detection and global gesture recognition.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] An event-based motion scene feature extraction framework
    Liu, Zhaoxin
    Wu, Jinjian
    Shi, Guangming
    Yang, Wen
    Ma, Jupo
    PATTERN RECOGNITION, 2025, 161
  • [2] MOTION-BASED RECOGNITION - A SURVEY
    CEDRAS, C
    SHAH, M
    IMAGE AND VISION COMPUTING, 1995, 13 (02) : 129 - 155
  • [3] Motion-based recognition of pedestrians
    Heisele, B
    Wohler, C
    FOURTEENTH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOLS 1 AND 2, 1998, : 1325 - 1330
  • [4] Event-Based Motion Magnification
    Chen, Yutian
    Guo, Shi
    Yu, Fangzheng
    Zhang, Feng
    Gu, Jinwei
    Xue, Tianfan
    COMPUTER VISION - ECCV 2024, PT LVIII, 2025, 15116 : 428 - 444
  • [5] Incremental motion-based location recognition
    Lee, SW
    Mase, K
    FIFTH INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, PROCEEDINGS, 2001, : 123 - 130
  • [6] Event-Based Motion Segmentation by Motion Compensation
    Stoffregen, Timo
    Gallego, Guillermo
    Drummond, Tom
    Kleeman, Lindsay
    Scaramuzza, Davide
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 7243 - 7252
  • [7] Neuromorphic event-based recognition boosted by motion-aware learning
    Liu, Yuhan
    Deng, Yongjian
    Xie, Bochen
    Liu, Hai
    Yang, Zhen
    Li, Youfu
    NEUROCOMPUTING, 2025, 630
  • [8] HOTS: A Hierarchy of Event-Based Time-Surfaces for Pattern Recognition
    Lagorce, Xavier
    Orchard, Garrick
    Galluppi, Francesco
    Shi, Bertram E.
    Benosman, Ryad B.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (07) : 1346 - 1359
  • [9] Establishing motion-based feature point correspondence
    Mehrotra, R
    PATTERN RECOGNITION, 1998, 31 (01) : 23 - 30
  • [10] Establishing motion-based feature point correspondence
    Eastman Kodak Co, Rochester, United States
    Pattern Recognit, 1 (23-30):