A Motion-Based Feature for Event-Based Pattern Recognition

被引:38
|
作者
Clady, Xavier [1 ]
Maro, Jean-Matthieu [1 ]
Barre, Sebastien [1 ]
Benosman, Ryad B. [1 ]
机构
[1] UPMC Univ Paris 06, CNRS, INSERM, Inst Vis,Sorbonne Univ, Paris, France
基金
欧盟地平线“2020”;
关键词
neuromorphic sensor; event-driven vision; pattern recognition; motion-based feature; speed-tuned integration time; histogram of oriented optical flow; corner detection; gesture recognition; INTEREST POINT DETECTORS; IMAGE CORNER DETECTION; FUNCTIONAL ARCHITECTURE; PERFORMANCE EVALUATION; COMPACT APPROXIMATION; 3D RECONSTRUCTION; SELECTIVE NEURONS; RECEPTIVE-FIELDS; DRIVEN; DESCRIPTORS;
D O I
10.3389/fnins.2016.00594
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
This paper introduces an event-based luminance-free feature from the output of asynchronous event-based neuromorphic retinas. The feature consists in mapping the distribution of the optical flow along the contours of the moving objects in the visual scene into a matrix. Asynchronous event-based neuromorphic retinas are composed of autonomouspixels, each of them asynchronously generating "spiking" events that encode relative changes in pixels' illumination at high temporal resolutions. The optical flow is computed at each event, and is integrated locally or globally in a speed and direction coordinate frame based grid, using speed-tuned temporal kernels. The latter ensures that the resulting feature equitably represents the distribution of the normal motion along the current moving edges, whatever their respective dynamics. The usefulness and the generality of the proposed feature are demonstrated in pattern recognition applications: local corner detection and global gesture recognition.
引用
收藏
页数:20
相关论文
共 50 条
  • [31] Motion-Based Gesture Recognition Algorithms for Robot Manipulation
    Marasovic, Tea
    Papic, Vladan
    Marasovic, Jadranka
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2015, 12
  • [32] Classifying Airborne Targets With Motion-Based Recognition Techniques
    Androulakakis, Pavlos
    2024 IEEE AEROSPACE CONFERENCE, 2024,
  • [33] Motion-based pedestrian recognition from a moving vehicle
    Fardi, Basel
    Seifert, Ingmar
    Wanielik, Gerd
    Gayko, Jens
    2006 IEEE INTELLIGENT VEHICLES SYMPOSIUM, 2006, : 219 - +
  • [34] Feature Representation and Compression Methods for Event-Based Data
    Wang, Conghe
    Wang, Xia
    Yan, Changda
    Ma, Kai
    IEEE SENSORS JOURNAL, 2023, 23 (05) : 5109 - 5123
  • [35] Motion-based motion deblurring
    Ben-Ezra, M
    Nayar, SK
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2004, 26 (06) : 689 - 698
  • [36] Motion-based segmentation scheme to feature extraction of hand gestures
    Zhu, YX
    Huang, Y
    Xu, GY
    Yu, CH
    INTERNATIONAL SYMPOSIUM ON MULTISPECTRAL IMAGE PROCESSING, 1998, 3545 : 228 - 231
  • [37] Sequential pattern analysis for event-based intrusion detection
    Nisha T.N.
    Pramod D.
    International Journal of Information and Computer Security, 2019, 11 (4-5) : 476 - 492
  • [38] Motion and Structure from Event-Based Normal Flow
    Ren, Zhongyang
    Liao, Bangyan
    Kong, Delei
    Li, Jinghang
    Liu, Peidong
    Kneip, Laurent
    Gallego, Guillermo
    Zhou, Yi
    COMPUTER VISION - ECCV 2024, PT LVI, 2025, 15114 : 108 - 125
  • [39] Event-based motion segmentation of small objects in the wild
    Sun, Zhezheng
    Hou, Chuantong
    Wang, Longguang
    Deng, Xinpu
    Li, Miao
    ELECTRONICS LETTERS, 2022, 58 (19) : 726 - 728
  • [40] Representing Motion Information from Event-Based Cameras
    Sullivan, Keith
    Lawson, Wallace
    2017 26TH IEEE INTERNATIONAL SYMPOSIUM ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION (RO-MAN), 2017, : 1465 - 1470