Event-Based Target Tracking Control for a Snake Robot Using a Dynamic Vision Sensor

被引:2
|
作者
Jiang, Zhuangyi [1 ]
Bing, Zhenshan [1 ]
Huang, Kai [2 ]
Chen, Guang [1 ]
Cheng, Long [1 ]
Knoll, Alois [1 ]
机构
[1] Tech Univ Munich, Dept Informat, Boltzmannstr 3, D-85748 Munich, Germany
[2] Sun Yat Sen Univ, Sch Data & Comp Sci, Guangzhou, Peoples R China
关键词
Target tracking; Spiking Neural Network; Dynamic Vision Sensor; Neuromorphic snake robot; Hough transform;
D O I
10.1007/978-3-319-70136-3_12
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Dynamic Vision Sensor (DVS) is a promising neuromorphic vision sensor for autonomous locomotion control of mobile robots, as the DVS acquires visual information by mimicking retina to sense and encode the world as neural signals. In this paper, we present an autonomous target detecting and tracking control approach for a snake-like robot with a monocular DVS. By using Hough transform based on the Spiking Neural Network (SNN), the target pole is detected as two parallel lines from the event-based visual input. Then a depth estimation method based on the pose and motion of the robot is proposed. Furthermore, by combining the periodic motion feature of the snake-like robot, an adaptive tracking method based on the estimated depth information is introduced. Experiments are conducted on a snake-like robot to demonstrate the practicality and accuracy of our proposed method to track a target pole dynamically with a monocular DVS.
引用
收藏
页码:111 / 121
页数:11
相关论文
共 50 条
  • [1] An Event-based Tracking Control Framework for Multirotor Aerial Vehicles using a Dynamic Vision Sensor and Neuromorphic Hardware
    Aspragkathos, Sotirios N.
    Ntouros, Evangelos
    Karras, George C.
    Linares-Barranco, B.
    Serrano-Gotarredona, T.
    Kyriakopoulos, Kostas J.
    [J]. 2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 6349 - 6355
  • [2] Toward real-time particle tracking using an event-based dynamic vision sensor
    Drazen, David
    Lichtsteiner, Patrick
    Hafliger, Philipp
    Delbrueck, Tobi
    Jensen, Atle
    [J]. EXPERIMENTS IN FLUIDS, 2011, 51 (05) : 1465 - 1469
  • [3] Toward real-time particle tracking using an event-based dynamic vision sensor
    David Drazen
    Patrick Lichtsteiner
    Philipp Häfliger
    Tobi Delbrück
    Atle Jensen
    [J]. Experiments in Fluids, 2011, 51
  • [4] Event-Based American Sign Language Recognition Using Dynamic Vision Sensor
    Wang, Yong
    Zhang, Xian
    Wang, Yanxiang
    Wang, Hongbin
    Huang, Chanying
    Shen, Yiran
    [J]. WIRELESS ALGORITHMS, SYSTEMS, AND APPLICATIONS, WASA 2021, PT III, 2021, 12939 : 3 - 10
  • [5] Dynamic Resolution Event-based Temporal Contrast Vision Sensor
    Guo, Heng
    Huang, Jing
    Guo, Menghan
    Chen, Shoushun
    [J]. 2016 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2016, : 1422 - 1425
  • [6] Low-Latency Line Tracking Using Event-Based Dynamic Vision Sensors
    Everding, Lukas
    Conradt, Joerg
    [J]. FRONTIERS IN NEUROROBOTICS, 2018, 12
  • [7] Vision based mobile robot control for target tracking
    Lee, SO
    Hwang-Bo, M
    You, BJ
    Oh, SR
    Cho, YJ
    [J]. MOBILE ROBOT TECHNOLOGY, PROCEEDINGS, 2001, : 75 - 80
  • [8] Event-based Image Processing using a Neuromorphic Vision Sensor
    Garcia Franco, Jesus Armando
    del Valle Padilla, Juan Luis
    Ortega Cisneros, Susana
    [J]. 2013 IEEE INTERNATIONAL AUTUMN MEETING ON POWER, ELECTRONICS AND COMPUTING (ROPEC), 2013,
  • [9] Machine Vision Using Combined Frame-based and Event-based Vision Sensor
    Leow, H. S.
    Nikolic, K.
    [J]. 2015 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2015, : 706 - 709
  • [10] Event-Based Pedestrian Detection Using Dynamic Vision Sensors
    Wan, Jixiang
    Xia, Ming
    Huang, Zunkai
    Tian, Li
    Zheng, Xiaoying
    Chang, Victor
    Zhu, Yongxin
    Wang, Hui
    [J]. ELECTRONICS, 2021, 10 (08)