A Color Event-Based Camera Emulator for Robot Vision

被引:0
|
作者
Bugueno-Cordova, Ignacio [1 ]
Campusano, Miguel [2 ]
Guaman-Rivera, Robert [1 ]
Verschae, Rodrigo [1 ]
机构
[1] Univ OHiggins, Inst Engn Sci, Rancagua, Chile
[2] Univ Southern Denmark, Odense, Denmark
关键词
Event-Based camera; Color vision; Asynchronous sensors; Robot vision; Emulator; Robot Operating System (ROS);
D O I
10.1007/978-3-031-59057-3_24
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Event-based cameras are becoming increasingly popular due to their asynchronous spatial-temporal information, high temporal resolution, power efficiency, and high dynamic range advantages. Despite these benefits, the adoption of these sensors has been hindered, mainly due to their high cost. While prices are decreasing and commercial options exist, researchers and developers face barriers to addressing the potential of event-based vision, especially with more specialized models. Although accurate event-based simulators and emulators exist, their primary limitation lies in their inability to operate in real-time and in that they are designed only for grey-scale video streams. This limitation creates a gap between theoretical exploration and practical application, hindering the seamless integration of event-based systems into real-world applications, especially in robotics. Moreover, the importance of color information is well recognized for many tasks, and most existing event-based cameras do not handle color information, except for a few exceptions. To address this challenge, we propose a ROS-based color event camera emulator to aid in reducing the gap between the real-world applicability of event-based color cameras by presenting its software design and implementation. Finally, we present a preliminary evaluation to demonstrate its performance.
引用
下载
收藏
页码:375 / 390
页数:16
相关论文
共 50 条
  • [1] Event-Based Vision: A Survey
    Gallego, Guillermo
    Delbruck, Tobi
    Orchard, Garrick Michael
    Bartolozzi, Chiara
    Taba, Brian
    Censi, Andrea
    Leutenegger, Stefan
    Davison, Andrew
    Conradt, Jorg
    Daniilidis, Kostas
    Scaramuzza, Davide
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (01) : 154 - 180
  • [2] Focusing an Event-Based Camera: Towards Spatiotemporal Characterization of Neuromorphic Vision Systems
    Burks, Stephen D.
    Sengupta, Jonah P.
    Haefner, David P.
    Lee, David K.
    INFRARED IMAGING SYSTEMS: DESIGN, ANALYSIS, MODELING, AND TESTING XXXV, 2024, 13045
  • [3] Event-Based Camera Tracker by deltNeRF
    Masuda, Mana
    Sekikawa, Yusuke
    Saito, Hideo
    IEEE ACCESS, 2023, 11 : 96626 - 96635
  • [4] Event-based Features for Robotic Vision
    Lagorce, Xavier
    Ieng, Sio-Hoi
    Benosman, Ryad
    2013 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2013, : 4214 - 4219
  • [5] Mobile robot guidance using adaptive event-based pose estimation and camera sensor
    Martinez-Rey, Miguel
    Espinosa, Felipe
    Gardel, Alfredo
    Santos, Carlos
    Santiso, Enrique
    2016 2ND INTERNATIONAL CONFERENCE ON EVENT-BASED CONTROL, COMMUNICATION, AND SIGNAL PROCESSING (EBCCSP), 2016,
  • [6] GET: Group Event Transformer for Event-Based Vision
    Peng, Yansong
    Zhang, Yueyi
    Xiong, Zhiwei
    Sun, Xiaoyan
    Wu, Feng
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 6015 - 6025
  • [7] Neuromorphic Downsampling of Event-Based Camera Output
    Rizzo, Charles P.
    Schuman, Catherine D.
    Plank, James S.
    PROCEEDINGS OF THE 2023 ANNUAL NEURO-INSPIRED COMPUTATIONAL ELEMENTS CONFERENCE, NICE 2023, 2023, : 26 - 34
  • [8] Event-Based Target Tracking Control for a Snake Robot Using a Dynamic Vision Sensor
    Jiang, Zhuangyi
    Bing, Zhenshan
    Huang, Kai
    Chen, Guang
    Cheng, Long
    Knoll, Alois
    NEURAL INFORMATION PROCESSING (ICONIP 2017), PT VI, 2017, 10639 : 111 - 121
  • [9] Object Tracking with a Fusion of Event-Based Camera and Frame-Based Camera
    Sun, Haixin
    Fremont, Vincent
    INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 2, 2023, 543 : 250 - 264
  • [10] Integrating Event Camera Sensor Emulator
    Freeman, Andrew C.
    Mayer-Patel, Ketan
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 4503 - 4505