Powerline Tracking with Event Cameras

被引:14
|
作者
Dietsche, Alexander [1 ,2 ,3 ]
Cioffi, Giovanni [1 ,2 ,3 ]
Hidalgo-Carrio, Javier [1 ,2 ,3 ]
Scaramuzza, Davide [1 ,2 ,3 ]
机构
[1] Univ Zurich, Dept Informat, Robot & Percept Grp, Zurich, Switzerland
[2] Univ Zurich, Dept Neuroinformat, Zurich, Switzerland
[3] Swiss Fed Inst Technol, Zurich, Switzerland
基金
瑞士国家科学基金会;
关键词
D O I
10.1109/IROS51168.2021.9636824
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Autonomous inspection of powerlines with quadrotors is challenging. Flights require persistent perception to keep a close look at the lines. We propose a method that uses event cameras to robustly track powerlines. Event cameras are inherently robust to motion blur, have low latency, and high dynamic range. Such properties are advantageous for autonomous inspection of powerlines with drones, where fast motions and challenging illumination conditions are ordinary. Our method identifies lines in the stream of events by detecting planes in the spatio-temporal signal, and tracks them through time. The implementation runs onboard and is capable of detecting multiple distinct lines in real time with rates of up to 320 thousand events per second. The performance is evaluated in real-world flights along a powerline. The tracker is able to persistently track the powerlines, with a mean lifetime of the line 10x longer than existing approaches.
引用
收藏
页码:6990 / 6997
页数:8
相关论文
共 50 条
  • [1] Motion Segmentation and Tracking for Integrating Event Cameras
    Freeman, Andrew C.
    Burgess, Chris
    Mayer-Patel, Ketan
    MMSYS '21: PROCEEDINGS OF THE 2021 MULTIMEDIA SYSTEMS CONFERENCE, 2021, : 1 - 11
  • [2] Real-Time Panoramic Tracking for Event Cameras
    Reinbacher, Christian
    Munda, Gottfried
    Pock, Thomas
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL PHOTOGRAPHY (ICCP 2017), 2017, : 106 - 114
  • [3] Data-driven Feature Tracking for Event Cameras
    Messikommer, Nico
    Fang, Carter
    Gehrig, Mathias
    Scaramuzza, Davide
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 5642 - 5651
  • [4] Asynchronous event feature generation and tracking based on gradient descriptor for event cameras
    Li, Ruoxiang
    Shi, Dianxi
    Zhang, Yongjun
    Li, Ruihao
    Wang, Mingkun
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2021, 18 (04)
  • [5] Cooperative Object Tracking and Event Detection with Wireless Smart Cameras
    Wang, Youlu
    Casares, Mauricio
    Velipasalar, Senem
    AVSS: 2009 6TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE, 2009, : 394 - 399
  • [6] Flow-assisted visual tracking using event cameras
    Jiang, Rui
    Wang, Qinyi
    Shi, Shunshun
    Mou, Xiaozheng
    Chen, Shoushun
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2021, 6 (02) : 192 - 202
  • [7] Object tracking on event cameras with offline-online learning
    Jiang, Rui
    Mou, Xiaozheng
    Shi, Shunshun
    Zhou, Yueyin
    Wang, Qinyi
    Dong, Meng
    Chen, Shoushun
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2020, 5 (03) : 165 - 171
  • [8] Asynchronous Corner Detection and Tracking for Event Cameras in Real Time
    Alzugaray, Ignacio
    Chli, Margarita
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2018, 3 (04): : 3177 - 3184
  • [9] Asynchronous Multi-Hypothesis Tracking of Features with Event Cameras
    Alzugaray, Ignacio
    Chli, Margarita
    2019 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2019), 2019, : 269 - 278
  • [10] Intensity/Inertial Integration-Aided Feature Tracking on Event Cameras
    Li, Zeyu
    Liu, Yong
    Zhou, Feng
    Li, Xiaowan
    REMOTE SENSING, 2022, 14 (08)