Real-Time On-Board Deep Learning Fault Detection for Autonomous UAV Inspections

被引:26
|
作者
Ayoub, Naeem [1 ]
Schneider-Kamp, Peter [1 ]
机构
[1] Univ Southern Denmark, Dept Math & Comp Sci, DK-5230 Odense M, Denmark
关键词
unmanned aerial vehicles; edge computing; deep learning; object recognition; fault detection;
D O I
10.3390/electronics10091091
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Inspection of high-voltage power lines using unmanned aerial vehicles is an emerging technological alternative to traditional methods. In the Drones4Energy project, we work toward building an autonomous vision-based beyond-visual-line-of-sight (BVLOS) power line inspection system. In this paper, we present a deep learning-based autonomous vision system to detect faults in power line components. We trained a YOLOv4-tiny architecture-based deep neural network, as it showed prominent results for detecting components with high accuracy. For running such deep learning models in a real-time environment, different single-board devices such as the Raspberry Pi 4, Nvidia Jetson Nano, Nvidia Jetson TX2, and Nvidia Jetson AGX Xavier were used for the experimental evaluation. Our experimental results demonstrated that the proposed approach can be effective and efficient for fully automatic real-time on-board visual power line inspection.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Real-time On-board Detection of Components and Faults in an Autonomous UAV System for Power Line Inspection
    Ayoub, Naeem
    Schneider-Kamp, Peter
    [J]. PROCEEDINGS OF THE 1ST INTERNATIONAL CONFERENCE ON DEEP LEARNING THEORY AND APPLICATIONS (DELTA), 2020, : 68 - 75
  • [2] On-board real-time tracking of pedestrians on a UAV
    De Smedt, Floris
    Hulens, Dries
    Goedeme, Toon
    [J]. 2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2015,
  • [3] Real-Time Human Detection and Gesture Recognition for On-Board UAV Rescue
    Liu, Chang
    Sziranyi, Tamas
    [J]. SENSORS, 2021, 21 (06) : 1 - 21
  • [4] ShuffleDet: Real-Time Vehicle Detection Network in On-Board Embedded UAV Imagery
    Azimi, Seyed Majid
    [J]. COMPUTER VISION - ECCV 2018 WORKSHOPS, PT II, 2019, 11130 : 88 - 99
  • [5] AURORA: autonomous real-time on-board video analytics
    Plamen Angelov
    Pouria Sadeghi-Tehran
    Christopher Clarke
    [J]. Neural Computing and Applications, 2017, 28 : 855 - 865
  • [6] AURORA: autonomous real-time on-board video analytics
    Angelov, Plamen
    Sadeghi-Tehran, Pouria
    Clarke, Christopher
    [J]. NEURAL COMPUTING & APPLICATIONS, 2017, 28 (05): : 855 - 865
  • [7] On the Way to a Real-Time On-Board Orthogonal SLAM for an Indoor UAV
    Alpen, Mirco
    Frick, Klaus
    Horn, Joachim
    [J]. INTELLIGENT ROBOTICS AND APPLICATIONS, PT I: ICIRA 2011, 2011, 7101 : 1 - 11
  • [8] Real-time UAV Detection based on Deep Learning Network
    Hassan, Syed Ali
    Rahim, Tariq
    Shin, Soo Young
    [J]. 2019 10TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC): ICT CONVERGENCE LEADING THE AUTONOMOUS FUTURE, 2019, : 630 - 632
  • [9] Real-Time and On-Board Anomalous Command Detection in UAV Operations via Simultaneous UAV-Operator Monitoring
    Elia, Rafaella
    Theocharides, Theocharis
    [J]. 2024 INTERNATIONAL CONFERENCE ON UNMANNED AIRCRAFT SYSTEMS, ICUAS, 2024, : 248 - 255
  • [10] Real-Time Detection of Hogweed: UAV Platform Empowered by Deep Learning
    Menshchikov, Alexander
    Shadrin, Dmitrii
    Prutyanov, Viktor
    Lopatkin, Daniil
    Sosnin, Sergey
    Tsykunov, Evgeny
    Iakovlev, Evgeny
    Somov, Andrey
    [J]. IEEE TRANSACTIONS ON COMPUTERS, 2021, 70 (08) : 1175 - 1188