Design and Implementation of UAVs for Bird's Nest Inspection on Transmission Lines Based on Deep Learning

被引:19
|
作者
Li, Han [1 ]
Dong, Yiqun [1 ]
Liu, Yunxiao [1 ]
Ai, Jianliang [1 ]
机构
[1] Fudan Univ, Dept Aeronaut & Astronaut, Shanghai 200433, Peoples R China
关键词
transmission line; bird's nest detection; deep learning; UAV application;
D O I
10.3390/drones6090252
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
In recent years, unmanned aerial vehicles (UAV) have been increasingly used in power line inspections. Birds often nest on transmission line towers, which threatens safe power line operation. The existing research on bird's nest inspection using UAVs mainly stays at the level of image postprocessing detection, which has poor real-time performance and cannot obtain timely bird's nest detection results. Considering the above shortcomings, we designed a power inspection UAV system based on deep learning technology for autonomous flight, positioning and photography, real-time bird nest detection, and result export. In this research, 2000 bird's nest images in the actual power inspection environment were shot and collected to create the dataset. The parameter optimization and test comparison for bird's nest detection are based on the three target detection models of YOLOv3, YOLOv5-s, and YOLOX-s. A YOLOv5-s bird's nest detection model optimized for bird's nest real-time detection is proposed, and it is deployed to the onboard computer for real-time detection and verification during flight. The DJI M300 RTK UAV was used to conduct a test flight in a natural power inspection environment. The test results show that the mAP of the UAV system designed in this paper for bird's nest detection is 92.1%, and the real-time detection frame rate is 33.9 FPS. Compared with the previous research results, this paper proposes a new practice of using drones for bird's nest detection, dramatically improving the real-time accuracy of bird's nest detection. The UAV system can efficiently complete the task of bird's nest detection in the process of electric power inspection, which can significantly reduce manpower consumption in the power inspection process.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Deep Learning-Based Bird's Nest Detection on Transmission Lines Using UAV Imagery
    Li, Jin
    Yan, Daifu
    Luan, Kuan
    Li, Zeyu
    Liang, Hong
    [J]. APPLIED SCIENCES-BASEL, 2020, 10 (18):
  • [2] DETECTION OF BIRD'S NEST ON TRANSMISSION LINES FROM AERIAL IMAGES BASED ON DEEP LEARNING MODEL
    Zhang, Jie
    Qi, Qiye
    Zhang, Huanlong
    DU, Qifan
    Guo, Zhimin
    Tian, Yangyang
    [J]. INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2022, 18 (06): : 1755 - 1768
  • [3] Bird's nest defect detection of transmission lines based on domain knowledge and occlusion reasoning
    Dong, Na
    Zhang, Wenjing
    Chen, Ze
    Feng, Haiyan
    Jia, Jiandong
    [J]. IET GENERATION TRANSMISSION & DISTRIBUTION, 2023, 17 (22) : 4946 - 4957
  • [4] Inverse Design of Transmission Lines with Deep Learning
    Roy, Kallol
    Dolatsara, Majid Ahadi
    Torun, Hakki M.
    Trinchero, Riccardo
    Swaminathan, Madhavan
    [J]. 2019 IEEE 28TH CONFERENCE ON ELECTRICAL PERFORMANCE OF ELECTRONIC PACKAGING AND SYSTEMS (EPEPS 2019), 2019,
  • [5] Bird nest detection method for transmission lines based on improved YOLOv5
    Zhang, Huanlong
    Qi, Qiye
    Zhang, Jie
    Wang, Yanfeng
    Guo, Zhimin
    Tian, Yangyang
    Chen, Fuguo
    [J]. Dianli Xitong Baohu yu Kongzhi/Power System Protection and Control, 2023, 51 (02): : 151 - 159
  • [6] Deep learning's impact on contour extraction for Design Based Metrology and Design Based Inspection
    Yumiba, Ryo
    Ishikawa, Masayoshi
    Shinoda, Shinichi
    Sakimura, Shigetoshi
    Toyoda, Yasutaka
    Shindo, Hiroyuki
    Izawa, Masayuki
    [J]. METROLOGY, INSPECTION, AND PROCESS CONTROL FOR MICROLITHOGRAPHY XXXIII, 2019, 10959
  • [7] Deep learning's impact on pattern matching for Design Based Metrology and Design Based Inspection
    Dou, Shuyang
    Shinoda, Shinichi
    Ishikawa, Masayoshi
    Yumiba, Ryo
    Sakimura, Shigetoshi
    Ouchi, Masanori
    Toyoda, Yasutaka
    Shindo, Hiroyuki
    Izawa, Masayuki
    [J]. METROLOGY, INSPECTION, AND PROCESS CONTROL FOR MICROLITHOGRAPHY XXXIII, 2019, 10959
  • [8] 3D PATH PLANNING OF UAVs FOR TRANSMISSION LINES INSPECTION
    Dong, Ruifang
    Liu, Changan
    Wang, Xiaopeng
    Han, Xiaolei
    [J]. INTERNATIONAL JOURNAL OF ROBOTICS & AUTOMATION, 2020, 35 (04): : 269 - 282
  • [9] Development of Deep Learning-based Automatic Camera Gimbal System for Drone Inspection of Transmission Lines
    Ryu, Seo-Hyeon
    Park, Joon-Young
    Kim, Seok-Tae
    Kim, Tae-Won
    Ko, Byung-Sung
    Woo, Jung-Wook
    [J]. Transactions of the Korean Institute of Electrical Engineers, 2021, 70 (01): : 121 - 129
  • [10] On the design of deep learning-based control algorithms for visually guided UAVs engaged in power tower inspection tasks
    Maitre, Guillaume
    Martinot, Dimitri
    Tuci, Elio
    [J]. FRONTIERS IN ROBOTICS AND AI, 2024, 11