DCPLD-Net: A diffusion coupled convolution neural network for real-time power transmission lines detection from UAV-Borne LiDAR data

被引:18
|
作者
Chen, Chi [1 ,2 ,3 ]
Jin, Ang [1 ,2 ,3 ]
Yang, Bisheng [1 ,2 ,3 ]
Ma, Ruiqi [1 ,2 ,3 ]
Sun, Shangzhe [1 ,2 ,3 ]
Wang, Zhiye [1 ,2 ,3 ]
Zong, Zeliang [1 ,2 ,3 ,4 ]
Zhang, Fei [5 ]
机构
[1] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan, Peoples R China
[2] Wuhan Univ, Engn Res Ctr Spatio Temporal Data Smart Acquisit &, Minist Educ China, Wuhan, Peoples R China
[3] Wuhan Univ, Inst Geospatial intelligence, Wuhan, Peoples R China
[4] Sence Time, Hangzhou, Peoples R China
[5] Shanghai Weizhizhuoxin Informat Technol Co Ltd, Shanghai, Peoples R China
基金
欧盟地平线“2020”;
关键词
UAV; Power transmission lines inspection; Simulated physical processes; LiDAR; Point clouds; POINT; REGISTRATION; IMAGES;
D O I
10.1016/j.jag.2022.102960
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
The stable and reliable supply of electric power is strongly related to the normal social production. In recent years, power transmission lines inspection based on remote sensing methods has made great progress, especially using the UAV-borne LiDAR system. The extraction and identification of power transmission lines (i.e., con-ductors) from 3D point clouds are the basis of LiDAR data-based power grid risk management. However, existing rule-based/traditional machine learning extraction approaches have exposed some limitations, such as the lack of timeliness and generalization. Moreover, the potential of deep learning is seriously overlooked in RoW (Right of Way) LiDAR inspection tasks. Thus, we proposed DCPLD-Net: a diffusion coupled convolution neural network for real-time power transmission lines detection from UAV-borne LiDAR data. To implement efficient 2D convolution on 3D point clouds, we proposed a novel point cloud representation, named Cross Section View (CSV), which transforms the discrete point clouds into 3D tensors constructed by voxels with a deformed geo-metric shape along the flight trajectory. After the CSV feature generation, the encoded features of each voxel are treated as energy (i.e., heat) signals and diffused in space to generate diffusion feature maps. The feature of the power line points are thus enhanced through this simulated physical process (diffusion). Finally, a single-stage detector named PLDNet is proposed for the multiscale detection of conductors on the diffused CSV representa-tions. The experimental results show that the DCPLD-Net achieves an average F1 score of 97.14 % at 8 Hz detection frequency on RoWs inspection LiDAR datasets collected by both mini-UAV LiDAR and large-scale fully autonomous UAV power lines inspection robots, and surpasses compared methods (i.e. PointNet ++, RandLA-Net) in terms of F1 scores and IoU.
引用
收藏
页数:19
相关论文
共 3 条
  • [1] DSA-Net: An Attention-Guided Network for Real-Time Defect Detection of Transmission Line Dampers Applied to UAV Inspections
    Zhang, Ye
    Li, Botao
    Shang, Jinghao
    Huang, Xinbo
    Zhai, Pengchao
    Geng, Cuicui
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 22
  • [2] YoloOW: A Spatial Scale Adaptive Real-Time Object Detection Neural Network for Open Water Search and Rescue From UAV Aerial Imagery
    Xu, Jianhao
    Fan, Xiangtao
    Jian, Hongdeng
    Xu, Chen
    Bei, Weijia
    Ge, Qifeng
    Zhao, Teng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [3] Efficient Detection and Transmission of Test Data enable immediate Reactions Progress Energy is monitored by the Control Center from Performance Tests in 30 Power Plants in Real-Time
    Fletcher, Jason
    ATP EDITION, 2012, (7-8): : 18 - 19