Towards accurate image stitching for drone-based wind turbine blade inspection

被引:17
|
作者
Yang, Cong [1 ]
Liub, Xun [2 ]
Zhou, Hua [2 ]
Ke, Yan [2 ]
See, John [3 ]
机构
[1] Soochow Univ, Suzhou, Peoples R China
[2] Clobotics, Shanghai, Peoples R China
[3] Heriot Watt Univ Malaysia, Putrajaya, Malaysia
基金
中国国家自然科学基金;
关键词
Defect analysis; Image stitching; Blade inspection; Wind turbine;
D O I
10.1016/j.renene.2022.12.063
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Accurate image stitching is crucial to wind turbine blade visualization and defect analysis. It is inevitable that drone-captured images for blade inspection are high resolution and heavily overlapped. This also necessitates the stitching-based deduplication process on detected defects. However, the stitching task suffers from texture poor blade surfaces, unstable drone pose (especially off-shore), and the lack of public blade datasets that cater to real-world challenges. In this paper, we present a simple yet efficient algorithm for robust and accurate blade image stitching. To promote further research, we also introduce a new dataset, Blade30, which contains 1,302 real drone-captured images covering 30 full blades captured under various conditions (both on-and off-shore), accompanied by a rich set of annotations such as defects and contaminations, etc. The proposed stitching algorithm generates the initial blade panorama based on blade edges and drone-blade distances at the coarse grained level, followed by fine-grained adjustments optimized by regression-based texture and shape losses. Our method also fully utilizes the properties of blade images and prior information of the drone. Experiments report promising accuracy in blade stitching and defect deduplication tasks in the vision-based wind turbine blade inspection scenario, surpassing the performance of existing methods.
引用
收藏
页码:267 / 279
页数:13
相关论文
共 50 条
  • [21] Autonomous Drone-Based Powerline Insulator Inspection via Deep Learning
    Muhammad, Anas
    Shahpurwala, Adnan
    Mukhopadhyay, Shayok
    El-Hag, Ayman H.
    [J]. FOURTH IBERIAN ROBOTICS CONFERENCE: ADVANCES IN ROBOTICS, ROBOT 2019, VOL 1, 2020, 1092 : 52 - 62
  • [22] Moving Mechanism for a Wind Turbine Blade Inspection and Repair Robot
    Hayashi, Shunsuke
    Takei, Toshinobu
    Hamamura, Keitaro
    Ito, Sumio
    Kanawa, Daichi
    Imanishi, Etsujiro
    Yamauchi, Yuga
    [J]. 2017 IEEE/SICE INTERNATIONAL SYMPOSIUM ON SYSTEM INTEGRATION (SII), 2017, : 270 - 275
  • [23] Drone-based entanglement distribution towards mobile quantum networks
    Liu, Hua-Ying
    Tian, Xiao-Hui
    Gu, Changsheng
    Fan, Pengfei
    Ni, Xin
    Yang, Ran
    Zhang, Ji-Ning
    Hu, Mingzhe
    Guo, Jian
    Cao, Xun
    Hu, Xiaopeng
    Zhao, Gang
    Lu, Yan-Qing
    Gong, Yan-Xiao
    Xie, Zhenda
    Zhu, Shi-Ning
    [J]. NATIONAL SCIENCE REVIEW, 2020, 7 (05) : 921 - 928
  • [24] A Drone-Based Building Inspection System Using Software-Agents
    Jo, Jun
    Jadidi, Zahra
    Stantic, Bela
    [J]. INTELLIGENT DISTRIBUTED COMPUTING XI, 2018, 737 : 115 - 121
  • [25] DETECTING AND POSITIONING OF WIND TURBINE BLADE TIPS FOR UAV-BASED AUTOMATIC INSPECTION
    Guo, Haowen
    Cui, Qiangqiang
    Wang, Jinwang
    Fang, Xu
    Yang, Wen
    Li, Zhengrong
    [J]. 2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 1374 - 1377
  • [26] Accurate Probability Distribution Calculation for Drone-Based Highway-VANETs
    Seliem, Hafez
    Shahidi, Reza
    Ahmed, Mohamed H.
    Shehata, Mohamed S.
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (01) : 1127 - 1130
  • [27] Fast detection of wind turbine blade damage using Cascade Mask R-DSCNN-aided drone inspection analysis
    Diaz, P. M.
    Tittus, P.
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (05) : 2333 - 2341
  • [28] Fast detection of wind turbine blade damage using Cascade Mask R-DSCNN-aided drone inspection analysis
    P. M. Diaz
    P. Tittus
    [J]. Signal, Image and Video Processing, 2023, 17 : 2333 - 2341
  • [29] Efficient and Accurate Damage Detector for Wind Turbine Blade Images
    Lv, Liang
    Yao, Zhongyuan
    Wang, Enming
    Ren, Xin
    Pang, Ran
    Wang, Hua
    Zhang, Yu
    Wu, Hao
    [J]. IEEE ACCESS, 2022, 10 : 123378 - 123386
  • [30] Drone-based entanglement distribution towards mobile quantum networks
    Hua-Ying Liu
    Xiao-Hui Tian
    Changsheng Gu
    Pengfei Fan
    Xin Ni
    Ran Yang
    Ji-Ning Zhang
    Mingzhe Hu
    Jian Guo
    Xun Cao
    Xiaopeng Hu
    Gang Zhao
    Yan-Qing Lu
    Yan-Xiao Gong
    Zhenda Xie
    Shi-Ning Zhu
    [J]. National Science Review, 2020, 7 (05) : 921 - 928