Towards accurate image stitching for drone-based wind turbine blade inspection

被引:17
|
作者
Yang, Cong [1 ]
Liub, Xun [2 ]
Zhou, Hua [2 ]
Ke, Yan [2 ]
See, John [3 ]
机构
[1] Soochow Univ, Suzhou, Peoples R China
[2] Clobotics, Shanghai, Peoples R China
[3] Heriot Watt Univ Malaysia, Putrajaya, Malaysia
基金
中国国家自然科学基金;
关键词
Defect analysis; Image stitching; Blade inspection; Wind turbine;
D O I
10.1016/j.renene.2022.12.063
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Accurate image stitching is crucial to wind turbine blade visualization and defect analysis. It is inevitable that drone-captured images for blade inspection are high resolution and heavily overlapped. This also necessitates the stitching-based deduplication process on detected defects. However, the stitching task suffers from texture poor blade surfaces, unstable drone pose (especially off-shore), and the lack of public blade datasets that cater to real-world challenges. In this paper, we present a simple yet efficient algorithm for robust and accurate blade image stitching. To promote further research, we also introduce a new dataset, Blade30, which contains 1,302 real drone-captured images covering 30 full blades captured under various conditions (both on-and off-shore), accompanied by a rich set of annotations such as defects and contaminations, etc. The proposed stitching algorithm generates the initial blade panorama based on blade edges and drone-blade distances at the coarse grained level, followed by fine-grained adjustments optimized by regression-based texture and shape losses. Our method also fully utilizes the properties of blade images and prior information of the drone. Experiments report promising accuracy in blade stitching and defect deduplication tasks in the vision-based wind turbine blade inspection scenario, surpassing the performance of existing methods.
引用
收藏
页码:267 / 279
页数:13
相关论文
共 50 条
  • [41] Towards Robust and Optimal Image Stitching for Pavement Crack Inspection and Mapping
    Li, Haifeng
    Liu, Yu
    Fan, Longfei
    Chen, Xinwei
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (IEEE ROBIO 2017), 2017, : 2390 - 2400
  • [42] Full-Field Inspection of a Wind Turbine Blade Using Three-Dimensional Digital Image Correlation
    LeBlanc, Bruce
    Niezrecki, Christopher
    Avitabile, Peter
    Chen, Julie
    Sherwood, James
    Hughes, Scott
    [J]. INDUSTRIAL AND COMMERCIAL APPLICATIONS OF SMART STRUCTURES TECHNOLOGIES 2011, 2011, 7979
  • [43] Playing with Drones: Towards understanding the design of drone-based pervasive play
    Silvester, Timothy A.
    [J]. EXTENDED ABSTRACTS OF THE 2021 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'21), 2021,
  • [44] Towards drone-based magnetometer measurements for archaeological prospection in challenging terrain
    Schmidt, Volkmar
    Coolen, Joris
    Fritsch, Thomas
    Klingen, Stefan
    [J]. DRONE SYSTEMS AND APPLICATIONS, 2024, 12 : 1 - 15
  • [45] Towards a Holistic Performance Evaluation Framework for Drone-Based Object Detection
    Petrides, P.
    Kyrkou, C.
    Kolios, P.
    Theocharides, T.
    Panayiotou, C.
    [J]. 2017 INTERNATIONAL CONFERENCE ON UNMANNED AIRCRAFT SYSTEMS (ICUAS'17), 2017, : 1785 - 1793
  • [46] A Drone-Driven X-Ray Image-Based Diagnosis of Wind Turbine Blades for Reliable Operation of Wind Turbine
    Lee, Hyunyong
    Hwang, Yu Min
    Lee, Jungi
    Kim, Nac-Woo
    Ko, Seok-Kap
    [J]. IEEE ACCESS, 2024, 12 : 56141 - 56158
  • [47] Principles and practice of acquiring drone-based image data in marine environments
    Joyce, K. E.
    Duce, S.
    Leahy, S. M.
    Leon, J.
    Maier, S. W.
    [J]. MARINE AND FRESHWATER RESEARCH, 2019, 70 (07) : 952 - 963
  • [48] Research on wind turbine blade damage identification method based on thermal infrared image
    Yin, Yu
    Zhang, Yong
    Wang, Jian
    Wu, Guojing
    Su, Lide
    Wang, Chaoyu
    [J]. Taiyangneng Xuebao/Acta Energiae Solaris Sinica, 2022, 43 (02): : 492 - 497
  • [49] Research on Surface Defect Detection Technology of Wind Turbine Blade Based on UAV Image
    TAN Xingguo
    ZHANG Gaoming
    [J]. Instrumentation, 2022, 9 (01) : 41 - 48
  • [50] Feature extraction method of wind turbine blade surface scratches based on image processing
    Li, Wanrun
    Zhang, Jianfei
    Wang, Xueping
    Du, Yongfeng
    [J]. Taiyangneng Xuebao/Acta Energiae Solaris Sinica, 2020, 41 (12): : 278 - 287