Deep-Learning-Based Defect Detection for Light Aircraft With Unmanned Aircraft Systems

被引:0
|
作者
Connolly, Luke [1 ,3 ]
Garland, James [2 ,3 ]
O'Gorman, Diarmuid [1 ,3 ]
Tobin, Edmond F. [1 ,3 ]
机构
[1] South East Technol Univ, Dept Aerosp & Mech Engn, Carlow Campus, Carlow R93 V960, Ireland
[2] South East Technol Univ, Dept Elect Engn & Commun, Carlow Campus, Carlow R93 V960, Ireland
[3] South East Technol Univ, Ctr Res & Enterprise Engn engCORE, Carlow Campus, Carlow R93 V960, Ireland
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Aircraft; Training; Inspection; Visualization; Atmospheric modeling; Computational modeling; Maintenance engineering; Deep learning; object detection; defects; aircraft damage detection;
D O I
10.1109/ACCESS.2024.3412204
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Visual inspections of aircraft are a vital aspect of aircraft maintenance. They involve ground personnel walking around the aircraft, mounting scaffolding or ladders, and fully inspecting the aircraft. A visual inspection, however, requires a significant amount of time to perform and may be prone to human error. To address these challenges, a deep-learning-based defect-detection model is proposed, which has the potential to reduce inspection time significantly and enhance inspection reliability. This approach utilises an Unmanned Aircraft System (UAS) equipped with an onboard camera system to capture images for analysis. The proposed machine-learning (ML) model is trained using a deep-learning framework, specifically YOLOv8, on a diverse dataset comprising of both defective and non-defective images of the aircraft. The labelling process for novel classes is accelerated through utilising a low accuracy pre-trained model. Following model analysis, the operator inspects the defects reported in the images. To facilitate efficient identification, object detection techniques, such as bounding boxes, are employed. In this study, various hyperparameter combinations to optimise the model's performance are explored. Implementing this ML detection system would mitigate the risks associated with human error and improve inspection accuracy, providing a safer visual inspection process for ground personnel and a more efficient solution for aircraft visual inspections for preventative maintenance. Moreover, the utilisation of a UAS enables inspections of inaccessible or hazardous areas without compromising personnel safety. This research demonstrates the potential of deep learning for aircraft visual inspections. The defects analysed are damaged and missing rivets, filiform corrosion, and missing panels, while future research aims to expand the scope to include additional defects such as paint chipping, scratches, burns, and rust. The model's capability to discern the condition of rivets, panels, and filiform corrosion is evidenced by its achieved validation mean Average Precision (mAP) of 85 %.
引用
收藏
页码:83876 / 83886
页数:11
相关论文
共 50 条
  • [1] A Deep-Learning-Based Approach for Aircraft Engine Defect Detection
    Upadhyay, Anurag
    Li, Jun
    King, Steve
    Addepalli, Sri
    [J]. MACHINES, 2023, 11 (02)
  • [2] Detection of aircraft below the horizon for vision-based detect and avoid in unmanned aircraft systems
    Molloy, Timothy L.
    Ford, Jason J.
    Mejias, Luis
    [J]. JOURNAL OF FIELD ROBOTICS, 2017, 34 (07) : 1378 - 1391
  • [3] Integration of Small Unmanned Aircraft Systems and Deep Learning for Efficient Airfield Pavement Crack Detection and Assessment
    Sourav, Md. Abdullah All
    Ceylan, Halil
    Kim, Sunghwan
    Brynick, Matthew
    [J]. INTERNATIONAL CONFERENCE ON TRANSPORTATION AND DEVELOPMENT 2024: TRANSPORTATION SAFETY AND EMERGING TECHNOLOGIES, ICTD 2024, 2024, : 884 - 893
  • [4] Deep-learning-based Moving Target Detection for Unmanned Air Vehicles
    Yao, Haodi
    Yu, Qingtao
    Xing, Xiaowei
    He, Fenghua
    Ma, Jie
    [J]. PROCEEDINGS OF THE 36TH CHINESE CONTROL CONFERENCE (CCC 2017), 2017, : 11459 - 11463
  • [5] Brandt's vole hole detection and counting method based on deep learning and unmanned aircraft system
    Wu, Wei
    Liu, Shengping
    Zhong, Xiaochun
    Liu, Xiaohui
    Wang, Dawei
    Lin, Kejian
    [J]. FRONTIERS IN PLANT SCIENCE, 2024, 15
  • [6] Deep Learning-Based Real Time Defect Detection for Optimization of Aircraft Manufacturing and Control Performance
    Shafi, Imran
    Mazhar, Muhammad Fawad
    Fatima, Anum
    Alvarez, Roberto Marcelo
    Miro, Yini
    Espinosa, Julio Cesar Martinez
    Ashraf, Imran
    [J]. DRONES, 2023, 7 (01)
  • [7] Unmanned aircraft systems as wingmen
    Garcia, Richard D.
    Barnes, Laura
    Fields, MaryAnne
    [J]. JOURNAL OF DEFENSE MODELING AND SIMULATION-APPLICATIONS METHODOLOGY TECHNOLOGY-JDMS, 2012, 9 (01): : 5 - 15
  • [8] REGULATION FOR UNMANNED AIRCRAFT SYSTEMS
    Preseren, Peter
    [J]. GEODETSKI VESTNIK, 2016, 60 (03) : 544 - 544
  • [9] Unmanned Aircraft Systems as Wingmen
    Garcia, Richard
    Barnes, Laura
    Fields, MaryAnne
    [J]. UNMANNED SYSTEMS TECHNOLOGY XII, 2010, 7692
  • [10] The Law of Unmanned Aircraft Systems
    Savic, Iva
    [J]. AIR & SPACE LAW, 2023, 48 (02): : 253 - 258