Road damage detection using UAV images based on multi-level attention mechanism

被引:38
|
作者
Zhang, Yingchao [1 ]
Zuo, Zhiwu [2 ]
Xu, Xiaobin [3 ]
Wu, Jianqing [1 ,4 ]
Zhu, Jianguo [3 ]
Zhang, Hongbo [1 ]
Wang, Jiewen [3 ]
Tian, Yuan [1 ]
机构
[1] Shandong Univ, Sch Qilu Transportat, Jinan, Peoples R China
[2] Shandong Hispeed Grp Co Ltd, Jinan, Peoples R China
[3] Shandong Hispeed Dongying Dev Co Ltd, Dongying, Peoples R China
[4] Shandong Univ, Suzhou Res Inst, Suzhou, Peoples R China
关键词
Road damage detection; Convolutional neural network (CNN); You only look once version 3 (YOLO v3); Attention mechanism; CRACK DETECTION; PAVEMENT;
D O I
10.1016/j.autcon.2022.104613
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Pavement damage detection is essential for subsequent road maintenance decisions. However, recent detection networks have low accuracy and fail to detect most diseases on the road, which means that testing is very inefficient. Therefore, this study uses the unmanned aerial vehicle (UAV) road damage database and describes a multi-level attention mechanism called Multi-level Attention Block (MLAB) to strengthen the utilization of essential features by the You Only Look Once version 3 (YOLO v3). Adding MLAB between the backbone and feature fusion parts effectively increases the mAP value of the proposed network to 68.75%, while the accuracy of the original network is only 61.09%. The network is able to detect longitudinal cracks, transverse cracks, repairs, and potholes with high accuracy, and significantly improves the accuracy of alligator cracks and oblique cracks. The findings of this study will accelerate the application of non-destructive automatic road damage detection.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Road Damage Detection and Classification based on Multi-level Feature Pyramids
    Yin, Junru
    Qu, Jiantao
    Huang, Wei
    Chen, Qiqiang
    [J]. KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2021, 15 (02): : 786 - 799
  • [2] Road Crack Model Based on Multi-Level Feature Fusion and Attention Mechanism
    Song, Rongrong
    Wang, Caiyong
    Tian, Qichuan
    Zhang, Qi
    [J]. Computer Engineering and Applications, 2023, 59 (13) : 281 - 288
  • [3] Attention-Based Multi-Level Feature Fusion for Object Detection in Remote Sensing Images
    Dong, Xiaohu
    Qin, Yao
    Gao, Yinghui
    Fu, Ruigang
    Liu, Songlin
    Ye, Yuanxin
    [J]. REMOTE SENSING, 2022, 14 (15)
  • [4] Image inpainting network based on multi-level attention mechanism
    Xiang, Hongyue
    Min, Weidong
    Wei, Zitai
    Zhu, Meng
    Liu, Mengxue
    Deng, Ziyang
    [J]. IET IMAGE PROCESSING, 2024, 18 (02) : 428 - 438
  • [5] A multimodal fusion model with multi-level attention mechanism for depression detection
    Fang, Ming
    Peng, Siyu
    Liang, Yujia
    Hung, Chih-Cheng
    Liu, Shuhua
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 82
  • [6] Automated Road Damage Detection Using UAV Images and Deep Learning Techniques
    Silva, Luis Augusto
    Leithardt, Valderi Reis Quietinho
    Batista, Vivian Felix Lopez
    Gonzalez, Gabriel Villarrubia
    Santana, Juan Francisco De Paz
    [J]. IEEE ACCESS, 2023, 11 : 62918 - 62931
  • [7] LUFFD-YOLO: A Lightweight Model for UAV Remote Sensing Forest Fire Detection Based on Attention Mechanism and Multi-Level Feature Fusion
    Han, Yuhang
    Duan, Bingchen
    Guan, Renxiang
    Yang, Guang
    Zhen, Zhen
    [J]. REMOTE SENSING, 2024, 16 (12)
  • [8] Visual Relation Detection with Multi-Level Attention
    Zheng, Sipeng
    Chen, Shizhe
    Jin, Qin
    [J]. PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 121 - 129
  • [9] A multi-level feature attention network for COVID-19 detection based on multi-source medical images
    Zhao, Aite
    Wu, Huimin
    Chen, Ming
    Wang, Nana
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (27) : 70419 - 70450
  • [10] A New Framework for Automatic Airports Extraction from SAR Images Using Multi-Level Dual Attention Mechanism
    Chen, Lifu
    Tan, Siyu
    Pan, Zhouhao
    Xing, Jin
    Yuan, Zhihui
    Xing, Xuemin
    Zhang, Peng
    [J]. REMOTE SENSING, 2020, 12 (03)