DMA-Net: DeepLab With Multi-Scale Attention for Pavement Crack Segmentation

被引:90
|
作者
Sun, Xinzi [1 ]
Xie, Yuanchang [2 ]
Jiang, Liming [2 ]
Cao, Yu [1 ]
Liu, Benyuan [1 ]
机构
[1] Univ Massachusetts Lowell, Dept Comp Sci, Lowell, MA 01854 USA
[2] Univ Massachusetts Lowell, Dept Civil & Environm Engn, Lowell, MA 01854 USA
关键词
Image segmentation; Convolution; Semantics; Roads; Decoding; Feature extraction; Computer vision; Pavement crack segmentation; Convolutional Neural Network (CNN); multi-scale attention; CONVOLUTIONAL NETWORKS; DAMAGE;
D O I
10.1109/TITS.2022.3158670
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Cracks are important indicators of pavement structural and operational conditions. Early pavement crack detection and treatments can help extend pavement service life, reduce fuel consumption, and improve safety and ride quality. Pavement distress surveys have traditionally been performed manually by visually inspecting the roads, which is labor-intensive and time-consuming. Therefore, computer-vision-based automated crack detection has great practical significance in pavement maintenance and traffic safety. Traditional image processing techniques are sensitive to noise in images and are thus likely to miss detecting some cracks due to the crack texture variety, complex lighting conditions, and various similar but irrelevant objects on the road. This paper adopts and enhances DeepLabv3+, a popular deep learning framework for semantic image segmentation, for road pavement crack detection. We propose a multi-scale attention module in the decoder of DeepLabv3+ to generate an attention mask and dynamically assign weights between high-level and low-level feature maps. Compared with fixed weights across different features, the dynamic weights strategy can assign more reasonable weights to different feature maps. Ablation experiments show that the attention mask can effectively help the model better combine multi-scale features and generate more accurate pavement crack segmentation results. The proposed method achieves state-of-the-art results on three benchmarks, including Crack500, DeepCrack, and FMA (Fitchburg Municipal Airport) datasets. We further test it on pavement crack images captured by smartphones, and the results show that it provides a viable approach to road pavement crack segmentation in practice with excellent performance.
引用
收藏
页码:18392 / 18403
页数:12
相关论文
共 50 条
  • [1] DMA-Net: Decoupled Multi-Scale Attention for Few-Shot Object Detection
    Xie, Xijun
    Lee, Feifei
    Chen, Qiu
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (12):
  • [2] GMDNet: An Irregular Pavement Crack Segmentation Method Based on Multi-Scale Convolutional Attention Aggregation
    Qi, Yawei
    Wan, Fang
    Lei, Guangbo
    Liu, Wei
    Xu, Li
    Ye, Zhiwei
    Zhou, Wen
    [J]. ELECTRONICS, 2023, 12 (15)
  • [3] CNN-based network with multi-scale context feature and attention mechanism for automatic pavement crack segmentation
    Liang, Jia
    Gu, Xingyu
    Jiang, Dong
    Zhang, Qipeng
    [J]. AUTOMATION IN CONSTRUCTION, 2024, 164
  • [4] Multi-scale triple-attention network for pixelwise crack segmentation
    Yang, Lei
    Bai, Suli
    Liu, Yanhong
    Yu, Hongnian
    [J]. AUTOMATION IN CONSTRUCTION, 2023, 150
  • [5] DMA-Net: Dual multi-instance attention network for X-ray image classification
    Liu, Shuoyan
    Yang, Enze
    Liu, Yuxin
    Zhao, Shitao
    [J]. IET IMAGE PROCESSING, 2022, 16 (13) : 3518 - 3528
  • [6] MA-Net: A Multi-Scale Attention Network for Liver and Tumor Segmentation
    Fan, Tongle
    Wang, Guanglei
    Li, Yan
    Wang, Hongrui
    [J]. IEEE ACCESS, 2020, 8 : 179656 - 179665
  • [7] Latent fingerprint segmentation using multi-scale attention U-Net
    Akhila, P.
    Koolagudi, Shashidhar G.
    [J]. INTERNATIONAL JOURNAL OF BIOMETRICS, 2024, 16 (02) : 195 - 215
  • [8] Multi-scale Regional Attention Deeplab3+: Multiple Myeloma Plasma Cells Segmentation in Microscopic Images
    Bozorgpour, Afshin
    Azad, Reza
    Showkatian, Eman
    Sulaiman, Alaa
    [J]. MICCAI WORKSHOP ON COMPUTATIONAL PATHOLOGY, VOL 156, 2021, 156 : 47 - 56
  • [9] DAU-Net: Dense Attention U-Net for Pavement Crack Segmentation
    Hsieh, Yung-An
    Tsai, Yi-Chang James
    [J]. 2021 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2021, : 2251 - 2256
  • [10] CycleADC-Net: A crack segmentation method based on multi-scale feature fusion
    Yan, Yidan
    Zhu, Shujin
    Ma, Shaolian
    Guo, Yinan
    Yu, Zekuan
    [J]. MEASUREMENT, 2022, 204