STrans-YOLOX: Fusing Swin Transformer and YOLOX for Automatic Pavement Crack Detection

被引:17
|
作者
Luo, Hui [1 ]
Li, Jiamin [1 ]
Cai, Lianming [1 ]
Wu, Mingquan [1 ]
机构
[1] East China Jiaotong Univ, Sch Informat Engn, Nanchang 330013, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 03期
基金
中国国家自然科学基金;
关键词
pavement crack detection; object detection; Swin Transformer; YOLOX; global guidance attention; multi-scale feature fusion; NMS; complex scenes;
D O I
10.3390/app13031999
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Automatic pavement crack detection is crucial for reducing road maintenance costs and ensuring transportation safety. Although convolutional neural networks (CNNs) have been widely used in automatic pavement crack detection, they cannot adequately model the long-range dependencies between pixels and easily lose edge detail information in complex scenes. Moreover, irregular crack shapes also make the detection task challenging. To address these issues, an automatic pavement crack detection architecture named STrans-YOLOX is proposed. Specifically, the architecture first exploits the CNN backbone to extract feature information, preserving the local modeling ability of the CNN. Then, Swin Transformer is introduced to enhance the long-range dependencies through a self-attention mechanism by supplying each pixel with global features. A new global attention guidance module (GAGM) is used to ensure effective information propagation in the feature pyramid network (FPN) by using high-level semantic information to guide the low-level spatial information, thereby enhancing the multi-class and multi-scale features of cracks. During the post-processing stage, we utilize alpha-IoU-NMS to achieve the accurate suppression of the detection boxes in the case of occlusion and overlapping objects by introducing an adjustable power parameter. The experiments demonstrate that the proposed STrans-YOLOX achieves 63.37% mAP and surpasses the state-of-the-art models on the challenging pavement crack dataset.
引用
收藏
页数:17
相关论文
共 50 条
  • [41] Automatic Crack Detection From Pavement Images Using Fuzzy Thresholding
    Ahmed, Nouha Ben Cheikh
    Lahouar, Samer
    Souani, Chokri
    Besbes, Kamel
    2017 INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND DIAGNOSIS (ICCAD), 2017, : 528 - 533
  • [42] A lightweight encoder-decoder network for automatic pavement crack detection
    Zhu, Guijie
    Liu, Jiacheng
    Fan, Zhun
    Yuan, Duan
    Ma, Peili
    Wang, Meihua
    Sheng, Weihua
    Wang, Kelvin C. P.
    COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2024, 39 (12) : 1743 - 1765
  • [43] Pavement crack detection from CCD images with a locally enhanced transformer network
    Xu, Zhengsen
    Guan, Haiyan
    Kang, Jian
    Lei, Xiangda
    Ma, Lingfei
    Yu, Yongtao
    Chen, Yiping
    Li, Jonathan
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2022, 110
  • [44] Automatic Detection of Asphalt Pavement Crack Width Based on Machine Vision
    Tao, Rui
    Peng, Rui
    Jin, Yong
    Gong, Fangyuan
    Li, Bo
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2025, 26 (01) : 484 - 496
  • [45] Automatic crack detection algorithm for airport pavement based on depth image
    Li H.-F.
    Wu Z.-L.
    Nie J.-J.
    Peng B.
    Gui Z.-C.
    Jiaotong Yunshu Gongcheng Xuebao/Journal of Traffic and Transportation Engineering, 2020, 20 (06): : 250 - 260
  • [46] Research on Automatic Classification and Detection of Mutton Multi-Parts Based on Swin-Transformer
    Zhao, Shida
    Bai, Zongchun
    Wang, Shucai
    Gu, Yue
    FOODS, 2023, 12 (08)
  • [47] An Automatic Image Processing Algorithm Based on Crack Pixel Density for Pavement Crack Detection and Classification
    Safaei, Nima
    Smadi, Omar
    Masoud, Arezoo
    Safaei, Babak
    INTERNATIONAL JOURNAL OF PAVEMENT RESEARCH AND TECHNOLOGY, 2022, 15 (01) : 159 - 172
  • [48] An Automatic Image Processing Algorithm Based on Crack Pixel Density for Pavement Crack Detection and Classification
    Nima Safaei
    Omar Smadi
    Arezoo Masoud
    Babak Safaei
    International Journal of Pavement Research and Technology, 2022, 15 : 159 - 172
  • [49] Vison Transformer-Based Automatic Crack Detection on Dam Surface
    Zhou, Jian
    Zhao, Guochuan
    Li, Yonglong
    WATER, 2024, 16 (10)
  • [50] Ensemble of Deep Convolutional Neural Networks for Automatic Pavement Crack Detection and Measurement
    Fan, Zhun
    Li, Chong
    Chen, Ying
    Di Mascio, Paola
    Chen, Xiaopeng
    Zhu, Guijie
    Loprencipe, Giuseppe
    COATINGS, 2020, 10 (02)