Pavement crack detection network based on pyramid structure and attention mechanism

被引:62
|
作者
Xiang, Xuezhi [1 ]
Zhang, Yuqi [1 ]
El Saddik, Abdulmotaleb [2 ]
机构
[1] Harbin Engn Univ, Sch Informat & Commun Engn, Harbin 150001, Peoples R China
[2] Univ Ottawa, Sch Elect Engn & Comp Sci, Ottawa, ON K1N 6N5, Canada
基金
黑龙江省自然科学基金; 中国国家自然科学基金;
关键词
learning (artificial intelligence); object detection; crack detection; roads; structural engineering computing; image recognition; cracks; maintenance engineering; convolutional neural nets; intelligent transportation systems; pavement crack detection network; pyramid structure; attention mechanism; automatic pavement crack detection; surrounding pavement; spatial-channel combinational attention module; crack features; CRACK500; dataset; pavement crack datasets; encoder-decoder network; road maintenance; encoder-decoder architecture; end-to-end trainable deep convolution neural network; complex topology structures; pooling operation; intelligent transportation system;
D O I
10.1049/iet-ipr.2019.0973
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatic detection of pavement crack is an important task for conducting road maintenance. However, as an important part of the intelligent transportation system, automatic pavement crack detection is challenging due to the poor continuity of cracks, the different width of cracks, and the low contrast between cracks and the surrounding pavement. This study proposes a novel pavement crack detection method based on an end-to-end trainable deep convolution neural network. The authors build the network using the encoder-decoder architecture and adopt a pyramid module to exploit global context information for the complex topology structures of cracks. Moreover, they introduce a spatial-channel combinational attention module into the encoder-decoder network for refining crack features. Further, the dilated convolution is used to reduce the loss of crack details due to the pooling operation in the encoder network. In addition, they introduce a lovasz hinge loss function, which is suitable for small objects. They train the authors' network on the CRACK500 dataset and evaluate it on three pavement crack datasets. Among the methods they compare, their method can achieve the best experimental results.
引用
收藏
页码:1580 / 1586
页数:7
相关论文
共 50 条
  • [1] Method of feature pyramid and attention enhancement network for pavement crack detection
    Qu, Zhong
    Dong, Xiao-Yu
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (03)
  • [2] A novel transformer-based network with attention mechanism for automatic pavement crack detection
    Guo, Feng
    Liu, Jian
    Lv, Chengshun
    Yu, Huayang
    [J]. CONSTRUCTION AND BUILDING MATERIALS, 2023, 391
  • [3] Convolutional Neural Network-Based Pavement Crack Segmentation Using Pyramid Attention Network
    Wang, Wenjun
    Su, Chao
    [J]. IEEE ACCESS, 2020, 8 : 206548 - 206558
  • [4] Pavement Crack Detection with Deep Learning Based on Attention Mechanism
    Cao J.
    Yang G.
    Yang X.
    [J]. 1600, Institute of Computing Technology (32): : 1324 - 1333
  • [5] Feature Pyramid and Hierarchical Boosting Network for Pavement Crack Detection
    Yang, Fan
    Zhang, Lei
    Yu, Sijia
    Prokhorov, Danil
    Mei, Xue
    Ling, Haibin
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (04) : 1525 - 1535
  • [6] Attention-Based Convolutional Neural Network for Pavement Crack Detection
    Wan, Haifeng
    Gao, Lei
    Su, Manman
    Sun, Qirun
    Huang, Lei
    [J]. ADVANCES IN MATERIALS SCIENCE AND ENGINEERING, 2021, 2021
  • [7] Automatic Pavement Crack Detection Fusing Attention Mechanism
    Ren, Junhua
    Zhao, Guowu
    Ma, Yadong
    Zhao, De
    Liu, Tao
    Yan, Jun
    [J]. ELECTRONICS, 2022, 11 (21)
  • [8] An attention-based progressive fusion network for pixelwise pavement crack detection
    Ma, Mingyang
    Yang, Lei
    Liu, Yanhong
    Yu, Hongnian
    [J]. MEASUREMENT, 2024, 226
  • [9] Road Crack Detection Using Deep Neural Network Based on Attention Mechanism and Residual Structure
    Jing, Peng
    Yu, Haiyang
    Hua, Zhihua
    Xie, Saifei
    Song, Caoyuan
    [J]. IEEE ACCESS, 2023, 11 : 919 - 929
  • [10] Pavement crack detection based on transformer network
    Guo, Feng
    Qian, Yu
    Liu, Jian
    Yu, Huayang
    [J]. AUTOMATION IN CONSTRUCTION, 2023, 145