A Deeply Supervised Convolutional Neural Network for Pavement Crack Detection With Multiscale Feature Fusion

被引:78
|
作者
Qu, Zhong [1 ]
Cao, Chong [1 ]
Liu, Ling [2 ]
Zhou, Dong-Yang [2 ]
机构
[1] Chongqing Univ Posts & Telecommunicat, Coll Comp Sci & Technol, Chongqing 400065, Peoples R China
[2] Chongqing Univ Posts & Telecommunicat, Coll Mobile Telecommunicat, Chongqing 401520, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Convolution; Semantics; Image edge detection; Convolutional neural networks; Learning systems; Training; Convolutional neural networks (CNNs); deep supervision; multiscale feature fusion; pavement crack detection;
D O I
10.1109/TNNLS.2021.3062070
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatic crack detection is vital for efficient and economical road maintenance. With the explosive development of convolutional neural networks (CNNs), recent crack detection methods are mostly based on CNNs. In this article, we propose a deeply supervised convolutional neural network for crack detection via a novel multiscale convolutional feature fusion module. Within this multiscale feature fusion module, the high-level features are introduced directly into the low-level features at different convolutional stages. Besides, deep supervision provides integrated direct supervision for convolutional feature fusion, which is helpful to improve model convergency and final performance of crack detection. Multiscale convolutional features learned at different convolution stages are fused together to robustly represent cracks, whose geometric structures are complicated and hardly captured by single-scale features. To demonstrate its superiority and generalizability, we evaluate the proposed network on three public crack data sets, respectively. Sufficient experimental results demonstrate that our method outperforms other state-of-the-art crack detection, edge detection, and image segmentation methods in terms of F1-score and mean IU.
引用
收藏
页码:4890 / 4899
页数:10
相关论文
共 50 条
  • [21] A Lightweight Network with Dual Encoder and Cross Feature Fusion for Cement Pavement Crack Detection
    Qu, Zhong
    Mu, Guoqing
    Yuan, Bin
    [J]. CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2024, 140 (01): : 255 - 273
  • [22] Hierarchical Convolutional Neural Network With Feature Preservation and Autotuned Thresholding for Crack Detection
    Zhu, Qiuchen
    Dinh, Tran Hiep
    Phung, Manh Duong
    Ha, Quang Phuc
    [J]. IEEE ACCESS, 2021, 9 : 60201 - 60214
  • [23] A lightweight feature attention fusion network for pavement crack segmentation
    Huang, Yucheng
    Liu, Yuchen
    Liu, Fang
    Liu, Wei
    [J]. COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2024, 39 (18) : 2811 - 2825
  • [24] Deeply supervised convolutional neural network for shadow detection based on a novel aerial shadow imagery dataset
    Luo, Shuang
    Li, Huifang
    Shen, Huanfeng
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 167 : 443 - 457
  • [25] A High-Stability Diagnosis Model Based on a Multiscale Feature Fusion Convolutional Neural Network
    Wang, Pengxin
    Song, Liuyang
    Guo, Xudong
    Wang, Huaqing
    Cui, Lingli
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [26] Automatic pavement crack detection using multimodal features fusion deep neural network
    Zhai, Junzhi
    Sun, Zhaoyun
    Huyan, Ju
    Yang, Handuo
    Li, Wei
    [J]. INTERNATIONAL JOURNAL OF PAVEMENT ENGINEERING, 2023, 24 (02)
  • [27] Gabor filter fusion network for pavement crack detection
    Chen Xiao-Dong
    Ai Da-Hang
    Zhang Jia-Chen
    Cai Huai-Yu
    Cui Ke-Rang
    [J]. CHINESE OPTICS, 2020, 13 (06) : 1293 - 1301
  • [28] Feature fusion method based on spiking neural convolutional network for edge detection
    Xian, Ronghao
    Xiong, Xin
    Peng, Hong
    Wang, Jun
    Marrero, Antonio Ramirez de Arellano
    Yang, Qian
    [J]. PATTERN RECOGNITION, 2024, 147
  • [29] Feature Cloning and Feature Fusion Based Transportation Mode Detection Using Convolutional Neural Network
    Alam, Md. Golam Rabiul
    Haque, Mahmudul
    Hassan, Md. Rafiul
    Huda, Shamsul
    Hassan, Mohammad Mehedi
    Strickland, Fred L. L.
    AlQahtani, Salman A. A.
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (04) : 4671 - 4681
  • [30] CrackU-net: A novel deep convolutional neural network for pixelwise pavement crack detection
    Ju, Huyan
    Li, Wei
    Tighe, Susan
    Xu, Zhengchao
    Zhai, Junzhi
    [J]. STRUCTURAL CONTROL & HEALTH MONITORING, 2020, 27 (08):