Three-Stage Pavement Crack Localization and Segmentation Algorithm Based on Digital Image Processing and Deep Learning Techniques

被引:20
|
作者
Yang, Zhen [1 ]
Ni, Changshuang [1 ]
Li, Lin [1 ,2 ]
Luo, Wenting [2 ]
Qin, Yong [3 ]
机构
[1] Fujian Agr & Forestry Univ, Coll Transportat & Civil Engn, Fuzhou 350108, Peoples R China
[2] Nanjing Tech Univ, Coll Transportat Engn, Nanjing 211816, Peoples R China
[3] Beijing Jiaotong Univ, Sch Traff & Transportat, Beijing 100044, Peoples R China
关键词
digital image processing technology; asphalt pavement crack; deep learning; guided filter; Retinex; YOLOv7; attention mechanism; DAMAGE DETECTION; NEURAL-NETWORK;
D O I
10.3390/s22218459
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
The image of expressway asphalt pavement crack disease obtained by a three-dimensional line scan laser is easily affected by external factors such as uneven illumination distribution, environmental noise, occlusion shadow, and foreign bodies on the pavement. To locate and extract cracks accurately and efficiently, this article proposes a three-stage asphalt pavement crack location and segmentation method based on traditional digital image processing technology and deep learning methods. In the first stage of this method, the guided filtering and Retinex methods are used to preprocess the asphalt pavement crack image. The processed image removes redundant noise information and improves the brightness. At the information entropy level, it is 63% higher than the unpreprocessed image. In the second stage, the newly proposed YOLO-SAMT target detection model is used to locate the crack diseases in asphalt pavement. The model is 5.42 percentage points higher than the original YOLOv7 model on mAP@0.5, which enhances the recognition and location ability of crack diseases and reduces the calculation amount for the extraction of crack contour in the next stage. In the third stage, the improved k-means clustering algorithm is used to extract cracks. Compared with the traditional k-means clustering algorithm, this method improves the accuracy by 7.34 percentage points, the true rate by 6.57 percentage points, and the false positive rate by 18.32 percentage points to better extract the crack contour. To sum up, the method proposed in this article improves the quality of the pavement disease image, enhances the ability to identify and locate cracks, reduces the amount of calculation, improves the accuracy of crack contour extraction, and provides a new solution for highway crack inspection.
引用
收藏
页数:31
相关论文
共 50 条
  • [1] Automatic coronary artery segmentation algorithm based on deep learning and digital image processing
    Tian, Fangzheng
    Gao, Yongbin
    Fang, Zhijun
    Gu, Jia
    APPLIED INTELLIGENCE, 2021, 51 (12) : 8881 - 8895
  • [2] Automatic coronary artery segmentation algorithm based on deep learning and digital image processing
    Fangzheng Tian
    Yongbin Gao
    Zhijun Fang
    Jia Gu
    Applied Intelligence, 2021, 51 : 8881 - 8895
  • [3] A three-stage pavement image crack detection framework with positive sample augmentation
    Song, Qingsong
    Liu, Liming
    Lu, Na
    Zhang, Yan
    Muniyandi, Ravie Chandren
    An, Yisheng
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 129
  • [4] Pavement Crack Image Detection based on Deep Learning
    Lyu, Peng-hui
    Wang, Jun
    Wei, Rui-yuan
    ICDLT 2019: 2019 3RD INTERNATIONAL CONFERENCE ON DEEP LEARNING TECHNOLOGIES, 2019, : 6 - 10
  • [5] Pavement crack detection algorithm based on image processing analysis
    Zhu Qingbo
    2016 8TH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS (IHMSC), VOL. 1, 2016, : 15 - 18
  • [6] A Three-Stage Deep Learning Model for Accurate Retinal Vessel Segmentation
    Yan, Zengqiang
    Yang, Xin
    Cheng, Kwang-Ting
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2019, 23 (04) : 1427 - 1436
  • [7] A three-stage deep-learning-based method for crack detection of high-resolution steel box girder image
    Meng, Shiqiao
    Gao, Zhiyua
    Zhou, Ying
    He, Bin
    Kong, Qingzhao
    SMART STRUCTURES AND SYSTEMS, 2022, 29 (01) : 29 - 39
  • [8] A New Three-stage Curriculum Learning Approach for Deep Network Based Liver Tumor Segmentation
    Li, Huiyu
    Liu, Xiabi
    Boumaraf, Said
    Liu, Weihua
    Gong, Xiaopeng
    Ma, Xiaohong
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [9] Crack Segmentation Extraction and Parameter Calculation of Asphalt Pavement Based on Image Processing
    Li, Zhongbo
    Yin, Chao
    Zhang, Xixuan
    SENSORS, 2023, 23 (22)
  • [10] Tunnel Crack Detection Method and Crack Image Processing Algorithm Based on Improved Retinex and Deep Learning
    Wu, Jie
    Zhang, Xiaoqian
    SENSORS, 2023, 23 (22)