Identification of internal voids in pavement based on improved knowledge distillation technology

被引:1
|
作者
Kan, Qian [1 ,2 ]
Liu, Xing [2 ]
Meng, Anxin [2 ]
Yu, Li [1 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Elect Informat & Commun, Wuhan 430074, Peoples R China
[2] Shenzhen Urban Transport Planning Ctr Co LTD, Shenzhen 518057, Peoples R China
关键词
Asphalt pavement; Ground penetrating radar; Void; Improved knowledge distillation; Intelligent recognition;
D O I
10.1016/j.cscm.2024.e03555
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Investigating methods for the detection of internal voids within road structures is a critical measure to ensure the safety and integrity of roadway operations. The purpose of this research is to investigate on the identification method of internal voids in pavement based on improved knowledge distillation technology. Ground penetrating radar data in three dimensions were extensively collected to capture the internal voids present within roadways, and this data was subsequently validated through in-situ verification. The echo characteristics of ground penetrating radar for areas with road voids were analyzed, and a dataset containing 1700 images of these internal voids was established. A YOLOv8 model improvement method was proposed, and a model for the detection of internal road voids was constructed based on the improved YOLO v8 framework. To further refine the model's performance, a knowledge distillation method based on multiple guidance from teacher assistants was developed. A stochastic learning approach was integrated, resulting in the establishment of a model optimized by this stochastic learning scheme for the identification of internal road voids. The results demonstrate that the presence of overfitting during the training phase of the void identification model can restrict its performance within a certain domain. The proposed stochastic learning-optimized, multi-teacher assistant guided knowledge distillation model, adeptly harnesses the performance benefits of both the teacher and assistant models by means of knowledge transfer, consequently achieving a significant improvement in the detection of internal road voids.
引用
收藏
页数:23
相关论文
共 50 条
  • [21] Improved Zero-Knowledge Identification with Improved Zero-Knowledge Identification with Lattices
    Cayrel, Pierre-Louis
    Lindner, Richard
    Rueckert, Markus
    Silva, Rosemberg
    PROVABLE SECURITY, 2010, 6402 : 1 - +
  • [22] Improved Knowledge Distillation for Crowd Counting on IoT Devices
    Huang, Zuo
    Sinnott, Richard O.
    2023 IEEE INTERNATIONAL CONFERENCE ON EDGE COMPUTING AND COMMUNICATIONS, EDGE, 2023, : 207 - 214
  • [23] KNOWLEDGE DISTILLATION FOR IMPROVED ACCURACY IN SPOKEN QUESTION ANSWERING
    You, Chenyu
    Chen, Nuo
    Zou, Yuexian
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 7793 - 7797
  • [24] Ensemble Knowledge Distillation for Learning Improved and Efficient Networks
    Asif, Umar
    Tang, Jianbin
    Harrer, Stefan
    ECAI 2020: 24TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, 325 : 953 - 960
  • [25] Improved knowledge distillation method with curriculum learning paradigm
    Zhang S.
    Wang C.
    Yang K.
    Luo X.
    Wu C.
    Li Q.
    Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2022, 28 (07): : 2075 - 2082
  • [26] A Highway Pavement Crack Identification Method Based on an Improved U-Net Model
    Wu, Qinge
    Song, Zhichao
    Chen, Hu
    Lu, Yingbo
    Zhou, Lintao
    APPLIED SCIENCES-BASEL, 2023, 13 (12):
  • [27] An Improved Crack Identification Method for Asphalt Concrete Pavement
    Li, Yongshang
    Yang, Nan
    APPLIED SCIENCES-BASEL, 2023, 13 (15):
  • [28] Knowledge Distillation Approach for Efficient Internal Language Model Estimation
    Chen, Zhipeng
    Xu, Haihua
    Khassanov, Yerbolat
    He, Yi
    Lu, Lu
    Ma, Zejun
    Wu, Ji
    INTERSPEECH 2023, 2023, : 1339 - 1343
  • [29] Visual Relationship Detection with Internal and External Linguistic Knowledge Distillation
    Yu, Ruichi
    Li, Ang
    Morariu, Vlad I.
    Davis, Larry S.
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 1068 - 1076
  • [30] Rare and Endangered Plant Leaf Identification Method Based on Transfer Learning and Knowledge Distillation
    Wu, Lin
    Yang, Jingjing
    Gu, Zhihao
    Guo, Jiaqian
    Zhang, Xiao
    INTERNATIONAL JOURNAL OF AGRICULTURAL AND ENVIRONMENTAL INFORMATION SYSTEMS, 2021, 12 (04)