Network Fault Lightweight Prediction Algorithm Based on Continuous Knowledge Distillation

被引:0
|
作者
Huang, Wei [1 ,2 ]
Huang, Jie [1 ]
Fan, Chengwen [3 ]
Yang, Yang [3 ]
机构
[1] Southeast Univ, Sch Cyber Sci & Engn, Nanjing, Jiangsu, Peoples R China
[2] CETC, Res Inst 54, Shijiazhuang, Hebei, Peoples R China
[3] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing, Peoples R China
关键词
Knowledge distillation; Fault prediction; Lightweight method; BiLSTM;
D O I
10.1007/978-981-99-9247-8_31
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Network fault prediction is one of the important means to ensure network security and stable operation. Efficient fault prediction can improve the ability of operation and maintenance personnel to deal with faults and reduce losses caused by faults. In edge scenarios, device resources may be limited by hardware resources, such as storage space, memory, processing power. They may also be limited by unstable network connections, such as limited bandwidth, high packet loss rate, and large delay. This paper investigates the research status of network fault prediction at home and abroad. Currently, commonly used network fault prediction methods include methods based on statistics, based on machine learning, and based on deep learning. These network fault prediction methods can learn the characteristics of network faults and have achieved good results in network fault prediction tasks. However, the methods based on neural networks have a large computational resource overhead and are easily limited by device performance in edge scenarios. The methods based on statistics and machine learning have low cost but low accuracy. In this paper, an edge side network fault prediction model based on improved BiLSTM is designed, and improve the continuous distillation technology to design Stage Continuous Knowledge Distillation (SCKD). The simulation experiments prove that the student model performs similarly to the teacher model in terms of accuracy and F1-Score, and has lower memory usage and parameter volume.
引用
收藏
页码:316 / 325
页数:10
相关论文
共 50 条
  • [1] Lightweight Spectrum Prediction Based on Knowledge Distillation
    Cheng, Runmeng
    Zhang, Jianzhao
    Deng, Junquan
    Zhu, Yanping
    [J]. RADIOENGINEERING, 2023, 32 (04) : 469 - 478
  • [2] Network lightweight method based on knowledge distillation is applied to RV reducer fault diagnosis
    He, Feifei
    Liu, Chang
    Wang, Mengdi
    Yang, Enshan
    Liu, Xiaoqin
    [J]. MEASUREMENT SCIENCE AND TECHNOLOGY, 2023, 34 (09)
  • [3] A lightweight crack segmentation network based on knowledge distillation
    Wang, Wenjun
    Su, Chao
    Han, Guohui
    Zhang, Heng
    [J]. JOURNAL OF BUILDING ENGINEERING, 2023, 76
  • [4] Lightweight Tunnel Defect Detection Algorithm Based on Knowledge Distillation
    Zhu, Anfu
    Wang, Bin
    Xie, Jiaxiao
    Ma, Congxiao
    [J]. ELECTRONICS, 2023, 12 (15)
  • [5] Lightweight Edge-side Fault Diagnosis Based on Knowledge Distillation
    Shang, Yingjun
    Feng, Tao
    Huo, Yonghua
    Duan, Yongcun
    Long, Yuhan
    [J]. 2022 IEEE 14TH INTERNATIONAL CONFERENCE ON ADVANCED INFOCOMM TECHNOLOGY (ICAIT 2022), 2022, : 348 - 353
  • [6] Lightweight fault diagnosis method in embedded system based on knowledge distillation
    Gong, Ran
    Wang, Chenlin
    Li, Jinxiao
    Xu, Yi
    [J]. JOURNAL OF MECHANICAL SCIENCE AND TECHNOLOGY, 2023, 37 (11) : 5649 - 5660
  • [7] Lightweight fault diagnosis method in embedded system based on knowledge distillation
    Ran Gong
    Chenlin Wang
    Jinxiao Li
    Yi Xu
    [J]. Journal of Mechanical Science and Technology, 2023, 37 : 5649 - 5660
  • [8] Yarn state detection based on lightweight network and knowledge distillation
    Ren G.
    Tu J.
    Li Y.
    Qiu Z.
    Shi W.
    [J]. Fangzhi Xuebao/Journal of Textile Research, 2023, 44 (09): : 205 - 212
  • [9] Lightweight Network Traffic Classification Model Based on Knowledge Distillation
    Wu, Yanhui
    Zhang, Meng
    [J]. WEB INFORMATION SYSTEMS ENGINEERING - WISE 2021, PT II, 2021, 13081 : 107 - 121
  • [10] KDSMALL: A lightweight small object detection algorithm based on knowledge distillation
    Zhou, Wen
    Wang, Xiaodon
    Fan, Yusheng
    Yang, Yishuai
    Wen, Yihan
    Li, Yixuan
    Xu, Yicheng
    Lin, Zhengyuan
    Chen, Langlang
    Yao, Shizhou
    Zequn, Liu
    Wang, Jianqing
    [J]. COMPUTER COMMUNICATIONS, 2024, 219 : 271 - 281