Network Traffic Prediction Based on LSTM and Transfer Learning

被引:16
|
作者
Wan, Xianbin [1 ]
Liu, Hui [1 ]
Xu, Hao [1 ]
Zhang, Xinchang [2 ]
机构
[1] Qilu Univ Technol, Shandong Acad Sci, Shandong Comp Sci Ctr, Natl Supercomp Ctr Jinan, Jinan 250014, Peoples R China
[2] Qilu Univ Technol, Shandong Acad Sci, Coll Comp Sci & Technol, Jinan 250306, Peoples R China
基金
中国国家自然科学基金;
关键词
Telecommunication traffic; Transfer learning; Predictive models; Data models; Task analysis; Neural networks; Autoregressive processes; LSTM; network traffic prediction; transfer learning;
D O I
10.1109/ACCESS.2022.3199372
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The increasing amount of traffic in recent years has led to increasingly complex network problems. To be able to improve overall network performance and increase network utilization, it is valuable to take measures to capture future trends in network traffic. In traditional machine learning, to guarantee the accuracy and high reliability of the models obtained through training, there are two basic assumptions: (1) the training samples used for learning and the new test samples satisfy the condition of independent identical distribution; and (2) there must be enough training samples to learn a good model. However, time-series data are not easily accessible in real life, and even after putting in a lot of time and effort to collect them, the data may be unavailable due to confidentiality. In this paper, a neural network model based on long and short-term memory (LSTM) and transfer learning is proposed to address the problem of small sample size in network traffic prediction. Knowledge in the source domain is transferred to the target domain using transfer learning, and a prediction model with good performance is constructed with a small amount of target domain data. The results show that the performance of the transfer learning model improves by more than 40% over the direct training model when using the same samples for predicting 10,000 rows of data, resulting in better performance of the network traffic prediction task.
引用
收藏
页码:86181 / 86190
页数:10
相关论文
共 50 条
  • [21] Deep Convolutional LSTM Network-based Traffic Matrix Prediction with Partial Information
    Van An Le
    Phi Le Nguyen
    Ji, Yusheng
    2019 IFIP/IEEE SYMPOSIUM ON INTEGRATED NETWORK AND SERVICE MANAGEMENT (IM), 2019, : 261 - 269
  • [22] Migration and Energy Aware Network Traffic Prediction Method Based on LSTM in NFV Environment
    Hu, Ying
    Zhu, Liang
    Zhang, Jianwei
    Cai, Zengyu
    Han, Jihui
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2023, 17 (03): : 896 - 915
  • [23] Prediction of Ship Traffic Flow Based on RF-Bidirectional LSTM Neural Network
    Sun, Xiaocong
    Yu, Chen
    Fu, Yuhui
    Zhang, Yifei
    SIXTH INTERNATIONAL CONFERENCE ON ELECTROMECHANICAL CONTROL TECHNOLOGY AND TRANSPORTATION (ICECTT 2021), 2022, 12081
  • [24] Leveraging Graph Neural Network With LSTM For Traffic Speed Prediction
    Lu, Zhilong
    Lv, Weifeng
    Xie, Zhipu
    Du, Bowen
    Huang, Runhe
    2019 IEEE SMARTWORLD, UBIQUITOUS INTELLIGENCE & COMPUTING, ADVANCED & TRUSTED COMPUTING, SCALABLE COMPUTING & COMMUNICATIONS, CLOUD & BIG DATA COMPUTING, INTERNET OF PEOPLE AND SMART CITY INNOVATION (SMARTWORLD/SCALCOM/UIC/ATC/CBDCOM/IOP/SCI 2019), 2019, : 74 - 81
  • [25] Internet traffic matrix prediction with convolutional LSTM neural network
    Jiang, Weiwei
    INTERNET TECHNOLOGY LETTERS, 2022, 5 (02)
  • [26] Developing machine learning based framework for the network traffic prediction
    Murugesan, G.
    Jaiswal, Rachana
    Kshatri, Sapna Singh
    Bhonsle, Devanand
    INTERNATIONAL JOURNAL OF NEXT-GENERATION COMPUTING, 2022, 13 (03): : 777 - 784
  • [27] Deep Learning-Based Traffic Prediction for Network Optimization
    Troia, Sebastian
    Alvizu, Rodolfo
    Zhou, Youduo
    Maier, Guido
    Pattavina, Achille
    2018 20TH ANNIVERSARY INTERNATIONAL CONFERENCE ON TRANSPARENT OPTICAL NETWORKS (ICTON), 2018,
  • [28] A Hybrid Prediction Method for Realistic Network Traffic With Temporal Convolutional Network and LSTM
    Bi, Jing
    Zhang, Xiang
    Yuan, Haitao
    Zhang, Jia
    Zhou, MengChu
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2022, 19 (03) : 1869 - 1879
  • [29] Short-term traffic flow prediction based on optimized deep learning neural network: PSO-Bi-LSTM
    Bharti, Poonam
    Redhu, Poonam
    Kumar, Kranti
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2023, 625
  • [30] Designing a hybrid model for stock marketing prediction based on LSTM and transfer learning
    Rameh, Tahereh
    Abbasi, Rezvan
    Sanaei, Mohamadreza
    INTERNATIONAL JOURNAL OF NONLINEAR ANALYSIS AND APPLICATIONS, 2021, 12 : 2325 - 2337