Tr-Predictior: An Ensemble Transfer Learning Model for Small-Sample Cloud Workload Prediction

被引:5
|
作者
Liu, Chunhong [1 ,2 ]
Jiao, Jie [1 ]
Li, Weili [1 ]
Wang, Jingxiong [1 ]
Zhang, Junna [1 ,2 ]
机构
[1] Henan Normal Univ, Coll Comp & Informat Engn, Xinxiang 453007, Peoples R China
[2] Engn Lab Intelligence Business, Xinxiang 453007, Peoples R China
基金
中国国家自然科学基金;
关键词
cloud data center; transfer entropy; workload forecast; ensemble learning; transfer learning; NEURAL-NETWORKS; FRAMEWORK; ERROR;
D O I
10.3390/e24121770
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Accurate workload prediction plays a key role in intelligent scheduling decisions on cloud platforms. There are massive amounts of short-workload sequences in the cloud platform, and the small amount of data and the presence of outliers make accurate workload sequence prediction a challenge. For the above issues, this paper proposes an ensemble learning method based on sample weight transfer and long short-term memory (LSTM), termed as Tr-Predictor. Specifically, a selection method of similar sequences combining time warp edit distance (TWED) and transfer entropy (TE) is proposed to select a source domain dataset with higher similarity for the target workload sequence. Then, we upgrade the basic learner of the ensemble model two-stage TrAdaBoost.R2 to LSTM in the deep model and enhance the ability of the ensemble model to extract sequence features. To optimize the weight adjustment strategy, we adopt a two-stage weight adjustment strategy and select the best weight for the learner according to the sample error and model error. Finally, the above process determines the parameters of the target model and uses the target model to predict the short-task sequences. In the experimental validation, we arbitrarily select nine sets of short-workload data from the Google dataset and three sets of short-workload data from the Alibaba cluster to verify the prediction effectiveness of the proposed algorithm. The experimental results show that compared with the commonly used cloud workload prediction methods Tr-Predictor has higher prediction accuracy on the small-sample workload. The prediction indicators of the ablation experiments show the performance gain of each part in the proposed method.
引用
收藏
页数:17
相关论文
共 50 条
  • [41] A novel DL-BiGRU multi-feature fusion and deep transfer learning based modeling approach for quality prediction of injection molded products using small-sample datasets
    Qian, Qingjie
    Yu, Junhe
    Zhan, Hongfei
    Wang, Rui
    JOURNAL OF MANUFACTURING PROCESSES, 2024, 120 : 272 - 285
  • [42] Prediction for Lateral Response of Monopiles: Deep Learning Model on Small Datasets Using Transfer Learning
    Alduais, Mohammed
    Taherkhani, Amir Hosein
    Mei, Qipei
    Han, Fei
    GEO-CONGRESS 2024: FOUNDATIONS, RETAINING STRUCTURES, GEOSYNTHETICS, AND UNDERGROUND ENGINEERING, 2024, 350 : 1 - 7
  • [43] Insulator Breakage Detection Utilizing a Convolutional Neural Network Ensemble Implemented With Small Sample Data Augmentation and Transfer Learning
    She, Lingcong
    Fan, Yadong
    Xu, Mengxi
    Wang, Jianguo
    Xue, Jian
    Ou, Jianhua
    IEEE TRANSACTIONS ON POWER DELIVERY, 2022, 37 (04) : 2787 - 2796
  • [44] Deep learning models for enhancing potato leaf disease prediction: Implementation of transfer learning based stacking ensemble model
    Jha, Pradeep
    Dembla, Deepak
    Dubey, Widhi
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (13) : 37839 - 37858
  • [45] Deep learning models for enhancing potato leaf disease prediction: Implementation of transfer learning based stacking ensemble model
    Jha, Pradeep
    Dembla, Deepak
    Dubey, Widhi
    Multimedia Tools and Applications, 2024, 83 (13) : 37839 - 37858
  • [46] Deep learning models for enhancing potato leaf disease prediction: Implementation of transfer learning based stacking ensemble model
    Pradeep Jha
    Deepak Dembla
    Widhi Dubey
    Multimedia Tools and Applications, 2024, 83 : 37839 - 37858
  • [47] Developing an Explainable Machine Learning-Based Personalised Dementia Risk Prediction Model: A Transfer Learning Approach With Ensemble Learning Algorithms
    Danso, Samuel O.
    Zeng, Zhanhang
    Muniz-Terrera, Graciela
    Ritchie, Craig W.
    FRONTIERS IN BIG DATA, 2021, 4
  • [48] Leveraging small-sample machine learning for rigorous prediction of JOA recovery in cervical spondylotic myelopathy patients: insights from imaging parameters and modeling strategies
    Li, Zhangfu
    Feng, Zihe
    Yang, Honghao
    Hai, Yong
    EUROPEAN SPINE JOURNAL, 2025,
  • [49] Transfer Learning Enhanced Gaussian Process Model for Surface Roughness Prediction with Small Data
    Hu, L.
    Gao, R.
    Guo, Y. B.
    MANUFACTURING LETTERS, 2023, 35 : 1103 - 1108
  • [50] Transfer Learning Enhanced Gaussian Process Model for Surface Roughness Prediction with Small Data
    Hu, L.
    Gao, R.
    Guo, Y. B.
    MANUFACTURING LETTERS, 2023, 35 : 1103 - 1108