E2LG: a multiscale ensemble of LSTM/GAN deep learning architecture for multistep-ahead cloud workload prediction

被引:27
|
作者
Yazdanian, Peyman [1 ]
Sharifian, Saeed [1 ]
机构
[1] Amirkabir Univ Technol, Dept Elect Engn, Tehran 15914, Iran
来源
JOURNAL OF SUPERCOMPUTING | 2021年 / 77卷 / 10期
关键词
Cloud computing; Workload prediction; EMD; LSTM; ConvNet; GAN; MODEL; ARIMA; EMD;
D O I
10.1007/s11227-021-03723-6
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Efficient resource demand prediction and management are two main challenges for cloud service providers in order to control dynamic autoscaling and power consumption in recent years. The behavior of cloud workload time-series at subminute scale is highly chaotic and volatile; therefore, traditional machine learning-based time-series analysis approaches fail to obtain accurate predictions. In recent years, deep learning-based schemes are suggested to predict highly nonlinear cloud workloads, but sometimes they fail to obtain excellent prediction results. Hence, demands for more accurate prediction algorithm exist. In this paper, we address this issue by proposing a hybrid E2LG algorithm, which decomposes the cloud workload time-series into its constituent components in different frequency bands using empirical mode decomposition method which reduces the complexity and nonlinearity of prediction model in each frequency band. Also, a new state-of-the-art ensemble GAN/LSTM deep learning architecture is proposed to predict each sub band workload time-series individually, based on its degree of complexity and volatility. Our novel ensemble GAN/LSTM architecture, which employs stacked LSTM blocks as its generator and 1D ConvNets as discriminator, can exploit the long-term nonlinear dependencies of cloud workload time-series effectively specially in high-frequency, noise-like components. By validating our approach using extensive set of experiments with standard real cloud workload traces, we confirm that E2LG provides significant improvements in cloud workload prediction accuracy with respect to the mean absolute and standard deviation of the prediction error and outperforming traditional and state-of-the-art deep learning approaches. It improves the prediction accuracy at least 5% and 12% in average compared to the main contemporary approaches in recent papers such as hybrid methods which employs CNN, LSTM or SVR.
引用
收藏
页码:11052 / 11082
页数:31
相关论文
共 4 条
  • [1] E2LG: a multiscale ensemble of LSTM/GAN deep learning architecture for multistep-ahead cloud workload prediction
    Peyman Yazdanian
    Saeed Sharifian
    [J]. The Journal of Supercomputing, 2021, 77 : 11052 - 11082
  • [2] Ensemble CNN Attention-Based BiLSTM Deep Learning Architecture for Multivariate Cloud Workload Prediction
    Kaim, Ananya
    Singh, Surjit
    Patel, Yashwant Singh
    [J]. PROCEEDINGS OF THE 24TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING AND NETWORKING, ICDCN 2023, 2023, : 342 - 348
  • [3] Resource Management Through Workload Prediction Using Deep Learning in Fog-Cloud Architecture
    Yadav, Pratibha
    Vidyarthi, Deo Prakash
    [J]. SOFT COMPUTING AND ITS ENGINEERING APPLICATIONS, PT 2, ICSOFTCOMP 2023, 2024, 2031 : 258 - 269
  • [4] Distributed edge to cloud ensemble deep learning architecture to diagnose Covid-19 from lung image in IoT based e-Health system
    Zamani, Mohammadreza
    Sharifian, Saeed
    [J]. JOURNAL OF SUPERCOMPUTING, 2024, 80 (13): : 18492 - 18520