Imitation learning enabled fast and adaptive task scheduling in cloud

被引:1
|
作者
Kang, KaiXuan [2 ]
Ding, Ding [1 ,2 ]
Xie, HuaMao [2 ]
Zhao, LiHong [2 ]
Li, YiNong [2 ]
Xie, YiXuan [2 ]
机构
[1] Minist Educ, Key Lab Big Data & Artificial Intelligence Transpo, Beijing 100044, Peoples R China
[2] Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
关键词
Cloud computing; Task scheduling; Energy efficient; Deadline constrained; Deep reinforcement learning; Imitation learning;
D O I
10.1016/j.future.2024.01.002
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Studies of resource provision in cloud computing have drawn extensive attention, since effective task scheduling solutions promise an energy -efficient way of utilizing resources while meeting diverse requirements of users. Deep reinforcement learning (DRL) has demonstrated its outstanding capability in tackling this issue with the ability of online self -learning, however, it is still prevented by the low sampling efficiency, poor sample validity, and slow convergence speed especially for deadline constrained applications. To address these challenges, an Imitation Learning Enabled Fast and Adaptive Task Scheduling (ILETS) framework based on DRL is proposed in this paper. First, we introduce behavior cloning to provide a well-behaved and robust model through Offline Initial Network Parameters Training (OINPT) so as to guarantee the initial decision -making quality of DRL. Next, we design a novel Online Asynchronous Imitation Learning (OAIL)-based method to assist the DRL agent to re -optimize its policy and to against the oscillations caused by the high dynamic of the cloud, which promises DRL agent moving towards the optimal policy with a fast and stable process. Extensive experiments on the real -world dataset have demonstrated that the proposed ILETS can consistently produce shorter response time, lower energy consumption and higher success rate than the baselines and other state-of-the-art methods at the accelerated convergence speed.
引用
收藏
页码:160 / 172
页数:13
相关论文
共 50 条
  • [1] Imitation Learning Enabled Task Scheduling for Online Vehicular Edge Computing
    Wang, Xiaojie
    Ning, Zhaolong
    Guo, Song
    Wang, Lei
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2022, 21 (02) : 598 - 611
  • [2] Imitation-Learning-Enabled Vehicular Edge Computing: Toward Online Task Scheduling
    Nie, Laisen
    Wang, Xiaojie
    Sun, Wentao
    Li, Yongkang
    Li, Shengtao
    Zhang, Peng
    [J]. IEEE NETWORK, 2021, 35 (03): : 102 - 108
  • [3] Deep Learning based task scheduling in a Cloud RAN enabled edge environment
    Fletcher, Jude
    Wallom, David
    [J]. SEC'19: PROCEEDINGS OF THE 4TH ACM/IEEE SYMPOSIUM ON EDGE COMPUTING, 2019, : 283 - 285
  • [4] Cloud Resource Scheduling With Deep Reinforcement Learning and Imitation Learning
    Guo, Wenxia
    Tian, Wenhong
    Ye, Yufei
    Xu, Lingxiao
    Wu, Kui
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (05): : 3576 - 3586
  • [5] Deep learning and optimization enabled multi-objective for task scheduling in cloud computing
    Komarasamy, Dinesh
    Ramaganthan, Siva Malar
    Kandaswamy, Dharani Molapalayam
    Mony, Gokuldhev
    [J]. NETWORK-COMPUTATION IN NEURAL SYSTEMS, 2024,
  • [6] MRLCC: an adaptive cloud task scheduling method based on meta reinforcement learning
    Xiu, Xi
    Li, Jialun
    Long, Yujie
    Wu, Weigang
    [J]. JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS, 2023, 12 (01):
  • [7] MRLCC: an adaptive cloud task scheduling method based on meta reinforcement learning
    Xi Xiu
    Jialun Li
    Yujie Long
    Weigang Wu
    [J]. Journal of Cloud Computing, 12
  • [8] Evolutionary Algorithm Based Task Scheduling in IoT Enabled Cloud Environment
    Raj, R. Joshua Samuel
    Varalatchoumy, M.
    Josephine, V. L. Helen
    Jegatheesan, A.
    Kadry, Seifedine
    Meqdad, Maytham N.
    Nam, Yunyoung
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 71 (01): : 1095 - 1109
  • [9] Adaptive task scheduling enhances motor learning
    Choi, YG
    Schweighofer, N
    [J]. JOURNAL OF SPORT & EXERCISE PSYCHOLOGY, 2006, 28 : S51 - S51
  • [10] An Efficient and Secure Model Using Adaptive Optimal Deep Learning for Task Scheduling in Cloud Computing
    Badri, Sahar
    Alghazzawi, Daniyal M. M.
    Hasan, Syed Humaid
    Alfayez, Fayez
    Hasan, Syed Hamid
    Rahman, Monawar
    Bhatia, Surbhi
    [J]. ELECTRONICS, 2023, 12 (06)