Imitation learning enabled fast and adaptive task scheduling in cloud

被引:1
|
作者
Kang, KaiXuan [2 ]
Ding, Ding [1 ,2 ]
Xie, HuaMao [2 ]
Zhao, LiHong [2 ]
Li, YiNong [2 ]
Xie, YiXuan [2 ]
机构
[1] Minist Educ, Key Lab Big Data & Artificial Intelligence Transpo, Beijing 100044, Peoples R China
[2] Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
关键词
Cloud computing; Task scheduling; Energy efficient; Deadline constrained; Deep reinforcement learning; Imitation learning;
D O I
10.1016/j.future.2024.01.002
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Studies of resource provision in cloud computing have drawn extensive attention, since effective task scheduling solutions promise an energy -efficient way of utilizing resources while meeting diverse requirements of users. Deep reinforcement learning (DRL) has demonstrated its outstanding capability in tackling this issue with the ability of online self -learning, however, it is still prevented by the low sampling efficiency, poor sample validity, and slow convergence speed especially for deadline constrained applications. To address these challenges, an Imitation Learning Enabled Fast and Adaptive Task Scheduling (ILETS) framework based on DRL is proposed in this paper. First, we introduce behavior cloning to provide a well-behaved and robust model through Offline Initial Network Parameters Training (OINPT) so as to guarantee the initial decision -making quality of DRL. Next, we design a novel Online Asynchronous Imitation Learning (OAIL)-based method to assist the DRL agent to re -optimize its policy and to against the oscillations caused by the high dynamic of the cloud, which promises DRL agent moving towards the optimal policy with a fast and stable process. Extensive experiments on the real -world dataset have demonstrated that the proposed ILETS can consistently produce shorter response time, lower energy consumption and higher success rate than the baselines and other state-of-the-art methods at the accelerated convergence speed.
引用
收藏
页码:160 / 172
页数:13
相关论文
共 50 条
  • [21] Task Scheduling Mechanism Based on Reinforcement Learning in Cloud Computing
    Wang, Yugui
    Dong, Shizhong
    Fan, Weibei
    [J]. MATHEMATICS, 2023, 11 (15)
  • [22] Machine learning approach to optimal task scheduling in cloud communication
    Alsubaei, Faisal S.
    Hamed, Ahmed Y.
    Hassan, Moatamad R.
    Mohery, M.
    Elnahary, M. Kh.
    [J]. ALEXANDRIA ENGINEERING JOURNAL, 2024, 89 : 1 - 30
  • [23] Cloud Task Scheduling based on Swarm Intelligence and Machine Learning
    Rjoub, Gaith
    Bentahar, Jamal
    [J]. 2017 IEEE 5TH INTERNATIONAL CONFERENCE ON FUTURE INTERNET OF THINGS AND CLOUD (FICLOUD 2017), 2017, : 272 - 279
  • [24] An adaptive symbiotic organisms search for constrained task scheduling in cloud computing
    Mohammed Abdullahi
    Md Asri Ngadi
    Salihu Idi Dishing
    Shafi’i Muhammad Abdulhamid
    [J]. Journal of Ambient Intelligence and Humanized Computing, 2023, 14 : 8839 - 8850
  • [25] Adaptive Scheduling Algorithm Based Task Loading in Cloud Data Centers
    Mukherjee, Dibyendu
    Ghosh, Shivnath
    Pal, Souvik
    Aly, Ayman A.
    Le, Dac-Nhuong
    [J]. IEEE ACCESS, 2022, 10 : 49412 - 49421
  • [26] Adaptive task scheduling method in multi-tenant cloud computing
    Ramegowda A.
    Agarkhed J.
    Patil S.R.
    [J]. International Journal of Information Technology, 2020, 12 (4) : 1093 - 1102
  • [27] An adaptive symbiotic organisms search for constrained task scheduling in cloud computing
    Abdullahi, Mohammed
    Ngadi, Md Asri
    Dishing, Salihu Idi
    Abdulhamid, Shafi'i Muhammad
    [J]. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2022, 14 (7) : 8839 - 8850
  • [28] Alts: An Adaptive Load Balanced Task Scheduling Approach for Cloud Computing
    Mubeen, Aroosa
    Ibrahim, Muhammad
    Bibi, Nargis
    Baz, Mohammad
    Hamam, Habib
    Cheikhrouhou, Omar
    [J]. PROCESSES, 2021, 9 (09)
  • [29] Energy efficient task scheduling using adaptive PSO for cloud computing
    Rani R.
    Garg R.
    [J]. International Journal of Reasoning-based Intelligent Systems, 2021, 13 (02) : 50 - 58
  • [30] Task Scheduling Based on Adaptive Priority Experience Replay on Cloud Platforms
    Li, Cuixia
    Gao, Wenlong
    Shi, Li
    Shang, Zhiquan
    Zhang, Shuyan
    [J]. ELECTRONICS, 2023, 12 (06)