Space Information Network Resource Scheduling for Cloud Computing: A Deep Reinforcement Learning Approach

被引:2
|
作者
Wang, Yufei [1 ]
Liu, Jun [1 ]
Yin, Yanhua [2 ]
Tong, Yu [1 ]
Liu, Jiansheng [3 ]
机构
[1] Northeastern Univ, Sch Comp Sci & Engn, Shenyang 110169, Peoples R China
[2] Meteorol Informat Ctr Liaoning Prov, Shenyang 110166, Peoples R China
[3] Northeastern Univ, Neusoft Res, Shenyang 110169, Peoples R China
基金
中国国家自然科学基金;
关键词
ALLOCATION; OPTIMIZATION; MANAGEMENT; ALGORITHM; IOT;
D O I
10.1155/2022/1927937
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of satellite technology, space information networks (SINs) have been applied to various fields. SINs can provide more and more complex services and receive more and more tasks. The existing resource scheduling algorithms are difficult to play an efficient role in such a complex environment of resources and tasks. We propose a resource allocation scheme based on reinforcement learning. Firstly, according to the characteristics of the resources of SINs, we established the cloud computing architecture of SINs to manage the resources uniformly. Next, we adopt a variable granularity resources clustering algorithm based on fuzzy and hierarchical clustering algorithms. This algorithm can adaptively adjust the resource size and reduce the scheduling range. Finally, we model the resource scheduling process by a reinforcement learning algorithm to solve the joint resource scheduling problem. The simulation results show that the scheme can effectively reduce resources consumption, shorten the task execution time, and improve the resource utilization efficiency of SINs.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Resource Scheduling for Offline Cloud Computing Using Deep Reinforcement Learning
    El-Boghdadi, Hatem M.
    Ramadan, Rabie A.
    [J]. INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2019, 19 (04): : 54 - 60
  • [2] Cloud Resource Scheduling With Deep Reinforcement Learning and Imitation Learning
    Guo, Wenxia
    Tian, Wenhong
    Ye, Yufei
    Xu, Lingxiao
    Wu, Kui
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (05): : 3576 - 3586
  • [3] Optimized intellectual resource scheduling using deep reinforcement Q-learning in cloud computing
    Uma, J.
    Vivekanandan, P.
    Shankar, S.
    [J]. TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES, 2022, 33 (05):
  • [4] Deep reinforcement learning-based algorithms selectors for the resource scheduling in hierarchical Cloud computing
    Zhou, Guangyao
    Wen, Ruiming
    Tian, Wenhong
    Buyya, Rajkumar
    [J]. Journal of Network and Computer Applications, 2022, 208
  • [5] Resource scheduling approach in cloud Testing as a Service using deep reinforcement learning algorithms
    Karthik, Priyadarsini
    Sekhar, Karthik
    [J]. CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2021, 6 (02) : 147 - 154
  • [6] Reinforcement Learning to Improve Resource Scheduling and Load Balancing in Cloud Computing
    Kaveri P.R.
    Lahande P.
    [J]. SN Computer Science, 4 (2)
  • [7] Scheduling the NASA Deep Space Network with Deep Reinforcement Learning
    Goh, Edwin
    Venkataram, Hamsa Shwetha
    Hoffmann, Mark
    Johnston, Mark D.
    Wilson, Brian
    [J]. 2021 IEEE AEROSPACE CONFERENCE (AEROCONF 2021), 2021,
  • [8] Deep reinforcement learning-based methods for resource scheduling in cloud computing: a review and future directions
    Zhou, Guangyao
    Tian, Wenhong
    Buyya, Rajkumar
    Xue, Ruini
    Song, Liang
    [J]. ARTIFICIAL INTELLIGENCE REVIEW, 2024, 57 (05)
  • [9] A novel deep reinforcement learning scheme for task scheduling in cloud computing
    Siddesha, K.
    Jayaramaiah, G. V.
    Singh, Chandrapal
    [J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2022, 25 (06): : 4171 - 4188
  • [10] A novel deep reinforcement learning scheme for task scheduling in cloud computing
    K. Siddesha
    G. V. Jayaramaiah
    Chandrapal Singh
    [J]. Cluster Computing, 2022, 25 : 4171 - 4188