A Reinforcement Learning Algorithm for Resource Provisioning in Mobile Edge Computing Network

被引:11
|
作者
Huynh Thi Thanh Binh [1 ]
Nguyen Phi Le [1 ]
Nguyen Binh Minh [1 ]
Trinh Thu Hai [1 ]
Ngo Quang Minh [1 ]
Do Bao Son [2 ]
机构
[1] Hanoi Univ Sci & Technol, Sch Informat & Commun Technol, Hanoi, Vietnam
[2] Univ Transport Technol, Fac Informat Technol, Hanoi, Vietnam
关键词
Mobile Edge Computing; Fog Computing; Resource Provisioning; Markov Decision Process; Energy Harvesting; Proximal Policy Optimization; COMPUTATION RATE MAXIMIZATION;
D O I
10.1109/ijcnn48605.2020.9206947
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Mobile edge computing (MEC) is a model that allows integration of computing power into telecommunications networks, to improve communication and data processing efficiency. In general, providing power to ensure the computing power of edge servers in the MEC network is very important. In many cases, ensuring continuous power supply to the system is not possible because servers are deployed in hard-to-reach areas such as outlying areas, forests, islands, etc. This is when renewable energy prevails as a viable source of power for ensuring stable operation. This paper addresses resource provisioning in the MEC network using renewable energy. We formulate the problem as a Markov Decision Problem and introduce a new approach to optimize this problem in terms of energy and time costs by using a reinforcement learning technique. Our simulation validates the efficacy of our algorithm, which results in a cost three times better than the other methods.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] Enhanced resource allocation in mobile edge computing using reinforcement learning based MOACO algorithm for IIOT
    Vimal, S.
    Khari, Manju
    Dey, Nilanjan
    Gonzalez Crespo, Ruben
    Robinson, Y. Harold
    [J]. COMPUTER COMMUNICATIONS, 2020, 151 : 355 - 364
  • [2] Computation Offloading and Resource Allocation in Mobile Edge Computing via Reinforcement Learning
    Wang, Danfeng
    Zhao, Jian
    [J]. 2019 11TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2019,
  • [3] Smart Resource Allocation for Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Wang, Jiadai
    Zhao, Lei
    Liu, Jiajia
    Kato, Nei
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2021, 9 (03) : 1529 - 1541
  • [4] Smart Resource Allocation for Mobile Edge Computing: A Deep Reinforcement Learning Approach
    [J]. Liu, Jiajia (liujiajia@nwpu.edu.cn), 1600, IEEE Computer Society (09):
  • [5] Task and Resource Allocation in Mobile Edge Computing: An Improved Reinforcement Learning Approach
    Wang, Sihua
    Chen, Mingzhe
    Liu, Xuanlin
    Yin, Changchuan
    [J]. 2019 IEEE GLOBECOM WORKSHOPS (GC WKSHPS), 2019,
  • [6] Deep Reinforcement Learning Based Edge Computing Network Aided Resource Allocation Algorithm for Smart Grid
    Chi, Yingying
    Zhang, Yi
    Liu, Yong
    Zhu, Hailong
    Zheng, Zhe
    Liu, Rui
    Zhang, Peiying
    [J]. IEEE ACCESS, 2023, 11 : 6541 - 6550
  • [7] Resource Provisioning in Fog Computing through Deep Reinforcement Learning
    Santos, Jose
    Wauters, Tim
    Volckaert, Bruno
    De Turck, Filip
    [J]. 2021 IFIP/IEEE INTERNATIONAL SYMPOSIUM ON INTEGRATED NETWORK MANAGEMENT (IM 2021), 2021, : 431 - 437
  • [8] Federated Learning for Online Resource Allocation in Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Zheng, Jingjing
    Li, Kai
    Mhaisen, Naram
    Ni, Wei
    Tovar, Eduardo
    Guizani, Mohsen
    [J]. 2023 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC, 2023,
  • [9] Online computation offloading with double reinforcement learning algorithm in mobile edge computing
    Liao, Linbo
    Lai, Yongxuan
    Yang, Fan
    Zeng, Wenhua
    [J]. JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2023, 171 : 28 - 39
  • [10] Reinforcement learning-based online resource allocation for edge computing network
    Li Y.-J.
    Jiang H.-T.
    Gao M.-H.
    [J]. Kongzhi yu Juece/Control and Decision, 2022, 37 (11): : 2880 - 2886