Deep Reinforcement Learning based Computation Offloading and Resource Allocation for MEC

被引:2
|
作者
Li, Ji [1 ]
Gao, Hui [1 ]
Lv, Tiejun [1 ]
Lu, Yueming [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Informat & Commun Engn, Minist Educ, Key Lab Trustworthy Distributed Comp & Serv, Beijing 100876, Peoples R China
关键词
MOBILE; INTERNET; RADIO;
D O I
10.1109/wcnc.2018.8377343
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Mobile edge computing (MEC) has the potential to enable computation-intensive applications in 5G networks. MEC can extend the computational capacity at the edge of wireless networks by migrating the computation-intensive tasks to the MEC server. In this paper, we consider a multi-user MEC system, where multiple user equipments (UEs) can perform computation offloading via wireless channels to an MEC server. We formulate the sum cost of delay and energy consumptions for all UEs as our optimization objective. In order to minimize the sum cost of the considered MEC system, we jointly optimize the offloading decision and computational resource allocation. However, it is challenging to obtain an optimal policy in such a dynamic system. Besides immediate reward, Reinforcement Learning (RL) also takes a long-term goal into consideration, which is very important to a time-variant dynamic systems, such as our considered multi-user wireless MEC system. To this end, we propose RL-based optimization framework to tackle the resource allocation in wireless MEC. Specifically, the Q-learning based and Deep Reinforcement Learning (DRL) based schemes are proposed, respectively. Simulation results show that the proposed scheme achieves significant reduction on the sum cost compared to other baselines.
引用
收藏
页数:6
相关论文
共 50 条
  • [31] Computation Offloading and Resource Allocation in Mobile Edge Computing via Reinforcement Learning
    Wang, Danfeng
    Zhao, Jian
    [J]. 2019 11TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2019,
  • [32] Deep Reinforcement Learning for Joint Offloading and Resource Allocation in Fog Computing
    Bai, Wenle
    Qian, Cheng
    [J]. PROCEEDINGS OF 2021 IEEE 12TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS), 2021, : 131 - 134
  • [33] Computation Offloading and Resource Allocation in MEC-Enabled Integrated Aerial-Terrestrial Vehicular Networks: A Reinforcement Learning Approach
    Waqar, Noor
    Hassan, Syed Ali
    Mahmood, Aamir
    Dev, Kapal
    Dinh-Thuan Do
    Gidlund, Mikael
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (11) : 21478 - 21491
  • [34] Joint computation offloading and resource allocation based on deep reinforcement learning in C-V2X edge computing
    Peng Hou
    Xiaohan Jiang
    Zhihui Lu
    Bo Li
    Zongshan Wang
    [J]. Applied Intelligence, 2023, 53 : 22446 - 22466
  • [35] Joint computation offloading and resource allocation based on deep reinforcement learning in C-V2X edge computing
    Hou, Peng
    Jiang, Xiaohan
    Lu, Zhihui
    Li, Bo
    Wang, Zongshan
    [J]. APPLIED INTELLIGENCE, 2023, 53 (19) : 22446 - 22466
  • [36] Joint Computation Offloading and Resource Allocation for Maritime MEC With Energy Harvesting
    Wang, Zhen
    Lin, Bin
    Ye, Qiang
    Fang, Yuguang
    Han, Xiaoling
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (11): : 19898 - 19913
  • [37] Computation Offloading and Resource Allocation for Backhaul Limited Cooperative MEC Systems
    Phuong-Duy Nguyen
    Vu Nguyen Ha
    Long Bao Le
    [J]. 2019 IEEE 90TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2019-FALL), 2019,
  • [38] Joint Channel Allocation and Resource Management for Stochastic Computation Offloading in MEC
    Ren, Ju
    Mahfujul, Kadir
    Lyu, Feng
    Yue, Sheng
    Zhang, Yaoxue
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (08) : 8900 - 8913
  • [39] A DRL Agent for Jointly Optimizing Computation Offloading and Resource Allocation in MEC
    Chen, Juan
    Xing, Huanlai
    Xiao, Zhiwen
    Xu, Lexi
    Tao, Tao
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (24): : 17508 - 17524
  • [40] An efficient computation offloading and resource allocation algorithm in RIS empowered MEC?
    Zhang, Xiangjun
    Wu, Weiguo
    Liu, Song
    Wang, Jinyu
    [J]. COMPUTER COMMUNICATIONS, 2023, 197 : 113 - 123