Edge Computing Resource Allocation Algorithm for NB-IoT Based on Deep Reinforcement Learning

被引:1
|
作者
Chu, Jiawen [1 ,2 ]
Pan, Chunyun [1 ,2 ]
Wang, Yafei [1 ,2 ]
Yun, Xiang [3 ]
LI, Xuehua [1 ,2 ]
机构
[1] Beijing Informat Sci & Technol Univ, Key Lab Informat & Commun Syst, Minist Informat Ind, Beijing 100101, Peoples R China
[2] Beijing Informat Sci & Technol Univ, Key Lab Modern Measurement & Control Technol, Minist Educ, Beijing 100101, Peoples R China
[3] Baicells Technol Co Ltd, Beijing 100101, Peoples R China
关键词
narrowband Internet of Things; mobile edge computing; deep reinforcement learning; compute offload; resource allocation;
D O I
10.1587/transcom.2022EBP3076
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Mobile edge computing (MEC) technology guarantees the privacy and security of large-scale data in the Narrowband-IoT (NB-IoT) by deploying MEC servers near base stations to provide sufficient comput-ing, storage, and data processing capacity to meet the delay and energy consumption requirements of NB-IoT terminal equipment. For the NB-IoT MEC system, this paper proposes a resource allocation algorithm based on deep reinforcement learning to optimize the total cost of task offloading and execution. Since the formulated problem is a mixed-integer non-linear programming (MINLP), we cast our problem as a multi-agent distributed deep reinforcement learning (DRL) problem and address it using dueling Q-learning network algorithm. Simulation results show that compared with the deep Q-learning network and the all-local cost and all-offload cost algo-rithms, the proposed algorithm can effectively guarantee the success rates of task offloading and execution. In addition, when the execution task volume is 200 KBit, the total system cost of the proposed algorithm can be reduced by at least 1.3%,and when the execution task volume is 600 KBit, the total cost of system execution tasks can be reduced by 16.7% at most.
引用
收藏
页码:439 / 447
页数:9
相关论文
共 50 条
  • [11] Resource allocation for content distribution in IoT edge cloud computing environments using deep reinforcement learning
    Neelakantan, Puligundla
    Gangappa, Malige
    Rajasekar, Mummalaneni
    Kumar, Talluri Sunil
    Reddy, Gali Suresh
    [J]. JOURNAL OF HIGH SPEED NETWORKS, 2024, 30 (03) : 409 - 426
  • [12] Deep Reinforcement Learning-Based Resource Allocation for Content Distribution in IoT-Edge-Cloud Computing Environments
    Cui, Tongke
    Yang, Ruopeng
    Fang, Chao
    Yu, Shui
    [J]. SYMMETRY-BASEL, 2023, 15 (01):
  • [13] Resource Allocation in IoT Edge Computing via Concurrent Federated Reinforcement Learning
    Tianqing Zhu
    Zhou, Wei
    Ye, Dayong
    Cheng, Zishuo
    Li, Jin
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (02) : 1414 - 1426
  • [14] Resource Allocation Method of Industrial Terminal Edge Computing Based on Reinforcement Learning Algorithm
    Lu, Guanghua
    Zhang, Wei
    Ma, Lijun
    Liu, Mingbo
    Gao, Lei
    Wang, Zenghai
    Hou, Rui
    Yang, Jie
    Sun, Yingxue
    [J]. 2022 INTERNATIONAL CONFERENCE ON INDUSTRIAL IOT, BIG DATA AND SUPPLY CHAIN, IIOTBDSC, 2022, : 62 - 67
  • [15] Node Selection Algorithm for Federated Learning Based on Deep Reinforcement Learning for Edge Computing in IoT
    Yan, Shuai
    Zhang, Peiying
    Huang, Siyu
    Wang, Jian
    Sun, Hao
    Zhang, Yi
    Tolba, Amr
    [J]. ELECTRONICS, 2023, 12 (11)
  • [16] Joint Service Migration and Resource Allocation in Edge IoT System Based on Deep Reinforcement Learning
    Liu, Fangzheng
    Yu, Hao
    Huang, Jiwei
    Taleb, Tarik
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (07) : 11341 - 11352
  • [17] A Power Allocation Algorithm in Vehicular Edge Computing Networks Based on Deep Reinforcement Learning
    Qiu, Bin
    Wang, Yunxiao
    Xiao, Hailin
    [J]. Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2024, 47 (02): : 81 - 89
  • [18] Task Offloading and Resource Allocation in IoT Based Mobile Edge Computing Using Deep Learning
    Abdullaev, Ilyos
    Prodanova, Natalia
    Bhaskar, K. Aruna
    Lydia, E. Laxmi
    Kadry, Seifedine
    Kim, Jungeun
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 76 (02): : 1463 - 1477
  • [19] Multi-Agent Reinforcement Learning for Resource Allocation in IoT Networks with Edge Computing
    Liu, Xiaolan
    Yu, Jiadong
    Feng, Zhiyong
    Gao, Yue
    [J]. CHINA COMMUNICATIONS, 2020, 17 (09) : 220 - 236
  • [20] Deep Reinforcement Learning Based Resource Allocation Strategy in Cloud-Edge Computing System
    Xu, Jianqiao
    Xu, Zhuohan
    Shi, Bing
    [J]. FRONTIERS IN BIOENGINEERING AND BIOTECHNOLOGY, 2022, 10