Edge Computing Resource Allocation Algorithm for NB-IoT Based on Deep Reinforcement Learning

被引:1
|
作者
Chu, Jiawen [1 ,2 ]
Pan, Chunyun [1 ,2 ]
Wang, Yafei [1 ,2 ]
Yun, Xiang [3 ]
LI, Xuehua [1 ,2 ]
机构
[1] Beijing Informat Sci & Technol Univ, Key Lab Informat & Commun Syst, Minist Informat Ind, Beijing 100101, Peoples R China
[2] Beijing Informat Sci & Technol Univ, Key Lab Modern Measurement & Control Technol, Minist Educ, Beijing 100101, Peoples R China
[3] Baicells Technol Co Ltd, Beijing 100101, Peoples R China
关键词
narrowband Internet of Things; mobile edge computing; deep reinforcement learning; compute offload; resource allocation;
D O I
10.1587/transcom.2022EBP3076
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Mobile edge computing (MEC) technology guarantees the privacy and security of large-scale data in the Narrowband-IoT (NB-IoT) by deploying MEC servers near base stations to provide sufficient comput-ing, storage, and data processing capacity to meet the delay and energy consumption requirements of NB-IoT terminal equipment. For the NB-IoT MEC system, this paper proposes a resource allocation algorithm based on deep reinforcement learning to optimize the total cost of task offloading and execution. Since the formulated problem is a mixed-integer non-linear programming (MINLP), we cast our problem as a multi-agent distributed deep reinforcement learning (DRL) problem and address it using dueling Q-learning network algorithm. Simulation results show that compared with the deep Q-learning network and the all-local cost and all-offload cost algo-rithms, the proposed algorithm can effectively guarantee the success rates of task offloading and execution. In addition, when the execution task volume is 200 KBit, the total system cost of the proposed algorithm can be reduced by at least 1.3%,and when the execution task volume is 600 KBit, the total cost of system execution tasks can be reduced by 16.7% at most.
引用
收藏
页码:439 / 447
页数:9
相关论文
共 50 条
  • [1] Resource Allocation Based on Deep Reinforcement Learning in IoT Edge Computing
    Xiong, Xiong
    Zheng, Kan
    Lei, Lei
    Hou, Lu
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2020, 38 (06) : 1133 - 1146
  • [2] Blockchain-Based Edge Computing Resource Allocation in IoT: A Deep Reinforcement Learning Approach
    He, Ying
    Wang, Yuhang
    Qiu, Chao
    Lin, Qiuzhen
    Li, Jianqiang
    Ming, Zhong
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (04) : 2226 - 2237
  • [3] Novel Resource Allocation Algorithm of Edge Computing Based on Deep Reinforcement Learning Mechanism
    Zhang, Degan
    Fan, Hongrui
    Zhang, Jie
    [J]. 19TH IEEE INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED PROCESSING WITH APPLICATIONS (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2021), 2021, : 437 - 444
  • [4] Resource Allocation Method of Edge IoT Agent Based on Deep Reinforcement Learning
    Zhong, Jiayong
    Hu, Ke
    Lv, Xiaohong
    Chen, Yongtao
    Gao, Jin
    [J]. JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2024, 33 (05)
  • [5] Resource Allocation for Edge Computing in IoT Networks via Reinforcement Learning
    Liu, Xiaolan
    Qin, Zhijin
    Gao, Yue
    [J]. ICC 2019 - 2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2019,
  • [6] Quantum Deep Reinforcement Learning for Dynamic Resource Allocation in Mobile Edge Computing-Based IoT Systems
    Ansere, James Adu
    Gyamfi, Eric
    Sharma, Vishal
    Shin, Hyundong
    Dobre, Octavia A.
    Duong, Trung Q.
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (06) : 6221 - 6233
  • [7] Task offloading and resource allocation algorithm based on deep reinforcement learning for distributed AI execution tasks in IoT edge computing environments
    Aghapour, Zahra
    Sharifian, Saeed
    Taheri, Hassan
    [J]. COMPUTER NETWORKS, 2023, 223
  • [8] Deep Reinforcement Learning Based Edge Computing Network Aided Resource Allocation Algorithm for Smart Grid
    Chi, Yingying
    Zhang, Yi
    Liu, Yong
    Zhu, Hailong
    Zheng, Zhe
    Liu, Rui
    Zhang, Peiying
    [J]. IEEE ACCESS, 2023, 11 : 6541 - 6550
  • [9] An adaptive uplink resource allocation algorithm in NB-IoT
    Pei, Errong
    Wang, Zhenmin
    Li, Yun
    [J]. 2021 IEEE 93RD VEHICULAR TECHNOLOGY CONFERENCE (VTC2021-SPRING), 2021,
  • [10] Multiuser Resource Control With Deep Reinforcement Learning in IoT Edge Computing
    Lei, Lei
    Xu, Huijuan
    Xiong, Xiong
    Zheng, Kan
    Xiang, Wei
    Wang, Xianbin
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (06) : 10119 - 10133