Deep Reinforcement Learning-Based Task Offloading and Resource Allocation for Industrial IoT in MEC Federation System

被引:11
|
作者
Do, Huong Mai [1 ]
Tran, Tuan Phong
Yoo, Myungsik [2 ]
机构
[1] Soongsil Univ, Dept Informat Commun Convergence Technol, Seoul, South Korea
[2] Soongsil Univ, Sch Elect Engn, Seoul, South Korea
关键词
~MEC federation; IIoT; task offloading; resource allocation; Markov decision process; deep reinforcement learning; NETWORKS; INTERNET;
D O I
10.1109/ACCESS.2023.3302518
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The rapid growth of the Internet of Things (IoT) has resulted in the development of intelligent industrial systems known as Industrial IoT (IIoT). These systems integrate smart devices, sensors, cameras, and 5G technologies to enable automated data gathering and analysis boost production efficiency and overcome scalability issues. However, IoT devices have limited computer power, memory, and battery capacities. To address these challenges, mobile edge computing (MEC) has been introduced to IIoT systems to reduce the computational burden on the devices. While the dedicated MEC paradigm limits optimal resource utilization and load balancing, the MEC federation can potentially overcome these drawbacks. However, previous studies have relied on idealized assumptions when developing optimal models, raising concerns about their practical applicability. In this study, we investigated the joint decision offloading and resource allocation problem for MEC federation in the IIoT. Specifically, an optimization model was constructed based on all real-world factors influencing system performance. To minimize the total energy delay cost, the original problem was transformed into a Markov decision process. Considering task generation dynamics and continuity, we addressed the Markov decision process using a deep reinforcement learning method. We propose a deep deterministic policy gradient algorithm with prioritized experience replay (DDPG-PER)-based resource allocation that can handle high-dimensional continuity of action and state spaces. The simulation results indicate that the proposed approach effectively minimizes the energy-delay costs associated with tasks.
引用
收藏
页码:83150 / 83170
页数:21
相关论文
共 50 条
  • [1] Deep Reinforcement Learning-based Task Offloading and Resource Allocation in MEC-enabled Wireless Networks
    Engidayehu, Seble Birhanu
    Mahboob, Tahira
    Chung, Min Young
    [J]. 2022 27TH ASIA PACIFIC CONFERENCE ON COMMUNICATIONS (APCC 2022): CREATING INNOVATIVE COMMUNICATION TECHNOLOGIES FOR POST-PANDEMIC ERA, 2022, : 226 - 230
  • [2] Deep Reinforcement Learning based Computation Offloading and Resource Allocation for MEC
    Li, Ji
    Gao, Hui
    Lv, Tiejun
    Lu, Yueming
    [J]. 2018 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2018,
  • [3] Deep reinforcement learning-based task scheduling and resource allocation for NOMA-MEC in Industrial Internet of Things
    Lin, Lixia
    Zhou, Wen'an
    Yang, Zhicheng
    Liu, Jianlong
    [J]. PEER-TO-PEER NETWORKING AND APPLICATIONS, 2023, 16 (01) : 170 - 188
  • [4] Deep reinforcement learning-based task scheduling and resource allocation for NOMA-MEC in Industrial Internet of Things
    Lixia Lin
    Wen’an Zhou
    Zhicheng Yang
    Jianlong Liu
    [J]. Peer-to-Peer Networking and Applications, 2023, 16 : 170 - 188
  • [5] Federated Deep Reinforcement Learning for Multimedia Task Offloading and Resource Allocation in MEC Networks
    Zhang, Rongqi
    Pan, Chunyun
    Wang, Yafei
    Yao, Yuanyuan
    Li, Xuehua
    [J]. IEICE TRANSACTIONS ON COMMUNICATIONS, 2024, E107B (06) : 446 - 457
  • [6] Deep reinforcement learning-based joint optimization model for vehicular task offloading and resource allocation
    Li, Zhi-Yuan
    Zhang, Zeng-Xiang
    [J]. PEER-TO-PEER NETWORKING AND APPLICATIONS, 2024, 17 (04) : 2001 - 2015
  • [7] Decentralized Computation Offloading and Resource Allocation in MEC by Deep Reinforcement Learning
    Liang, Yeteng
    He, Yejun
    Zhong, Xiaoxu
    [J]. 2020 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA (ICCC), 2020, : 244 - 249
  • [8] Federated Deep Reinforcement Learning for Online Task Offloading and Resource Allocation in WPC-MEC Networks
    Zang, Lianqi
    Zhang, Xin
    Guo, Boren
    [J]. IEEE ACCESS, 2022, 10 : 9856 - 9867
  • [9] Deep reinforcement learning-based joint task offloading and resource allocation in multipath transmission vehicular networks
    Yin, Chenyang
    Zhang, Yuyang
    Dong, Ping
    Zhang, Hongke
    [J]. TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES, 2024, 35 (01)
  • [10] Deep Reinforcement Learning for Task Offloading and Power Allocation in UAV-Assisted MEC System
    Zhao, Nan
    Ren, Fan
    Du, Wei
    Ye, Zhiyang
    [J]. INTERNATIONAL JOURNAL OF MOBILE COMPUTING AND MULTIMEDIA COMMUNICATIONS, 2021, 12 (04) : 32 - 51