A Novel Deep Reinforcement Learning Approach for Task Offloading in MEC Systems

被引:5
|
作者
Liu, Xiaowei [1 ]
Jiang, Shuwen [2 ]
Wu, Yi [1 ]
机构
[1] Fujian Normal Univ, Coll Photon & Elect Engn, Fuzhou 350007, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Informat & Commun Engn, Beijing 100876, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2022年 / 12卷 / 21期
基金
中国国家自然科学基金;
关键词
mobile edge computing; task offloading; delay sensitive; Markov decision process; deep reinforcement learning; RESOURCE-ALLOCATION; EDGE; OPTIMIZATION; ACCESS;
D O I
10.3390/app122111260
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
With the internet developing rapidly, mobile edge computing (MEC) has been proposed to offer computational capabilities to tackle the high latency caused by innumerable data and applications. Due to limited computing resources, the innovation of computation offloading technology for an MEC system remains challenging, and can lead to transmission delays and energy consumption. This paper focuses on a task-offloading scheme for an MEC-based system where each mobile device is an independent agent and responsible for making a schedule based on delay-sensitive tasks. Nevertheless, the time-varying network dynamics and the heterogeneous features of real-time data tasks make it difficult to find an optimal solution for task offloading. Existing centralized-based or distributed-based algorithms require huge computational resources for complex problems. To address the above problem, we design a novel deep reinforcement learning (DRL)-based approach by using a parameterized indexed value function for value estimation. Additionally, the task-offloading problem is simulated as a Markov decision process (MDP) and our aim is to reduce the total delay of data processing. Experimental results have shown that our algorithm significantly promotes the users' offloading performance over traditional methods.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] A Hybrid Deep Reinforcement Learning Approach for Dynamic Task Offloading in NOMA-MEC System
    Shang, Ce
    Sun, Yan
    Luo, Hong
    [J]. 2022 19TH ANNUAL IEEE INTERNATIONAL CONFERENCE ON SENSING, COMMUNICATION, AND NETWORKING (SECON), 2022, : 434 - 442
  • [2] A Deep Reinforcement Learning based Mobile Device Task Offloading Algorithm in MEC
    Li, Yang
    Shi, Bing
    [J]. 2020 IEEE INTL SYMP ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, INTL CONF ON BIG DATA & CLOUD COMPUTING, INTL SYMP SOCIAL COMPUTING & NETWORKING, INTL CONF ON SUSTAINABLE COMPUTING & COMMUNICATIONS (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2020), 2020, : 200 - 207
  • [3] Federated Deep Reinforcement Learning for Multimedia Task Offloading and Resource Allocation in MEC Networks
    Zhang, Rongqi
    Pan, Chunyun
    Wang, Yafei
    Yao, Yuanyuan
    Li, Xuehua
    [J]. IEICE TRANSACTIONS ON COMMUNICATIONS, 2024, E107B (06) : 446 - 457
  • [4] Lyapunov-guided deep reinforcement learning for delay-aware online task offloading in MEC systems
    Dai, Longbao
    Mei, Jing
    Yang, Zhibang
    Tong, Zhao
    Zeng, Cuibin
    Li, Keqin
    [J]. JOURNAL OF SYSTEMS ARCHITECTURE, 2024, 153
  • [5] Deep Reinforcement Learning for Task Offloading and Power Allocation in UAV-Assisted MEC System
    Zhao, Nan
    Ren, Fan
    Du, Wei
    Ye, Zhiyang
    [J]. INTERNATIONAL JOURNAL OF MOBILE COMPUTING AND MULTIMEDIA COMMUNICATIONS, 2021, 12 (04) : 32 - 51
  • [6] A Novel Deep Reinforcement Learning-based Approach for Task-offloading in Vehicular Networks
    Kazmi, S. M. Ahsan
    Otoum, Safa
    Hussain, Rasheed
    Mouftah, Hussein T.
    [J]. 2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [7] Computation Offloading and Resource Allocation in NOMA-MEC: A Deep Reinforcement Learning Approach
    Shang, Ce
    Sun, Yan
    Luo, Hong
    Guizani, Mohsen
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (17) : 15464 - 15476
  • [8] Deep Reinforcement Learning for Task Offloading in Mobile Edge Computing Systems
    Tang, Ming
    Wong, Vincent W. S.
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2022, 21 (06) : 1985 - 1997
  • [9] A deep reinforcement approach for computation offloading in MEC dynamic networks
    Fan, Yibiao
    Cai, Xiaowei
    [J]. EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2024, 2024 (01)
  • [10] Task Offloading in MEC-Aided Satellite-Terrestrial Networks: A Reinforcement Learning Approach
    Wei, Peng
    Feng, Wei
    Wang, Kaiwen
    Chen, Yunfei
    Ge, Ning
    [J]. ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 710 - 715