A Deep Reinforcement Learning Approach Towards Computation Offloading for Mobile Edge Computing

被引:0
|
作者
Wang, Qing [1 ]
Tan, Wenan [1 ,2 ]
Qin, Xiaofan [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing 211100, Peoples R China
[2] Shanghai Polytech Univ, Sch Comp & Informat Engn, Shanghai 201209, Peoples R China
来源
HUMAN CENTERED COMPUTING | 2019年 / 11956卷
基金
中国国家自然科学基金;
关键词
Mobile edge computing; Deep reinforcement learning; Computation offloading; Deep Q-learning; Cost minimization;
D O I
10.1007/978-3-030-37429-7_42
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In order to improve the quality of service for users and reduce the energy consumption of the cloud computing environment, Mobile Edge Computing (MEC) is a promising paradigm by providing computing resources which is close to the end device in physical distance. Nevertheless, the computation offloading policy to satisfy the requirements of the service provider and consumer at the same time within a MEC system still remains challenging. In this paper, we propose an offloading decision policy with three-level structure for MEC system different from the traditional two-level architecture to formulate the offloading decision optimization problem by minimizing the total cost of energy consumption and delay time. Because the traditional optimization methods could not solve this dynamic system problem efficiently, Reinforcement Learning (RL) has been used in complex control systems in recent years. We design a deep reinforcement learning (DRL) approach to minimize the total cost by applying deep Q-learning algorithm to address the issues of too large system state dimension. The simulation results show that the proposed algorithm has nearly optimal performance than traditional methods.
引用
收藏
页码:419 / 430
页数:12
相关论文
共 50 条
  • [21] Security and Cost-Aware Computation Offloading via Deep Reinforcement Learning in Mobile Edge Computing
    Huang, Binbin
    Li, Yangyang
    Li, Zhongjin
    Pan, Linxuan
    Wang, Shangguang
    Xu, Yunqiu
    Hu, Haiyang
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2019, 2019
  • [22] Online computation offloading with double reinforcement learning algorithm in mobile edge computing
    Liao, Linbo
    Lai, Yongxuan
    Yang, Fan
    Zeng, Wenhua
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2023, 171 : 28 - 39
  • [23] Computation Offloading and Resource Allocation in Mobile Edge Computing via Reinforcement Learning
    Wang, Danfeng
    Zhao, Jian
    2019 11TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2019,
  • [24] Deep Reinforcement Learning-Based Computation Offloading for Mobile Edge Computing in 6G
    Sun, Haifeng
    Wang, Jiawei
    Yong, Dongping
    Qin, Mingwei
    Zhang, Ning
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (04) : 7482 - 7493
  • [25] Deep Reinforcement Learning for Online Computation Offloading in Wireless Powered Mobile-Edge Computing Networks
    Huang, Liang
    Bi, Suzhi
    Zhang, Ying-Jun Angela
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2020, 19 (11) : 2581 - 2593
  • [26] Deep Reinforcement Learning-Based Computation Offloading in Vehicular Edge Computing
    Zhan, Wenhan
    Luo, Chunbo
    Wang, Jin
    Min, Geyong
    Duan, Hancong
    2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [27] Privacy-preserving task offloading in mobile edge computing: A deep reinforcement learning approach
    Xia, Fanglue
    Chen, Ying
    Huang, Jiwei
    SOFTWARE-PRACTICE & EXPERIENCE, 2024, 54 (09): : 1774 - 1792
  • [28] Deep reinforcement learning for the computation offloading in MIMO-based Edge Computing
    Sadiki, Abdeladim
    Bentahar, Jamal
    Dssouli, Rachida
    En-Nouaary, Abdeslam
    Otrok, Hadi
    AD HOC NETWORKS, 2023, 141
  • [29] A Distributed Computation Offloading Strategy for Edge Computing Based on Deep Reinforcement Learning
    Lai, Hongyang
    Yang, Zhuocheng
    Li, Jinhao
    Wu, Celimuge
    Bao, Wugedele
    MOBILE NETWORKS AND MANAGEMENT, MONAMI 2021, 2022, 418 : 73 - 86
  • [30] Cooperative Computation Offloading and Resource Allocation for Blockchain-Enabled Mobile-Edge Computing: A Deep Reinforcement Learning Approach
    Feng, Jie
    Yu, F. Richard
    Pei, Qingqi
    Chu, Xiaoli
    Du, Jianbo
    Zhu, Li
    IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (07) : 6214 - 6228