Deep Reinforcement Learning Based User Perception Optimization in 5G Edge Computing Network

被引:0
|
作者
Liu, Zhiyong [1 ]
Liang, Tong [1 ]
Meng, Dexiang [1 ]
Zhou, Xingwei [1 ]
Li, Linyu [1 ]
Pu, Bowei [1 ]
机构
[1] China Mobile Grp Design Inst Co Ltd, Beijing, Peoples R China
关键词
edge computing; caching; user perception; deep reinforcement learning; RESOURCE-ALLOCATION; PLACEMENT;
D O I
10.1109/ICCC62479.2024.10681742
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
China Mobile operates the world's largest 5G network, with the most significant user base globally. With the application of 5G network technology and Internet of Things (IoT) scenarios becomes more widespread, a large number of devices will connect to China Mobile's 5G network for communication, interaction and data processing. In computation-intensive scenarios, China Mobile applies edge computing as a supplemental method, offloading user tasks to edge servers to alleviate issues like high latency and bandwidth limitations existent in cloud computing. However, continuous task flows generated by users pose considerable challenges to the limited computation resource of edge servers. In this paper, we investigate dynamic task scheduling oriented towards user perception in 5G edge computing networks. With constraints on computational resources, we have converted the original problem into a user perception quality maximization problem based on the Markov Decision Process (MDP). Considering the uncertainty and dynamics of the state space, we propose a deep reinforcement learning (DRL) based user perception optimization (DUPO) algorithm, introducing an autonomous intelligent decision-making strategy between task computation and cache matching to handle a continuous influx of user tasks. Extensive simulation results indicate DUPO can dynamically adjust the task execution strategy according to random task demand and the system environment, effectively enhancing user perception.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] 5G Converged Network Resource Allocation Strategy Based on Reinforcement Learning in Edge Cloud Computing Environment
    Li, Xuezhu
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [2] A Distributed Mobile Edge Computing Based Dynamic Resource Allocation in 5G Network Using Green Anaconda Optimization Based Deep Learning Network
    Selvan, C.
    Rajulu, G. Govinda
    Padmanaban, K.
    Aghalya, S.
    INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS, 2025, 38 (05)
  • [3] Deep Reinforcement Learning-Based Computation Offloading for 5G Vehicle-Aware Multi-Access Edge Computing Network
    Ziying Wu
    Danfeng Yan
    China Communications, 2021, 18 (11) : 26 - 41
  • [4] Deep reinforcement learning-based computation offloading for 5G vehicle-aware multi-access edge computing network
    Wu, Ziying
    Yan, Danfeng
    CHINA COMMUNICATIONS, 2021, 18 (11) : 26 - 41
  • [5] Deep Reinforcement Learning-Based Network Slicing for beyond 5G
    Suh, Kyungjoo
    Kim, Sunwoo
    Ahn, Yongjun
    Kim, Seungnyun
    Ju, Hyungyu
    Shim, Byonghyo
    IEEE Access, 2022, 10 : 7384 - 7395
  • [6] Deep Reinforcement Learning-Based Network Slicing for Beyond 5G
    Suh, Kyungjoo
    Kim, Sunwoo
    Ahn, Yongjun
    Kim, Seungnyun
    Ju, Hyungyu
    Shim, Byonghyo
    IEEE ACCESS, 2022, 10 : 7384 - 7395
  • [7] When Deep Reinforcement Learning Meets Federated Learning: Intelligent Multitimescale Resource Management for Multiaccess Edge Computing in 5G Ultradense Network
    Yu, Shuai
    Chen, Xu
    Zhou, Zhi
    Gong, Xiaowen
    Wu, Di
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (04) : 2238 - 2251
  • [8] Deep Reinforcement Learning and Optimization Based Green Mobile Edge Computing
    Yang, Yang
    Hu, Yulin
    Gursoy, M. Cenk
    2021 IEEE 18TH ANNUAL CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE (CCNC), 2021,
  • [9] Computation offloading Optimization in Edge Computing based on Deep Reinforcement Learning
    Zhu Qinghua
    Chang Ying
    Zhao Jingya
    Liu Yong
    2020 5TH INTERNATIONAL CONFERENCE ON MECHANICAL, CONTROL AND COMPUTER ENGINEERING (ICMCCE 2020), 2020, : 1552 - 1558
  • [10] Support for Edge Computing in the 5G Network
    Choi, Young-il
    Park, Noik
    2018 TENTH INTERNATIONAL CONFERENCE ON UBIQUITOUS AND FUTURE NETWORKS (ICUFN 2018), 2018, : 586 - 590