Deep Reinforcement Learning Based User Perception Optimization in 5G Edge Computing Network

被引:0
|
作者
Liu, Zhiyong [1 ]
Liang, Tong [1 ]
Meng, Dexiang [1 ]
Zhou, Xingwei [1 ]
Li, Linyu [1 ]
Pu, Bowei [1 ]
机构
[1] China Mobile Grp Design Inst Co Ltd, Beijing, Peoples R China
关键词
edge computing; caching; user perception; deep reinforcement learning; RESOURCE-ALLOCATION; PLACEMENT;
D O I
10.1109/ICCC62479.2024.10681742
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
China Mobile operates the world's largest 5G network, with the most significant user base globally. With the application of 5G network technology and Internet of Things (IoT) scenarios becomes more widespread, a large number of devices will connect to China Mobile's 5G network for communication, interaction and data processing. In computation-intensive scenarios, China Mobile applies edge computing as a supplemental method, offloading user tasks to edge servers to alleviate issues like high latency and bandwidth limitations existent in cloud computing. However, continuous task flows generated by users pose considerable challenges to the limited computation resource of edge servers. In this paper, we investigate dynamic task scheduling oriented towards user perception in 5G edge computing networks. With constraints on computational resources, we have converted the original problem into a user perception quality maximization problem based on the Markov Decision Process (MDP). Considering the uncertainty and dynamics of the state space, we propose a deep reinforcement learning (DRL) based user perception optimization (DUPO) algorithm, introducing an autonomous intelligent decision-making strategy between task computation and cache matching to handle a continuous influx of user tasks. Extensive simulation results indicate DUPO can dynamically adjust the task execution strategy according to random task demand and the system environment, effectively enhancing user perception.
引用
收藏
页数:6
相关论文
共 50 条
  • [21] Task offloading of edge computing network based on Lyapunov and deep reinforcement learning
    Qiao, Xudong
    Zhou, Yongxin
    2024 9TH INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATION SYSTEMS, ICCCS 2024, 2024, : 1054 - 1059
  • [22] 5G Network Data Migration Service Based on Edge Computing
    Li, Furong
    Wang, Duan
    SYMMETRY-BASEL, 2021, 13 (11):
  • [23] User Allocation in Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Panda, Subrat Prasad
    Banerjee, Ansuman
    Bhattacharya, Arani
    2021 IEEE INTERNATIONAL CONFERENCE ON WEB SERVICES, ICWS 2021, 2021, : 447 - 458
  • [24] Deep Reinforcement Learning-Based Network Slicing Algorithm for 5G Heterogenous Services
    Alkhoury, George
    Berri, Sara
    Chorti, Arsenia
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 5190 - 5195
  • [25] Spectrum Sharing of Mobile Network Operators based on Deep Reinforcement Learning in 5G and beyond
    Hsu, Yi-Huai
    Chang, Chen-Fan
    Lee, Chao-Hung
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 2278 - 2283
  • [26] 5G and edge: A reinforcement learning approach for Virtual Network Embedding with cost optimization and improved acceptance rate
    Moreira, Cristiano L.
    Kamienski, Carlos A.
    Bianchi, Reinaldo A. C.
    COMPUTER NETWORKS, 2024, 247
  • [27] ICN with edge for 5G: Exploiting in-network caching in ICN-based edge computing for 5G networks
    Ullah, Rehmat
    Rehman, Muhammad Atif Ur
    Naeem, Muhammad Ali
    Kim, Byung-Seo
    Mastorakis, Spyridon
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 111 (111): : 159 - 174
  • [28] Handover Management in a Sliced 5G Network Using Deep Reinforcement Learning
    Arwa, Amaira
    Hend, Koubaa
    Faouzi, Zarai
    20TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE, IWCMC 2024, 2024, : 1394 - 1399
  • [29] DELCAS: Deep Reinforcement Learning Based GPU CaaS Packet Scheduling for Stabilizing QoE in 5G Multi-Access Edge Computing
    Lee, Changha
    Lee, Kyungchae
    Cho, Gyusang
    Youn, Chan-Hyun
    CURRENT TRENDS IN WEB ENGINEERING-ICWE 2023 INTERNATIONAL WORKSHOPS, BECS, SWEET, WALS, 2023, 2024, 1898 : 55 - 66
  • [30] 5G Network Slice Admission Control Using Optimization and Reinforcement Learning
    Haque, Md Ariful
    Kirova, Vassilka
    2022 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2022, : 854 - 859