Safe-NORA: Safe Reinforcement Learning-based Mobile Network Resource Allocation for Diverse User Demands

被引:5
|
作者
Huang, Wenzhen [1 ]
Li, Tong [1 ]
Cao, Yuting [2 ]
Lyu, Zhe [2 ]
Liang, Yanping [2 ]
Yu, Li [2 ]
Jin, Depeng [1 ]
Zhang, Junge [3 ]
Li, Yong [1 ]
机构
[1] Tsinghua Univ, Beijing, Peoples R China
[2] China Mobile Res Inst, Beijing, Peoples R China
[3] Chinese Acad Sci, Inst Automat, Beijing, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Safe reinforcement learning; Multi-agent; Mobile networks; Resources allocation;
D O I
10.1145/3583780.3615043
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As mobile communication technologies advance, mobile networks become increasingly complex, and user requirements become increasingly diverse. To satisfy the diverse demands of users while improving the overall performance of the network system, the limited wireless network resources should be efficiently and dynamically allocated to them based on the magnitude of their demands and their relative location to the base stations. We separated the problem into four constrained subproblems, which we then solved using a safe reinforcement learning method. In addition, we design a reward mechanism to encourage agent cooperation in distributed training environments. We test our methodology in a simulated scenario with thousands of users and hundreds of base stations. According to experimental findings, our method guarantees that over 95% of user demands are satisfied while also maximizing the overall system throughput.
引用
收藏
页码:885 / 894
页数:10
相关论文
共 50 条
  • [1] Safe and Fast Reinforcement Learning for Network Slicing Resource Allocation
    Massaro, Antonio
    Wellington, Dan
    Aghasaryan, Armen
    Seidl, Robert
    Naseer-Ul-Islam, Muhammad
    Bulakci, Oemer
    2023 IEEE 97TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-SPRING, 2023,
  • [2] Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learning
    Brunke, Lukas
    Greeff, Melissa
    Hall, Adam W.
    Yuan, Zhaocong
    Zhou, Siqi
    Panerati, Jacopo
    Schoellig, Angela P.
    ANNUAL REVIEW OF CONTROL ROBOTICS AND AUTONOMOUS SYSTEMS, 2022, 5 : 411 - 444
  • [3] Reinforcement learning-based online resource allocation for edge computing network
    Li Y.-J.
    Jiang H.-T.
    Gao M.-H.
    Kongzhi yu Juece/Control and Decision, 2022, 37 (11): : 2880 - 2886
  • [4] Federated Deep Reinforcement Learning-Based Task Offloading and Resource Allocation for Smart Cities in a Mobile Edge Network
    Chen, Xing
    Liu, Guizhong
    SENSORS, 2022, 22 (13)
  • [5] Safe Reinforcement Learning-Based Motion Planning for Functional Mobile Robots Suffering Uncontrollable Mobile Robots
    Cao, Huanhui
    Xiong, Hao
    Zeng, Weifeng
    Jiang, Hantao
    Cai, Zhiyuan
    Hu, Liang
    Zhang, Lin
    Lu, Wenjie
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (05) : 4346 - 4363
  • [6] Deep Reinforcement Learning-Based Resource Allocation for Satellite Internet of Things with Diverse QoS Guarantee
    Tang, Siqi
    Pan, Zhisong
    Hu, Guyu
    Wu, Yang
    Li, Yunbo
    SENSORS, 2022, 22 (08)
  • [7] Deep Reinforcement Learning Based Resource Allocation for URLLC User-Centric Network
    Hu, Fajin
    Zhao, Junhui
    Liao, Jieyu
    Zhang, Huan
    2022 14TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING, WCSP, 2022, : 522 - 526
  • [8] Reinforcement Learning-Based User Scheduling and Resource Allocation for Massive MU-MIMO System
    Bu, Gaojing
    Jiang, Jing
    2019 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA (ICCC), 2019,
  • [9] Safe-Control-Gym: A Unified Benchmark Suite for Safe Learning-Based Control and Reinforcement Learning in Robotics
    Yuan, Zhaocong
    Hall, Adam W.
    Zhou, Siqi
    Brunke, Lukas
    Greeff, Melissa
    Panerati, Jacopo
    Schoellig, Angela P.
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (04) : 11142 - 11149
  • [10] A Reinforcement Learning-based Orchestrator for Edge Computing Resource Allocation in Mobile Augmented Reality Systems
    Qian, Weiyang
    Coutinho, Rodolfo W. L.
    2023 IEEE 34TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, PIMRC, 2023,