Inter-Cell Slicing Resource Partitioning via Coordinated Multi-Agent Deep Reinforcement Learning

被引:65
|
作者
Hu, Tianlun [1 ,4 ]
Liao, Qi [1 ]
Liu, Qiang [2 ]
Wellington, Dan [3 ]
Carle, Georg [4 ]
机构
[1] Nokia Bell Labs, Stuttgart, Germany
[2] Univ Nebraska Lincoln, Sch Comp, Lincoln, NE USA
[3] Nokia Software, Bellevue, WA USA
[4] Tech Univ Munich, Dept Informat, Munich, Germany
关键词
ALLOCATION;
D O I
10.1109/ICC45855.2022.9838518
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Network slicing enables the operator to configure virtual network instances for diverse services with specific requirements. To achieve the slice-aware radio resource scheduling, dynamic slicing resource partitioning is needed to orchestrate multi-cell slice resources and mitigate inter-cell interference. It is, however, challenging to derive the analytical solutions due to the complex inter-cell interdependencies, interslice resource constraints, and service-specific requirements. In this paper, we propose a multi-agent deep reinforcement learning (DRL) approach that improves the max-min slice performance while maintaining the constraints of resource capacity. We design two coordination schemes to allow distributed agents to coordinate and mitigate inter-cell interference. The proposed approach is extensively evaluated in a system-level simulator. The numerical results show that the proposed approach with inter-agent coordination outperforms the centralized approach in terms of delay and convergence. The proposed approach improves more than two-fold increase in resource efficiency as compared to the baseline approach.
引用
收藏
页码:3202 / 3207
页数:6
相关论文
共 50 条
  • [41] Multi-agent deep reinforcement learning via double attention and adaptive entropy
    Wu, Pei-Liang
    Yuan, Xu-Dong
    Mao, Bing-Yi
    Chen, Wen-Bai
    Gao, Guo-Wei
    [J]. Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2024, 41 (10): : 1930 - 1936
  • [42] MULTI-AGENT DEEP REINFORCEMENT LEARNING FOR RESOURCE MANAGEMENT IN EARTH OBSERVATION SATELLITE CONSTELLATIONS
    Luz, Joao Henrique
    Kokkinogenis, Zafeiris
    Rossetti, Rosaldo J. F.
    [J]. 36TH ANNUAL EUROPEAN SIMULATION AND MODELLING CONFERENCE, ESM 2022, 2022, : 234 - 238
  • [43] Deep Reinforcement Learning Multi-Agent System for Resource Allocation in Industrial Internet of Things
    Rosenberger, Julia
    Urlaub, Michael
    Rauterberg, Felix
    Lutz, Tina
    Selig, Andreas
    Buehren, Michael
    Schramm, Dieter
    [J]. SENSORS, 2022, 22 (11)
  • [44] Deep multi-agent reinforcement learning for resource allocation in NOMA-enabled MEC
    Waqar, Noor
    Hassan, Syed Ali
    Pervaiz, Haris
    Jung, Haejoon
    Dev, Kapal
    [J]. COMPUTER COMMUNICATIONS, 2022, 196 : 1 - 8
  • [45] Multi-Agent Deep Reinforcement Learning for Enhancement of Distributed Resource Allocation in Vehicular Network
    Urmonov, Odilbek
    Aliev, Hayotjon
    Kim, HyungWon
    [J]. IEEE SYSTEMS JOURNAL, 2023, 17 (01): : 491 - 502
  • [46] Multi-Agent Deep Reinforcement Learning for Voltage Control With Coordinated Active and Reactive Power Optimization
    Hu, Daner
    Ye, Zhenhui
    Gao, Yuanqi
    Ye, Zuzhao
    Peng, Yonggang
    Yu, Nanpeng
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2022, 13 (06) : 4873 - 4886
  • [47] Coordinated control of gas supply system in PEMFC based on multi-agent deep reinforcement learning
    Li, Jiawen
    Yu, Tao
    Yang, Bo
    [J]. INTERNATIONAL JOURNAL OF HYDROGEN ENERGY, 2021, 46 (68) : 33899 - 33914
  • [48] A Transfer Learning Framework for Deep Multi-Agent Reinforcement Learning
    Yi Liu
    Xiang Wu
    Yuming Bo
    Jiacun Wang
    Lifeng Ma
    [J]. IEEE/CAA Journal of Automatica Sinica, 2024, 11 (11) : 2346 - 2348
  • [49] Coordinated Variable Speed Limit Control for Freeway Based on Multi-Agent Deep Reinforcement Learning
    Yu, Rongjie
    Xu, Ling
    Zhang, Ruici
    [J]. Tongji Daxue Xuebao/Journal of Tongji University, 2024, 52 (07): : 1089 - 1098
  • [50] A Multi-Agent Deep Reinforcement Learning Based Voltage Regulation Using Coordinated PV Inverters
    Cao, Di
    Hu, Weihao
    Zhao, Junbo
    Huang, Qi
    Chen, Zhe
    Blaabjerg, Frede
    [J]. IEEE TRANSACTIONS ON POWER SYSTEMS, 2020, 35 (05) : 4120 - 4123