Inter-Cell Slicing Resource Partitioning via Coordinated Multi-Agent Deep Reinforcement Learning

被引:65
|
作者
Hu, Tianlun [1 ,4 ]
Liao, Qi [1 ]
Liu, Qiang [2 ]
Wellington, Dan [3 ]
Carle, Georg [4 ]
机构
[1] Nokia Bell Labs, Stuttgart, Germany
[2] Univ Nebraska Lincoln, Sch Comp, Lincoln, NE USA
[3] Nokia Software, Bellevue, WA USA
[4] Tech Univ Munich, Dept Informat, Munich, Germany
关键词
ALLOCATION;
D O I
10.1109/ICC45855.2022.9838518
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Network slicing enables the operator to configure virtual network instances for diverse services with specific requirements. To achieve the slice-aware radio resource scheduling, dynamic slicing resource partitioning is needed to orchestrate multi-cell slice resources and mitigate inter-cell interference. It is, however, challenging to derive the analytical solutions due to the complex inter-cell interdependencies, interslice resource constraints, and service-specific requirements. In this paper, we propose a multi-agent deep reinforcement learning (DRL) approach that improves the max-min slice performance while maintaining the constraints of resource capacity. We design two coordination schemes to allow distributed agents to coordinate and mitigate inter-cell interference. The proposed approach is extensively evaluated in a system-level simulator. The numerical results show that the proposed approach with inter-agent coordination outperforms the centralized approach in terms of delay and convergence. The proposed approach improves more than two-fold increase in resource efficiency as compared to the baseline approach.
引用
收藏
页码:3202 / 3207
页数:6
相关论文
共 50 条
  • [1] Inter-Cell Network Slicing With Transfer Learning Empowered Multi-Agent Deep Reinforcement Learning
    Hu, Tianlun
    Liao, Qi
    Liu, Qiang
    Carle, Georg
    [J]. IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2023, 4 : 1141 - 1155
  • [2] Coordinated Slicing and Admission Control Using Multi-Agent Deep Reinforcement Learning
    Sulaiman, Muhammad
    Moayyedi, Arash
    Ahmadi, Mahdieh
    Salahuddin, Mohammad A.
    Boutaba, Raouf
    Saleh, Aladdin
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2023, 20 (02): : 1110 - 1124
  • [3] Multi-Agent Deep Reinforcement Learning Joint Beamforming for Slicing Resource Allocation
    Yan, Dandan
    Ng, Benjamin K.
    Ke, Wei
    Lam, Chan-Tong
    [J]. IEEE WIRELESS COMMUNICATIONS LETTERS, 2024, 13 (05) : 1220 - 1224
  • [4] Multi-Agent Reinforcement Learning for Slicing Resource Allocation in Vehicular Networks
    Cui, Yaping
    Shi, Hongji
    Wang, Ruyan
    He, Peng
    Wu, Dapeng
    Huang, Xinyun
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (02) : 2005 - 2016
  • [5] Resource Management in Wireless Networks via Multi-Agent Deep Reinforcement Learning
    Naderializadeh, Navid
    Sydir, Jaroslaw J.
    Simsek, Meryem
    Nikopour, Hosein
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (06) : 3507 - 3523
  • [6] Resource Management in Wireless Networks via Multi-Agent Deep Reinforcement Learning
    Naderializadeh, Navid
    Sydir, Jaroslaw
    Simsek, Meryem
    Nikopour, Hosein
    [J]. PROCEEDINGS OF THE 21ST IEEE INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (IEEE SPAWC2020), 2020,
  • [7] Partitioning in multi-agent reinforcement learning
    Sun, R
    Peterson, T
    [J]. FROM ANIMALS TO ANIMATS 6, 2000, : 325 - 332
  • [8] Analysis of coordinated behavior structures with multi-agent deep reinforcement learning
    Miyashita, Yuki
    Sugawara, Toshiharu
    [J]. APPLIED INTELLIGENCE, 2021, 51 (02) : 1069 - 1085
  • [9] Multi-Agent Deep Reinforcement Learning for Coordinated Multipoint in Mobile Networks
    Schneider, Stefan
    Karl, Holger
    Khalili, Ramin
    Hecker, Artur
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2024, 21 (01): : 908 - 924
  • [10] Analysis of coordinated behavior structures with multi-agent deep reinforcement learning
    Yuki Miyashita
    Toshiharu Sugawara
    [J]. Applied Intelligence, 2021, 51 : 1069 - 1085