Resource Management in Wireless Networks via Multi-Agent Deep Reinforcement Learning

被引:11
|
作者
Naderializadeh, Navid [1 ,2 ]
Sydir, Jaroslaw [2 ]
Simsek, Meryem [2 ]
Nikopour, Hosein [2 ]
机构
[1] HRL Labs, Malibu, CA 90265 USA
[2] Intel Corp, Santa Clara, CA 95054 USA
关键词
Radio resource management; deep neural networks; multi-agent deep reinforcement learning; ALLOCATION; GAME;
D O I
10.1109/spawc48557.2020.9154250
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We propose a mechanism for distributed radio resource management using multi-agent deep reinforcement learning to mitigate the interference among concurrent transmissions in wireless networks. We equip each transmitter in the network with a deep RL agent, which receives partial delayed observations from its own associated users, while also exchanging observations with its neighboring agents, and decides on which user to serve and what transmit power level to use at each scheduling interval. We propose a scalable agent design, where the dimensions of its observation and action spaces do not vary with changes in the environment configuration, e.g., in terms of number of transmitter and user nodes. Simulation results demonstrate the superiority of our proposed approach compared to decentralized baselines in terms of the tradeoff between average and 5th percentile user rates, while achieving performance close to, and even in certain cases outperforming, that of a centralized baseline.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Resource Management in Wireless Networks via Multi-Agent Deep Reinforcement Learning
    Naderializadeh, Navid
    Sydir, Jaroslaw J.
    Simsek, Meryem
    Nikopour, Hosein
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (06) : 3507 - 3523
  • [2] DeepMPR: Enhancing Opportunistic Routing in Wireless Networks via Multi-Agent Deep Reinforcement Learning
    Kaviani, Saeed
    Ryu, Bo
    Ahmed, Ejaz
    Kim, Deokseong
    Kim, Jae
    Spiker, Carrie
    Harnden, Blake
    [J]. MILCOM 2023 - 2023 IEEE MILITARY COMMUNICATIONS CONFERENCE, 2023,
  • [3] Multi-Agent Deep Reinforcement Learning for Distributed Resource Management in Wirelessly Powered Communication Networks
    Hwang, Sangwon
    Kim, Hanjin
    Lee, Hoon
    Lee, Inkyu
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (11) : 14055 - 14060
  • [4] Multi-Agent Deep Reinforcement Learning for Dynamic Power Allocation in Wireless Networks
    Nasir, Yasar Sinan
    Guo, Dongning
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2019, 37 (10) : 2239 - 2250
  • [5] Partially Observable Multi-Agent Deep Reinforcement Learning for Cognitive Resource Management
    Yang, Ning
    Zhang, Haijun
    Berry, Randall
    [J]. 2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [6] Multi-agent deep reinforcement learning for end-edge orchestrated resource allocation in industrial wireless networks
    Liu, Xiaoyu
    Xu, Chi
    Yu, Haibin
    Zeng, Peng
    [J]. FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2022, 23 (01) : 47 - 60
  • [7] Deep Multi-Agent Reinforcement Learning Based Cooperative Edge Caching in Wireless Networks
    Zhong, Chen
    Gursoy, M. Cenk
    Velipasalar, Senem
    [J]. ICC 2019 - 2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2019,
  • [8] Dynamic Channel Access and Power Control in Wireless Interference Networks via Multi-Agent Deep Reinforcement Learning
    Lu, Ziyang
    Zhong, Chen
    Gursoy, M. Cenk
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (02) : 1588 - 1601
  • [9] MULTI-AGENT DEEP REINFORCEMENT LEARNING FOR RESOURCE MANAGEMENT IN EARTH OBSERVATION SATELLITE CONSTELLATIONS
    Luz, Joao Henrique
    Kokkinogenis, Zafeiris
    Rossetti, Rosaldo J. F.
    [J]. 36TH ANNUAL EUROPEAN SIMULATION AND MODELLING CONFERENCE, ESM 2022, 2022, : 234 - 238
  • [10] Efficient Communications for Multi-Agent Reinforcement Learning in Wireless Networks
    Lv, Zefang
    Du, Yousong
    Chen, Yifan
    Xiao, Liang
    Han, Shuai
    Ji, Xiangyang
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 583 - 588