Adaptive Wireless Network Management with Multi-Agent Reinforcement Learning

被引:4
|
作者
Ivoghlian, Ameer [1 ]
Salcic, Zoran [1 ]
Wang, Kevin I-Kai [1 ]
机构
[1] Univ Auckland, Dept Elect Comp & Software Engn, Auckland 1010, New Zealand
关键词
large scale networks; congestion; reinforcement learning; multi-agent; LoRaWAN; fairness; application awareness;
D O I
10.3390/s22031019
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Wireless networks are trending towards large scale systems, containing thousands of nodes, with multiple co-existing applications. Congestion is an inevitable consequence of this scale and complexity, which leads to inefficient use of the network capacity. This paper proposes an autonomous and adaptive wireless network management framework, utilising multi-agent deep reinforcement learning, to achieve efficient use of the network. Its novel reward function incorporates application awareness and fairness to address both node and network level objectives. Our experimental results demonstrate the proposed approach's ability to be optimised for application-specific requirements, while optimising the fairness of the network. The results reveal significant performance benefits in terms of adaptive data rate and an increase in responsiveness compared to a single-agent approach. Some significant qualitative benefits of the multi-agent approach-network size independence, node-led priorities, variable iteration length, and reduced search space-are also presented and discussed.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Multi-agent Reinforcement Learning in Network Management
    Bagnasco, Ricardo
    Serrat, Joan
    [J]. SCALABILITY OF NETWORKS AND SERVICES, PROCEEDINGS, 2009, 5637 : 199 - 202
  • [2] Towards Multi-agent Reinforcement Learning for Wireless Network Protocol Synthesis
    Dutta, Hrishikesh
    Biswas, Subir
    [J]. 2021 INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS & NETWORKS (COMSNETS), 2021, : 614 - 622
  • [3] Multi-agent reinforcement learning with adaptive mimetism
    Yamaguchi, T
    Miura, M
    Yachida, M
    [J]. ETFA '96 - 1996 IEEE CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION, PROCEEDINGS, VOLS 1 AND 2, 1996, : 288 - 294
  • [4] SCM network with multi-agent reinforcement learning
    Zhao, Gang
    Sun, Ruoying
    [J]. FIFTH WUHAN INTERNATIONAL CONFERENCE ON E-BUSINESS, VOLS 1-3, 2006, : 1294 - 1300
  • [5] MAGNet: Multi-agent Graph Network for Deep Multi-agent Reinforcement Learning
    Malysheva, Aleksandra
    Kudenko, Daniel
    Shpilman, Aleksei
    [J]. 2019 XVI INTERNATIONAL SYMPOSIUM PROBLEMS OF REDUNDANCY IN INFORMATION AND CONTROL SYSTEMS (REDUNDANCY), 2019, : 171 - 176
  • [6] Resource Management in Wireless Networks via Multi-Agent Deep Reinforcement Learning
    Naderializadeh, Navid
    Sydir, Jaroslaw J.
    Simsek, Meryem
    Nikopour, Hosein
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (06) : 3507 - 3523
  • [7] Resource Management in Wireless Networks via Multi-Agent Deep Reinforcement Learning
    Naderializadeh, Navid
    Sydir, Jaroslaw
    Simsek, Meryem
    Nikopour, Hosein
    [J]. PROCEEDINGS OF THE 21ST IEEE INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (IEEE SPAWC2020), 2020,
  • [8] Adaptive mean field multi-agent reinforcement learning
    Wang, Xiaoqiang
    Ke, Liangjun
    Zhang, Gewei
    Zhu, Dapeng
    [J]. INFORMATION SCIENCES, 2024, 669
  • [9] ADAPTIVE STATE REPRESENTATIONS FOR MULTI-AGENT REINFORCEMENT LEARNING
    De Hauwere, Yann-Michael
    Vrancx, Peter
    Nowe, Ann
    [J]. ICAART 2011: PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE, VOL 2, 2011, : 181 - 189
  • [10] Adaptive Average Exploration in Multi-Agent Reinforcement Learning
    Hall, Garrett
    Holladay, Ken
    [J]. 2020 AIAA/IEEE 39TH DIGITAL AVIONICS SYSTEMS CONFERENCE (DASC) PROCEEDINGS, 2020,