Adaptive Wireless Network Management with Multi-Agent Reinforcement Learning

被引:4
|
作者
Ivoghlian, Ameer [1 ]
Salcic, Zoran [1 ]
Wang, Kevin I-Kai [1 ]
机构
[1] Univ Auckland, Dept Elect Comp & Software Engn, Auckland 1010, New Zealand
关键词
large scale networks; congestion; reinforcement learning; multi-agent; LoRaWAN; fairness; application awareness;
D O I
10.3390/s22031019
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Wireless networks are trending towards large scale systems, containing thousands of nodes, with multiple co-existing applications. Congestion is an inevitable consequence of this scale and complexity, which leads to inefficient use of the network capacity. This paper proposes an autonomous and adaptive wireless network management framework, utilising multi-agent deep reinforcement learning, to achieve efficient use of the network. Its novel reward function incorporates application awareness and fairness to address both node and network level objectives. Our experimental results demonstrate the proposed approach's ability to be optimised for application-specific requirements, while optimising the fairness of the network. The results reveal significant performance benefits in terms of adaptive data rate and an increase in responsiveness compared to a single-agent approach. Some significant qualitative benefits of the multi-agent approach-network size independence, node-led priorities, variable iteration length, and reduced search space-are also presented and discussed.
引用
收藏
页数:20
相关论文
共 50 条
  • [41] Multi-agent Exploration with Reinforcement Learning
    Sygkounas, Alkis
    Tsipianitis, Dimitris
    Nikolakopoulos, George
    Bechlioulis, Charalampos P.
    [J]. 2022 30TH MEDITERRANEAN CONFERENCE ON CONTROL AND AUTOMATION (MED), 2022, : 630 - 635
  • [42] Hierarchical multi-agent reinforcement learning
    Ghavamzadeh, Mohammad
    Mahadevan, Sridhar
    Makar, Rajbala
    [J]. AUTONOMOUS AGENTS AND MULTI-AGENT SYSTEMS, 2006, 13 (02) : 197 - 229
  • [43] Applying multi-agent deep reinforcement learning for contention window optimization to enhance wireless network performance
    Ke, Chih-Heng
    Astuti, Lia
    [J]. ICT EXPRESS, 2023, 9 (05): : 776 - 782
  • [44] Enabling Reinforcement Learning for Network Slice Management in Multi-Agent 5G Networks
    Tufeanu, Larisa-Mihaela
    Vochin, Marius-Constantin
    Paraschiv, Constantin-Laurentiu
    Li, Frank Y.
    [J]. 2023 IEEE 9TH WORLD FORUM ON INTERNET OF THINGS, WF-IOT, 2023,
  • [45] Learning to Routing in UAV Swarm Network: A Multi-Agent Reinforcement Learning Approach
    Wang, Zunliang
    Yao, Haipeng
    Mai, Tianle
    Xiong, Zehui
    Wu, Xiaohua
    Wu, Di
    Guo, Song
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (05) : 6611 - 6624
  • [46] Multi-Agent Reinforcement Learning for Integrated Network of Adaptive Traffic Signal Controllers (MARLIN-ATSC)
    El-Tantawy, Samah
    Abdulhai, Baher
    [J]. 2012 15TH INTERNATIONAL IEEE CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2012, : 319 - 326
  • [47] Distributed Multi-agent Reinforcement Learning for Directional UAV Network Control
    He, Linsheng
    Zhao, Jiamiao
    Hu, Fei
    [J]. PROCEEDINGS OF THE 32ND INTERNATIONAL SYMPOSIUM ON HIGH-PERFORMANCE PARALLEL AND DISTRIBUTED COMPUTING, HPDC 2023, 2023, : 317 - 318
  • [48] Multi-agent Reinforcement Learning for Swarm Retrieval with Evolving Neural Network
    Vaughan, Neil
    [J]. BIOMIMETIC AND BIOHYBRID SYSTEMS, 2018, 10928 : 522 - 526
  • [49] Multi-Agent Reinforcement Learning for Network Load Balancing in Data Center
    Yao, Zhiyuan
    Ding, Zihan
    Clausen, Thomas
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 3594 - 3603
  • [50] Multi-Agent Reinforcement Learning for Dynamic Topology Optimization of Mesh Wireless Networks
    Sun, Wei
    Lv, Qiushuo
    Xiao, Yang
    Liu, Zhi
    Tang, Qingwei
    Li, Qiyue
    Mu, Daoming
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (09) : 10501 - 10513