Network Maintenance Planning Via Multi-Agent Reinforcement Learning

被引:1
|
作者
Thomas, Jonathan [1 ]
Hernandez, Marco Perez [2 ]
Parlikad, Ajith Kumar [2 ]
Piechocki, Robert [1 ]
机构
[1] Univ Bristol, Commun Syst & Network Grp, Bristol, Avon, England
[2] Univ Cambridge, Inst Mfg, Cambridge, England
基金
英国工程与自然科学研究理事会;
关键词
POLICY;
D O I
10.1109/SMC52423.2021.9659150
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Within this work, the challenge of developing maintenance planning solutions for networked assets is considered. This is challenging due to the very nature of these systems which are often heterogeneous, distributed and have complex co-dependencies between the constituent components for effective operation. We develop a Multi-Agent Reinforcement Learning (MARL) solution for this domain and apply it to a simulated Radio Access Network (RAN) comprising of nine Base Stations (BS). Through empirical evaluation we show that our model outperforms fixed corrective and preventive maintenance policies in terms of network availability whilst generally utilizing less than or equal amounts of maintenance resource.
引用
收藏
页码:2289 / 2295
页数:7
相关论文
共 50 条
  • [1] Safe multi-agent motion planning via filtered reinforcement learning
    Vinod, Abraham P.
    Safaoui, Sleiman
    Chakrabarty, Ankush
    Quirynen, Rien
    Yoshikawa, Nobuyuki
    Di Cairano, Stefano
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2022, 2022, : 7270 - 7276
  • [2] Multi-agent Reinforcement Learning in Network Management
    Bagnasco, Ricardo
    Serrat, Joan
    [J]. SCALABILITY OF NETWORKS AND SERVICES, PROCEEDINGS, 2009, 5637 : 199 - 202
  • [3] SCM network with multi-agent reinforcement learning
    Zhao, Gang
    Sun, Ruoying
    [J]. FIFTH WUHAN INTERNATIONAL CONFERENCE ON E-BUSINESS, VOLS 1-3, 2006, : 1294 - 1300
  • [4] Multi-Agent Path Planning in Unknown Environment with Reinforcement Learning and Neural Network
    Luviano Cruz, David
    Yu, Wen
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), 2014, : 3458 - 3463
  • [5] Hierarchical reinforcement learning via dynamic subspace search for multi-agent planning
    Ma, Aaron
    Ouimet, Michael
    Cortes, Jorge
    [J]. AUTONOMOUS ROBOTS, 2020, 44 (3-4) : 485 - 503
  • [6] Hierarchical reinforcement learning via dynamic subspace search for multi-agent planning
    Aaron Ma
    Michael Ouimet
    Jorge Cortés
    [J]. Autonomous Robots, 2020, 44 : 485 - 503
  • [7] MAGNet: Multi-agent Graph Network for Deep Multi-agent Reinforcement Learning
    Malysheva, Aleksandra
    Kudenko, Daniel
    Shpilman, Aleksei
    [J]. 2019 XVI INTERNATIONAL SYMPOSIUM PROBLEMS OF REDUNDANCY IN INFORMATION AND CONTROL SYSTEMS (REDUNDANCY), 2019, : 171 - 176
  • [8] Multi-agent reinforcement learning as a rehearsal for decentralized planning
    Kraemer, Landon
    Banerjee, Bikramjit
    [J]. NEUROCOMPUTING, 2016, 190 : 82 - 94
  • [9] Multi-agent Reinforcement Learning for Urban Projects Planning
    Khelifa, Boudjemaa
    Laouar, Mohamed Ridda
    [J]. PROCEEDINGS OF THE 7TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND NEW TECHNOLOGIES (ICSENT '18), 2018,
  • [10] Cooperative Learning of Multi-Agent Systems Via Reinforcement Learning
    Wang, Xin
    Zhao, Chen
    Huang, Tingwen
    Chakrabarti, Prasun
    Kurths, Juergen
    [J]. IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2023, 9 : 13 - 23