DynAMO: Multi-agent reinforcement learning for dynamic anticipatory mesh optimization with applications to hyperbolic conservation laws

被引:1
|
作者
Dzanic, T. [1 ]
Mittal, K. [1 ]
Kim, D. [1 ,2 ]
Yang, J. [1 ]
Petrides, S. [1 ]
Keith, B. [1 ,2 ]
Anderson, R. [1 ]
机构
[1] Lawrence Livermore Natl Lab, Livermore, CA 94550 USA
[2] Brown Univ, Div Appl Math, Providence, RI 02912 USA
关键词
Adaptive mesh refinement; Finite element methods; Scientific machine learning; Reinforcement learning; Hyperbolic conservation laws; SUPERCONVERGENT PATCH RECOVERY; ERROR ESTIMATION; NEURAL-NETWORKS;
D O I
10.1016/j.jcp.2024.112924
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
We introduce DynAMO, a reinforcement learning paradigm for Dynamic Anticipatory Mesh Optimization. Adaptive mesh refinement is an effective tool for optimizing computational cost and solution accuracy in numerical methods for partial differential equations. However, traditional adaptive mesh refinement approaches for time -dependent problems typically rely only on instantaneous error indicators to guide adaptivity. As a result, standard strategies often require frequent remeshing to maintain accuracy. In the DynAMO approach, multi -agent reinforcement learning is used to discover new local refinement policies that can anticipate and respond to future solution states by producing meshes that deliver more accurate solutions for longer time intervals. By applying DynAMO to discontinuous Galerkin methods for the linear advection and compressible Euler equations in two dimensions, we demonstrate that this new mesh refinement paradigm can outperform conventional threshold -based strategies while also generalizing to different mesh sizes, remeshing and simulation times, and initial conditions.
引用
收藏
页数:37
相关论文
共 50 条
  • [31] Multi-agent Exploration with Reinforcement Learning
    Sygkounas, Alkis
    Tsipianitis, Dimitris
    Nikolakopoulos, George
    Bechlioulis, Charalampos P.
    2022 30TH MEDITERRANEAN CONFERENCE ON CONTROL AND AUTOMATION (MED), 2022, : 630 - 635
  • [32] Partitioning in multi-agent reinforcement learning
    Sun, R
    Peterson, T
    FROM ANIMALS TO ANIMATS 6, 2000, : 325 - 332
  • [33] The Dynamics of Multi-Agent Reinforcement Learning
    Dickens, Luke
    Broda, Krysia
    Russo, Alessandra
    ECAI 2010 - 19TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2010, 215 : 367 - 372
  • [34] Multi-agent reinforcement learning: A survey
    Busoniu, Lucian
    Babuska, Robert
    De Schutter, Bart
    2006 9TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION, VOLS 1- 5, 2006, : 1133 - +
  • [35] Skill matters: Dynamic skill learning for multi-agent cooperative reinforcement learning
    Li, Tong
    Bai, Chenjia
    Xu, Kang
    Chu, Chen
    Zhu, Peican
    Wang, Zhen
    NEURAL NETWORKS, 2025, 181
  • [36] LDSA: Learning Dynamic Subtask Assignment in Cooperative Multi-Agent Reinforcement Learning
    Yang, Mingyu
    Zhao, Jian
    Hu, Xunhan
    Zhou, Wengang
    Zhu, Jiangcheng
    Li, Houqiang
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [37] Multi-Agent Deep Reinforcement Learning for Multi-Robot Applications: A Survey
    Orr, James
    Dutta, Ayan
    SENSORS, 2023, 23 (07)
  • [38] Efficient multi-agent reinforcement learning HVAC power consumption optimization
    Miao, Chenyang
    Cui, Yunduan
    Li, Huiyun
    Wu, Xinyu
    ENERGY REPORTS, 2024, 12 : 5420 - 5431
  • [39] Multi-Agent Reinforcement Learning for Training and Non-Linear Optimization
    Morcos, Amir
    West, Aaron
    Maguire, Brian
    ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING FOR MULTI-DOMAIN OPERATIONS APPLICATIONS IV, 2022, 12113
  • [40] GOMARL: Global Optimization of Multiplier using Multi-Agent Reinforcement Learning
    Feng, Yi
    Wang, Chao
    2024 INTERNATIONAL SYMPOSIUM OF ELECTRONICS DESIGN AUTOMATION, ISEDA 2024, 2024, : 728 - 733