ENHANCING SAMPLE EFFICIENCY FOR TEMPERATURE CONTROL IN DED WITH REINFORCEMENT LEARNING AND MOOSE FRAMEWORK

被引:0
|
作者
Sousa, Joao [1 ,4 ,5 ]
Darabi, Roya [1 ,2 ]
Sousa, Armando [2 ,3 ]
Reis, Luis P. [2 ,4 ]
Brueckner, Frank [5 ]
Reis, Ana [1 ,2 ]
de Sa, Jose Cesar [1 ]
机构
[1] Inst Sci & Innovat Mech & Ind Engn INEGI, Porto, Portugal
[2] Univ Porto, Fac Engn, Porto, Portugal
[3] INESC Technol & Sci INESC TEC, Porto, Portugal
[4] Artificial Intelligence & Comp Sci Lab LIACC, Porto, Portugal
[5] Fraunhofer IWS, Dresden, Germany
关键词
MOOSE; DED; Reinforcement Learning; Model-Based; Q-learning; Dyna-Q;
D O I
暂无
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Directed Energy Deposition (DED) is crucial in additive manufacturing for various industries like aerospace, automotive, and biomedical. Precise temperature control is essential due to high-power lasers and dynamic environmental changes. Employing Reinforcement Learning (RL) can help with temperature control, but challenges arise from standardization and sample efficiency. In this study, a model-based Reinforcement Learning (MBRL) approach is used to train a DED model, improving control and efficiency. Computational models evaluate melt pool geometry and temporal characteristics during the process. The study employs the Allen-Cahn phase field (AC-PF) model using the Finite Element Method (FEM) with the Multi-physics Object-Oriented Simulation Environment (MOOSE). MBRL, specifically Dyna-Q+, outperforms traditional Q-learning, requiring fewer samples. Insights from this research aid in advancing RL techniques for laser metal additive manufacturing.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Enhancing HVAC Control Efficiency: A Hybrid Approach Using Imitation and Reinforcement Learning
    Kadamala, Kevlyn
    Chambers, Des
    Barrett, Enda
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES-APPLIED DATA SCIENCE TRACK, PT IX, ECML PKDD 2024, 2024, 14949 : 256 - 270
  • [2] Enhancing Greenhouse Efficiency: Integrating IoT and Reinforcement Learning for Optimized Climate Control
    Platero-Horcajadas, Manuel
    Pardo-Pina, Sofia
    Camara-Zapata, Jose-Maria
    Brenes-Carranza, Jose-Antonio
    Ferrandez-Pastor, Francisco-Javier
    SENSORS, 2024, 24 (24)
  • [3] Improving Sample Efficiency of Multiagent Reinforcement Learning With Nonexpert Policy for Flocking Control
    Qiu, Yunbo
    Jin, Yue
    Yu, Lebin
    Wang, Jian
    Wang, Yu
    Zhang, Xudong
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (16) : 14014 - 14027
  • [4] Surrogate Models for Enhancing the Efficiency of Neuroevolution in Reinforcement Learning
    Stork, Joerg
    Zaefferer, Martin
    Bartz-Beielstein, Thomas
    Eiben, A. E.
    PROCEEDINGS OF THE 2019 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE (GECCO'19), 2019, : 934 - 942
  • [5] Balancing Sample Efficiency and Suboptimality in Inverse Reinforcement Learning
    Damiani, Angelo
    Manganini, Giorgio
    Metelli, Alberto Maria
    Restelli, Marcello
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [6] Study of sample efficiency improvements for reinforcement learning algorithms
    Tianyue Cao
    2020 9TH IEEE INTEGRATED STEM EDUCATION CONFERENCE (ISEC 2020), 2020,
  • [7] Enhancing air traffic control: A transparent deep reinforcement learning framework for autonomous conflict resolution
    Wang, Lei
    Yang, Hongyu
    Lin, Yi
    Yin, Suwan
    Wu, Yuankai
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 260
  • [8] Deep Reinforcement Learning with Online Data Augmentation to Improve Sample Efficiency for Intelligent HVAC Control
    Kurte, Kuldeep
    Amasyali, Kadir
    Munk, Jeffrey
    Zandi, Helia
    PROCEEDINGS OF THE 2022 THE 9TH ACM INTERNATIONAL CONFERENCE ON SYSTEMS FOR ENERGY-EFFICIENT BUILDINGS, CITIES, AND TRANSPORTATION, BUILDSYS 2022, 2022, : 479 - 483
  • [9] Enhancing the Performance of Adaptive Iterative Learning Control with Reinforcement Learning
    Nemec, Bojan
    Simonic, Mihael
    Likar, Nejc
    Ude, Ales
    2017 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2017, : 2192 - 2199
  • [10] Enhancing Energy Efficiency in Electrical Systems with Reinforcement Learning Algorithms
    Patil, P. S.
    Janrao, Surekha
    Diwate, Ajay D.
    Tayal, Madhuri A.
    Selokar, Pradip Ram
    Bhosle, Amol A.
    JOURNAL OF ELECTRICAL SYSTEMS, 2024, 20 (01) : 230 - 243