ENHANCING SAMPLE EFFICIENCY FOR TEMPERATURE CONTROL IN DED WITH REINFORCEMENT LEARNING AND MOOSE FRAMEWORK

被引:0
|
作者
Sousa, Joao [1 ,4 ,5 ]
Darabi, Roya [1 ,2 ]
Sousa, Armando [2 ,3 ]
Reis, Luis P. [2 ,4 ]
Brueckner, Frank [5 ]
Reis, Ana [1 ,2 ]
de Sa, Jose Cesar [1 ]
机构
[1] Inst Sci & Innovat Mech & Ind Engn INEGI, Porto, Portugal
[2] Univ Porto, Fac Engn, Porto, Portugal
[3] INESC Technol & Sci INESC TEC, Porto, Portugal
[4] Artificial Intelligence & Comp Sci Lab LIACC, Porto, Portugal
[5] Fraunhofer IWS, Dresden, Germany
来源
PROCEEDINGS OF ASME 2023 INTERNATIONAL MECHANICAL ENGINEERING CONGRESS AND EXPOSITION, IMECE2023, VOL 3 | 2023年
关键词
MOOSE; DED; Reinforcement Learning; Model-Based; Q-learning; Dyna-Q;
D O I
暂无
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Directed Energy Deposition (DED) is crucial in additive manufacturing for various industries like aerospace, automotive, and biomedical. Precise temperature control is essential due to high-power lasers and dynamic environmental changes. Employing Reinforcement Learning (RL) can help with temperature control, but challenges arise from standardization and sample efficiency. In this study, a model-based Reinforcement Learning (MBRL) approach is used to train a DED model, improving control and efficiency. Computational models evaluate melt pool geometry and temporal characteristics during the process. The study employs the Allen-Cahn phase field (AC-PF) model using the Finite Element Method (FEM) with the Multi-physics Object-Oriented Simulation Environment (MOOSE). MBRL, specifically Dyna-Q+, outperforms traditional Q-learning, requiring fewer samples. Insights from this research aid in advancing RL techniques for laser metal additive manufacturing.
引用
收藏
页数:17
相关论文
共 50 条
  • [31] A Predictive Reinforcement Learning Approach for Temperature Control in Buildings
    Ferrarini, Luca
    IFAC PAPERSONLINE, 2023, 56 (02): : 11032 - 11037
  • [32] Supply temperature control of a heating network with reinforcement learning
    Ghane, Sara
    Jacobs, Stef
    Casteels, Wim
    Brembilla, Christian
    Mercelis, Siegfried
    Latre, Steven
    Verhaert, Ivan
    Hellinckx, Peter
    2021 IEEE INTERNATIONAL SMART CITIES CONFERENCE (ISC2), 2021,
  • [33] Cascade control of underactuated manipulator based on reinforcement learning framework
    Jiang, Naijing
    Guo, Dingxu
    Zhang, Shu
    Zhang, Dan
    Xu, Jian
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART I-JOURNAL OF SYSTEMS AND CONTROL ENGINEERING, 2023, 237 (02) : 231 - 243
  • [34] Reinforcement learning framework for adaptive control of nonlinear chemical processes
    Shah, Hitesh
    Gopal, Madan
    ASIA-PACIFIC JOURNAL OF CHEMICAL ENGINEERING, 2011, 6 (01) : 138 - 146
  • [35] LORM: a novel reinforcement learning framework for biped gait control
    Zhang, Weiyi
    Jiang, Yancao
    Farrukh, Fasih Ud Din
    Zhang, Chun
    Zhang, Debing
    Wang, Guangqi
    PEERJ COMPUTER SCIENCE, 2022, 8
  • [36] Occupant-centric HVAC and window control: A reinforcement learning model for enhancing indoor thermal comfort and energy efficiency
    Liu, Xin
    Gou, Zhonghua
    BUILDING AND ENVIRONMENT, 2024, 250
  • [37] A reinforcement learning framework for parameter control in computer vision applications
    Taylor, GW
    1ST CANADIAN CONFERENCE ON COMPUTER AND ROBOT VISION, PROCEEDINGS, 2004, : 496 - 503
  • [38] Applications of reinforcement learning for building energy efficiency control: A review
    Fu, Qiming
    Han, Zhicong
    Chen, Jianping
    Lu, You
    Wu, Hongjie
    Wang, Yunzhe
    JOURNAL OF BUILDING ENGINEERING, 2022, 50
  • [39] A Reinforcement Learning Approach to CAV and Intersection Control for Energy Efficiency
    Wang, Enshu
    Memar, Foad Hajiaghajani
    Korzelius, Steven
    Sadek, Adel W.
    Qiao, Chunming
    2022 FIFTH INTERNATIONAL CONFERENCE ON CONNECTED AND AUTONOMOUS DRIVING (METROCAD 2022), 2022, : 81 - 88
  • [40] Enhancing HVAC control systems through transfer learning with deep reinforcement learning agents
    Kadamala, Kevlyn
    Chambers, Des
    Barrett, Enda
    SMART ENERGY, 2024, 13