Deep reinforcement learning for continuous wood drying production line control

被引:1
|
作者
Tremblay, Francois-Alexandre [1 ,2 ]
Durand, Audrey [2 ,4 ]
Morin, Michael [1 ,3 ]
Marier, Philippe [2 ]
Gaudreault, Jonathan [1 ,2 ]
机构
[1] Univ Laval, FORAC Res Consortium, Quebec City, PQ G1V 0A6, Canada
[2] Univ Laval, Dept Comp Sci & Software Engn, Quebec City, PQ G1V 0A6, Canada
[3] Univ Laval, Dept Operat & Decis Syst, Quebec City, PQ G1V 0A6, Canada
[4] Canada CIFAR AI Chair, Toronto, ON, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Deep reinforcement learning; Production control; Robustness; Discrete-event simulation; Forest-products industry; OPTIMIZATION;
D O I
10.1016/j.compind.2023.104036
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Continuous high-frequency wood drying, when integrated with a traditional wood finishing line, allows correcting moisture content one piece of lumber at a time in order to improve its value. However, the integration of this precision drying process complicates sawmills logistics. The high stochasticity of lumber properties and less than ideal lumber routing decisions may cause bottlenecks and reduces productivity. To counteract this problem and fully exploit the technology, we propose to use reinforcement learning (RL) for learning continuous drying operation policies. An RL agent interacts with a simulated model of the finishing line to optimize its policies. Our results, based on multiple simulations, show that the learned policies outperform the heuristic currently used in industry and are robust to sudden disturbances which frequently occur in real contexts.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Benchmarking Deep Reinforcement Learning for Continuous Control
    Duan, Yan
    Chen, Xi
    Houthooft, Rein
    Schulman, John
    Abbeel, Pieter
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48
  • [2] Continuous control of a polymerization system with deep reinforcement learning
    Ma, Yan
    Zhu, Wenbo
    Benton, Michael G.
    Romagnoli, Jose
    [J]. JOURNAL OF PROCESS CONTROL, 2019, 75 : 40 - 47
  • [3] Hierarchical Deep Reinforcement Learning for Continuous Action Control
    Yang, Zhaoyang
    Merrick, Kathryn
    Jin, Lianwen
    Abbass, Hussein A.
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (11) : 5174 - 5184
  • [4] Continuous Control in Car Simulator with Deep Reinforcement Learning
    Yang, Fan
    Wang, Ping
    Wang, XinHong
    [J]. PROCEEDINGS OF 2018 THE 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ARTIFICIAL INTELLIGENCE (CSAI 2018) / 2018 THE 10TH INTERNATIONAL CONFERENCE ON INFORMATION AND MULTIMEDIA TECHNOLOGY (ICIMT 2018), 2018, : 566 - 570
  • [5] Deep Reinforcement Learning for Continuous Control of Material Thickness
    Dippel, Oliver
    Lisitsa, Alexei
    Peng, Bei
    [J]. ARTIFICIAL INTELLIGENCE XL, AI 2023, 2023, 14381 : 321 - 334
  • [6] Autoregressive Policies for Continuous Control Deep Reinforcement Learning
    Korenkevych, Dmytro
    Mahmood, A. Rupam
    Vasan, Gautham
    Bergstra, James
    [J]. PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 2754 - 2762
  • [7] Continuous Control of an Underground Loader Using Deep Reinforcement Learning
    Backman, Sofi
    Lindmark, Daniel
    Bodin, Kenneth
    Servin, Martin
    Mork, Joakim
    Lofgren, Hakan
    [J]. MACHINES, 2021, 9 (10)
  • [8] Continuous Control with Deep Reinforcement Learning for Mobile Robot Navigation
    Xiang, Jiaqi
    Li, Qingdong
    Dong, Xiwang
    Ren, Zhang
    [J]. 2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 1501 - 1506
  • [9] Continuous Control of a Soft Continuum Arm using Deep Reinforcement Learning
    Satheeshbabu, Sreeshankar
    Uppalapati, Naveen K.
    Fu, Tianshi
    Krishnan, Girish
    [J]. 2020 3RD IEEE INTERNATIONAL CONFERENCE ON SOFT ROBOTICS (ROBOSOFT), 2020, : 497 - 503
  • [10] Policy ensemble gradient for continuous control problems in deep reinforcement learning
    Liu, Guoqiang
    Chen, Gang
    Huang, Victoria
    [J]. NEUROCOMPUTING, 2023, 548