Deep reinforcement learning for continuous wood drying production line control

被引:1
|
作者
Tremblay, Francois-Alexandre [1 ,2 ]
Durand, Audrey [2 ,4 ]
Morin, Michael [1 ,3 ]
Marier, Philippe [2 ]
Gaudreault, Jonathan [1 ,2 ]
机构
[1] Univ Laval, FORAC Res Consortium, Quebec City, PQ G1V 0A6, Canada
[2] Univ Laval, Dept Comp Sci & Software Engn, Quebec City, PQ G1V 0A6, Canada
[3] Univ Laval, Dept Operat & Decis Syst, Quebec City, PQ G1V 0A6, Canada
[4] Canada CIFAR AI Chair, Toronto, ON, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Deep reinforcement learning; Production control; Robustness; Discrete-event simulation; Forest-products industry; OPTIMIZATION;
D O I
10.1016/j.compind.2023.104036
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Continuous high-frequency wood drying, when integrated with a traditional wood finishing line, allows correcting moisture content one piece of lumber at a time in order to improve its value. However, the integration of this precision drying process complicates sawmills logistics. The high stochasticity of lumber properties and less than ideal lumber routing decisions may cause bottlenecks and reduces productivity. To counteract this problem and fully exploit the technology, we propose to use reinforcement learning (RL) for learning continuous drying operation policies. An RL agent interacts with a simulated model of the finishing line to optimize its policies. Our results, based on multiple simulations, show that the learned policies outperform the heuristic currently used in industry and are robust to sudden disturbances which frequently occur in real contexts.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Reinforcement learning for continuous stochastic control problems
    Munos, R
    Bourgine, P
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 10, 1998, 10 : 1029 - 1035
  • [42] On-line learning control by association and reinforcement
    Si, J
    Wang, YT
    [J]. IJCNN 2000: PROCEEDINGS OF THE IEEE-INNS-ENNS INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOL III, 2000, : 221 - 226
  • [43] On-line learning control by association and reinforcement
    Si, J
    Wang, YT
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2001, 12 (02): : 264 - 276
  • [44] DEEP REINFORCEMENT LEARNING FOR TRANSFER OF CONTROL POLICIES
    Cunningham, James D.
    Miller, Simon W.
    Yukish, Michael A.
    Simpson, Timothy W.
    Tucker, Conrad S.
    [J]. PROCEEDINGS OF THE ASME INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, 2019, VOL 2A, 2020,
  • [45] Deep Reinforcement Learning to Assist Command and Control
    Park, Song Jun
    Vindiola, Manuel M.
    Logie, Anne C.
    Narayanan, Priya
    Davies, Jared
    [J]. ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING FOR MULTI-DOMAIN OPERATIONS APPLICATIONS IV, 2022, 12113
  • [46] Control of chaotic systems by deep reinforcement learning
    Bucci, M. A.
    Semeraro, O.
    Allauzen, A.
    Wisniewski, G.
    Cordier, L.
    Mathelin, L.
    [J]. PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2019, 475 (2231):
  • [47] Deep Decentralized Reinforcement Learning for Cooperative Control
    Koepf, Florian
    Tesfazgi, Samuel
    Flad, Michael
    Hohmann, Soeren
    [J]. IFAC PAPERSONLINE, 2020, 53 (02): : 1555 - 1562
  • [48] Deep reinforcement learning for quantum gate control
    An, Zheng
    Zhou, D. L.
    [J]. EPL, 2019, 126 (06)
  • [49] Deep Reinforcement Learning for Building HVAC Control
    Wei, Tianshu
    Wang, Yanzhi
    Zhu, Qi
    [J]. PROCEEDINGS OF THE 2017 54TH ACM/EDAC/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2017,
  • [50] Framework for Control and Deep Reinforcement Learning in Traffic
    Wu, Cathy
    Parvate, Kanaad
    Kheterpal, Nishant
    Dickstein, Leah
    Mehta, Ankur
    Vinitsky, Eugene
    Bayen, Alexandre M.
    [J]. 2017 IEEE 20TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2017,