Optimizing high-dimensional stochastic forestry via reinforcement learning

被引:7
|
作者
Tahvonen, Olli [1 ]
Suominen, Antti [2 ]
Malo, Pekka [2 ]
Viitasaari, Lauri [3 ]
Parkatti, Vesa-Pekka [1 ]
机构
[1] Univ Helsinki, Dept Econ, Helsinki, Finland
[2] Aalto Univ Sch Business, Dept Informat & Serv Management, Espoo, Finland
[3] Uppsala Univ, Dept Math, Uppsala, Sweden
来源
关键词
C61; Q23; Artificial intelligence; Reinforcement learning; Forestry; Stochasticity; Curse of dimensionality; Optimal rotation; Natural resources; MIXED-SPECIES STANDS; ANY-AGED MANAGEMENT; ROTATION PROBLEM; PRICE; RISK; SIZE; ENVIRONMENT; RESOURCE; POLICIES;
D O I
10.1016/j.jedc.2022.104553
中图分类号
F [经济];
学科分类号
02 ;
摘要
In proceeding beyond the generic optimal rotation model, forest economic research has applied various specifications that aim to circumvent the problems of high dimensional-ity. We specify an age-and size-structured mixed-species optimal harvesting model with binary variables for harvest timing, stochastic stand growth, and stochastic prices. Rein-forcement learning allows solving this high-dimensional model without simplifications. In addition to presenting new features in reservation price schedules and effects of stochas-ticity, our setup allows evaluating the simplifications in the existing research. We find that one-or two-dimensional models lose a high fraction of attainable economic output while the commonly applied size-structured matrix model overestimates economic profitability, yields deviations in harvest timing, including optimal rotation, and dilutes the effects of stochasticity. Reinforcement learning is found to be an efficient and promising method for detailed age-and size-structured optimization models in resource economics. (c) 2022 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY license ( http://creativecommons.org/licenses/by/4.0/ )
引用
收藏
页数:23
相关论文
共 50 条
  • [1] Offline reinforcement learning in high-dimensional stochastic environments
    Félicien Hêche
    Oussama Barakat
    Thibaut Desmettre
    Tania Marx
    Stephan Robert-Nicoud
    Neural Computing and Applications, 2024, 36 : 585 - 598
  • [2] Offline reinforcement learning in high-dimensional stochastic environments
    Heche, Felicien
    Barakat, Oussama
    Desmettre, Thibaut
    Marx, Tania
    Robert-Nicoud, Stephan
    NEURAL COMPUTING & APPLICATIONS, 2023, 36 (2): : 585 - 598
  • [3] Optimizing high-dimensional forestry for wood production and carbon sinks
    Tahvonen, Olli
    Suominen, Antti
    Parkatti, Vesa-Pekka
    Malo, Pekka
    CANADIAN JOURNAL OF FOREST RESEARCH, 2024, : 877 - 894
  • [4] High-dimensional Function Optimisation by Reinforcement Learning
    Wu, Q. H.
    Liao, H. L.
    2010 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2010,
  • [5] Reinforcement learning for high-dimensional problems with symmetrical actions
    Kamal, MAS
    Murata, J
    2004 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN & CYBERNETICS, VOLS 1-7, 2004, : 6192 - 6197
  • [6] Challenges in High-Dimensional Reinforcement Learning with Evolution Strategies
    Mueller, Nils
    Glasmachers, Tobias
    PARALLEL PROBLEM SOLVING FROM NATURE - PPSN XV, PT II, 2018, 11102 : 411 - 423
  • [7] Emergent Solutions to High-Dimensional Multitask Reinforcement Learning
    Kelly, Stephen
    Heywood, Malcolm, I
    EVOLUTIONARY COMPUTATION, 2018, 26 (03) : 347 - 380
  • [8] Human motion analysis in medical robotics via high-dimensional inverse reinforcement learning
    Li, Kun
    Burdick, Joel W.
    INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2020, 39 (05): : 568 - 585
  • [9] Machine learning for high-dimensional dynamic stochastic economies
    Scheidegger, Simon
    Bilionis, Ilias
    JOURNAL OF COMPUTATIONAL SCIENCE, 2019, 33 : 68 - 82
  • [10] High-Dimensional Stock Portfolio Trading with Deep Reinforcement Learning
    Pigorsch, Uta
    Schaefer, Sebastian
    2022 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE FOR FINANCIAL ENGINEERING AND ECONOMICS (CIFER), 2022,