Comparing approximation techniques to continuous-time stochastic dynamic programming problems: Applications to natural resource modelling

被引:6
|
作者
Kompas, Tom [1 ]
Chu, Long [1 ]
机构
[1] Australian Natl Univ, Crawford Sch Econ & Govt, Canberra, ACT 0200, Australia
关键词
Continuous-time stochastic dynamic programming; Parametric approximation; Perturbation method; Projection technique; Linear programming; Natural resource management; Fisheries management; Marine reserves;
D O I
10.1016/j.envsoft.2012.04.002
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Dynamic programming problems are common in economics, finance and natural resource management. However, exact solutions to these problems are exceptional. Instead, solutions typically rely on numerical approximation techniques which vary in use, complexity and computational requirements. Perturbation, projection and linear programming approaches are among the most useful of these numerical techniques. In this paper, we extend the parametric linear programming technique to include continuous-time problems with jump-diffusion processes, and compare it to projection and perturbation techniques for solving dynamic programming problems in terms of computational speed, accuracy, ease of use and scope. The comparisons are drawn from solutions to two fisheries management problems - a unidimensional model of optimal harvest and a multidimensional model for optimal marine reserve size. Available computer code illustrates how each technique solves these problems and how they can be applied to other comparable problems in natural resource modelling. (C) 2012 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1 / 12
页数:12
相关论文
共 50 条
  • [1] ON CONTINUOUS-TIME DISCOUNTED STOCHASTIC DYNAMIC-PROGRAMMING
    LAI, HC
    TANAKA, K
    APPLIED MATHEMATICS AND OPTIMIZATION, 1991, 23 (02): : 155 - 169
  • [2] SOLVING A CLASS OF CONTINUOUS-TIME CONVEX PROGRAMMING PROBLEMS WITH APPROXIMATION
    Wen, Ching-Feng
    JOURNAL OF NONLINEAR AND CONVEX ANALYSIS, 2012, 13 (03) : 397 - 419
  • [3] Continuous-Time Stochastic Policy Iteration of Adaptive Dynamic Programming
    Wei, Qinglai
    Zhou, Tianmin
    Lu, Jingwei
    Liu, Yu
    Su, Shuai
    Xiao, Jun
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (10): : 6375 - 6387
  • [4] Motion Planning for Continuous-Time Stochastic Processes: A Dynamic Programming Approach
    Esfahani, Peyman Mohajerin
    Chatterjee, Debasish
    Lygeros, John
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2016, 61 (08) : 2155 - 2170
  • [5] Robust adaptive dynamic programming for continuous-time linear stochastic systems
    Bian, Tao
    Jiang, Zhong-Ping
    2014 IEEE INTERNATIONAL SYMPOSIUM ON INTELLIGENT CONTROL (ISIC), 2014, : 536 - 541
  • [6] CONTINUOUS-TIME ROBUST DYNAMIC PROGRAMMING
    Bian, Tao
    Jiang, Zhong-Ping
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2019, 57 (06) : 4150 - 4174
  • [7] ON A CONTINUOUS-TIME STOCHASTIC-APPROXIMATION PROBLEM
    YIN, G
    GUPTA, I
    ACTA APPLICANDAE MATHEMATICAE, 1993, 33 (01) : 3 - 20
  • [8] Some models of continuous-time stochastic approximation
    Knopov, PS
    CYBERNETICS AND SYSTEMS ANALYSIS, 1995, 31 (06) : 863 - 868
  • [9] PRINCIPLES OF STOCHASTIC DYNAMIC OPTIMIZATION IN RESOURCE-MANAGEMENT - THE CONTINUOUS-TIME CASE
    LARSON, BA
    AGRICULTURAL ECONOMICS, 1992, 7 (02) : 91 - 107
  • [10] DUALITY FOR A CLASS OF CONTINUOUS-TIME PROGRAMMING PROBLEMS
    Preda, Vasile
    PROCEEDINGS OF THE ROMANIAN ACADEMY SERIES A-MATHEMATICS PHYSICS TECHNICAL SCIENCES INFORMATION SCIENCE, 2009, 10 (03): : 222 - 225