Modelling of hydrological persistence for hidden state Markov decision processes

被引：0

作者：

Aiden Fisher

David Green

Andrew Metcalfe

机构：

[1] University of Adelaide,

来源：

Annals of Operations Research | 2012年 / 199卷

关键词：

Hidden Markov model; Hidden state Markov decision process; Reservoir operation;

D O I：

暂无

中图分类号：

学科分类号：

摘要：

A reservoir in south east Queensland can supply irrigators, industry or domestic users. Stochastic inflow is modelled by a hidden state Markov chain, with three hidden states corresponding to prevailing climatic conditions. A stochastic dynamic program that relies on estimation of the hidden state is implemented. The optimal decisions are compared with those obtained if the hidden state Markov chain model is replaced with a model that relies on the Southern Oscillation Index to define prevailing climatic conditions.

引用

页码：215 / 224

页数：9

共 50 条

[21] Markov Decision Processes
Bäuerle N.
Rieder U.
Jahresbericht der Deutschen Mathematiker-Vereinigung, 2010, 112 (4) : 217 - 243
[22] EXTREME OCCUPATION MEASURES IN MARKOV DECISION PROCESSES WITH AN ABSORBING STATE
Piunovskiy, Alexey
Zhang, Yi
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2024, 62 (01) : 65 - 90
[23] Constrained discounted Markov decision processes with Borel state spaces
Feinberg, Eugene A.
Jaskiewicz, Anna
Nowak, Andrzej S.
AUTOMATICA, 2020, 111
[24] A learning algorithm for Markov decision processes with adaptive state aggregation
Baras, JS
Borkar, VS
PROCEEDINGS OF THE 39TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-5, 2000, : 3351 - 3356
[25] On the controller synthesis for finite-state Markov decision processes
Kucera, A
Strazovsky, O
FSTTCS 2005: FOUNDATIONS OF SOFTWARE TECHNOLOGY AND THEORETICAL COMPUTER SCIENCE, PROCEEDINGS, 2005, 3821 : 541 - 552
[26] The value iteration method for countable state Markov decision processes
Aviv, Y
Federgruen, A
OPERATIONS RESEARCH LETTERS, 1999, 24 (05) : 223 - 234
[27] Semiparametric estimation of Markov decision processes with continuous state space
Srisuma, Sorawoot
Linton, Oliver
JOURNAL OF ECONOMETRICS, 2012, 166 (02) : 320 - 341
[28] On the controller synthesis for finite-state Markov decision processes
Kucera, Antonin
Strazovsky, Oldrich
FUNDAMENTA INFORMATICAE, 2008, 82 (1-2) : 141 - 153
[29] Blackwell optimality in Markov decision processes with a Borel state space
Yushkevich, AA
PROCEEDINGS OF THE 36TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-5, 1997, : 2827 - 2830
[30] Pseudometrics for state aggregation in average reward Markov decision processes
Ortner, Ronald
ALGORITHMIC LEARNING THEORY, PROCEEDINGS, 2007, 4754 : 373 - 387

← 1 2 3 4 5 →