Modelling of hydrological persistence for hidden state Markov decision processes

被引：0
|
作者：
Aiden Fisher
David Green
Andrew Metcalfe
机构：
[1] University of Adelaide,
来源：
Annals of Operations Research | 2012年 / 199卷
关键词：
Hidden Markov model; Hidden state Markov decision process; Reservoir operation;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
A reservoir in south east Queensland can supply irrigators, industry or domestic users. Stochastic inflow is modelled by a hidden state Markov chain, with three hidden states corresponding to prevailing climatic conditions. A stochastic dynamic program that relies on estimation of the hidden state is implemented. The optimal decisions are compared with those obtained if the hidden state Markov chain model is replaced with a model that relies on the Southern Oscillation Index to define prevailing climatic conditions.
引用
收藏
页码：215 / 224
页数：9
相关论文
共 50 条
  • [31] Learning Decision by Hidden Markov Model
    Benyacoub, Badreddine
    ELMoudden, Ismail
    ElBernoussi, Souad
    Zoglat, Abdelhak
    CRAFTING GLOBAL COMPETITIVE ECONOMIES: 2020 VISION STRATEGIC PLANNING & SMART IMPLEMENTATION, VOLS I-IV, 2014, : 2238 - 2246
  • [32] Finite State Approximations of Markov Decision Processes with General State and Action Spaces
    Saldi, Naci
    Linder, Tamas
    Yueksel, Serdar
    2015 AMERICAN CONTROL CONFERENCE (ACC), 2015, : 3589 - 3594
  • [33] Exact solution of the hidden Markov processes
    Saakian, David B.
    PHYSICAL REVIEW E, 2017, 96 (05)
  • [34] Ambiguity rate of hidden Markov processes
    Jurgens, Alexandra M.
    Crutchfield, James P.
    PHYSICAL REVIEW E, 2021, 104 (06)
  • [35] Regular Decision Processes: Modelling Dynamic Systems without Using Hidden Variables
    Brafman, Ronen I.
    De Giacomo, Giuseppe
    AAMAS '19: PROCEEDINGS OF THE 18TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS, 2019, : 1844 - 1846
  • [36] Spatial modelling of natural disaster risk reduction policies with Markov decision processes
    Espada, Rodolfo, Jr.
    Apan, Armando
    McDougall, Kevin
    APPLIED GEOGRAPHY, 2014, 53 : 284 - 298
  • [37] Steady-State Policy Synthesis in Multichain Markov Decision Processes
    Atia, George
    Beckus, Andre
    Alkhouri, Ismail
    Velasquez, Alvaro
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 4069 - 4075
  • [38] Uniqueness and stability of optimal policies of finite state Markov decision processes
    Leizarowitz, Arie
    Zaslavski, Alexander J.
    MATHEMATICS OF OPERATIONS RESEARCH, 2007, 32 (01) : 156 - 167
  • [39] Risk-optimization in finite state markov decision processes with a constraint
    Hou, Pingjun
    JOURNAL OF STATISTICS & MANAGEMENT SYSTEMS, 2012, 15 (2-3): : 309 - 322
  • [40] Singular Control for Discounted Markov Decision Processes in a General State Space
    Costa, O. L. V.
    Dufour, F.
    2011 50TH IEEE CONFERENCE ON DECISION AND CONTROL AND EUROPEAN CONTROL CONFERENCE (CDC-ECC), 2011, : 7087 - 7092
12345