Observation-based Performance Sensitivity Analysis for POMDPs

被引：0
|
作者：
Ji, Zhe [1 ]
Jiang, Xiaofeng [1 ]
Xi, Hongsheng [1 ]
机构：
[1] Univ Sci & Technol China, Sch Informat Sci & Technol, Dept Auto, Hefei 230027, Peoples R China
来源：
2015 34TH CHINESE CONTROL CONFERENCE (CCC) | 2015年
关键词：
POMDPs; Performance sensitivity analysis; Performance difference formula; Performance derivative formula;
D O I：
暂无
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
In this paper, the performance sensitivity analysis for Markov decision processes (MDPs) are generalized to study the partially observable Markov decision processes (POMDPs). The performance derivative formula and the performance difference formula based on observation are derived in this paper. The derivation does not need any overly strict assumptions. In order to find the optimal policy based on observation, an observation-based policy iteration algorithm is designed. An example is presented to show the applicability of the algorithm finally.
引用
收藏
页码：1671 / 1676
页数：6
相关论文
共 50 条
  • [1] Observation-Based Optimization for POMDPs With Continuous State, Observation, and Action Spaces
    Jiang, Xiaofeng
    Yang, Jian
    Tan, Xiaobin
    Xi, Hongsheng
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2019, 64 (05) : 2045 - 2052
  • [2] Finding Optimal Observation-Based Policies for Constrained POMDPs Under the Expected Average Reward Criterion
    Jiang, Xiaofeng
    Xi, Hongsheng
    Wang, Xiaodong
    Liu, Falin
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2016, 61 (10) : 3070 - 3075
  • [3] Letter: Observation-Based Analysis and Industry Studies
    Giarratani, Frank
    ECONOMISTS VOICE, 2007, 4 (04):
  • [4] Observation-based analysis of ozone production sensitivity for two persistent ozone episodes in Guangdong, China
    Song, Kaixiang
    Liu, Run
    Wang, Yu
    Liu, Tao
    Wei, Liyan
    Wu, Yanxing
    Zheng, Junyu
    Wang, Boguang
    Liu, Shaw Chen
    ATMOSPHERIC CHEMISTRY AND PHYSICS, 2022, 22 (12) : 8403 - 8416
  • [5] Sensitivity of Ozone Formation in Summer in Jinan Using Observation-Based Model
    Xu, Chenxi
    He, Xuejuan
    Sun, Shida
    Bo, Yu
    Cui, Zeqi
    Zhang, Zhanchao
    Dong, Hui
    ATMOSPHERE, 2022, 13 (12)
  • [6] The level of skills involved in an observation-based gait analysis
    Bonkohara, Shuzo
    JOURNAL OF EYE MOVEMENT RESEARCH, 2024, 17 (03):
  • [7] An observation-based scaling model for climate sensitivity estimates and global projections to 2100
    Raphaël Hébert
    Shaun Lovejoy
    Bruno Tremblay
    Climate Dynamics, 2021, 56 : 1105 - 1129
  • [8] An observation-based scaling model for climate sensitivity estimates and global projections to 2100
    Hebert, Raphael
    Lovejoy, Shaun
    Tremblay, Bruno
    CLIMATE DYNAMICS, 2021, 56 (3-4) : 1105 - 1129
  • [9] An observation-based analysis of atmospheric oxidation capacity in Guangdong, China
    Wei, Liyan
    Liu, Run
    Liao, Chungui
    Ouyang, Shanshan
    Wu, Yanxing
    Jiang, Bin
    Chen, Duohong
    Zhang, Tao
    Guo, Yan
    Liu, Shaw Chen
    ATMOSPHERIC ENVIRONMENT, 2024, 318
  • [10] Observation-based Analysis of the Deflection of a Polar Crown Filament Eruption
    Pomoell, J.
    Vainio, R.
    Kilpua, E. K. J.
    TWELFTH INTERNATIONAL SOLAR WIND CONFERENCE, 2010, 1216 : 335 - 338
12345