Weak Feller property of non-linear filters

被引:16
|
作者
Kara, Ali Devran [1 ]
Saldi, Naci [2 ]
Yuksel, Serdar [1 ]
机构
[1] Queens Univ, Dept Math & Stat, Kingston, ON, Canada
[2] Ozyegin Univ, Dept Nat & Math Sci, Istanbul, Turkey
基金
加拿大自然科学与工程研究理事会;
关键词
Non-linear filtering; Partially observed stochastic control; MARKOV DECISION-PROCESSES; CONVERGENCE; INFORMATION; ERGODICITY; OPTIMALITY; CHAINS;
D O I
10.1016/j.sysconle.2019.104512
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Weak Feller property of controlled and control-free Markov chains leads to many desirable properties. In control-free setups this leads to the existence of invariant probability measures for compact spaces and applicability of numerical approximation methods. For controlled setups, this leads to existence and approximation results for optimal control policies. We know from stochastic control theory that partially observed systems can be converted to fully observed systems by replacing the original state space with a probability measure-valued state space, with the corresponding kernel acting on probability measures known as the non-linear filter process. Establishing sufficient conditions for the weak Feller property for such processes is a significant problem, studied under various assumptions and setups in the literature. In this paper, we prove the weak Feller property of the non-linear filter process (i) first under weak continuity of the transition probability of controlled Markov chain and total variation continuity of its observation channel, and then, (ii) under total variation continuity of the transition probability of controlled Markov chain. The former result (i) has first appeared in Feinberg et al. (2016). Here, we present a concise and easy to follow alternative proof for this existing result. The latter result (ii) establishes weak Feller property of non-linear filter process under conditions which have not been previously reported in the literature. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] Non-Linear Rewrite Closure and Weak Normalization
    Carles Creus
    Guillem Godoy
    Francesc Massanes
    Ashish Tiwari
    [J]. Journal of Automated Reasoning, 2013, 51 : 281 - 324
  • [22] WEAK CONTINUITY AND COMPACTNESS OF NON-LINEAR MAPPINGS
    LIPKIN, LJ
    [J]. NONLINEAR ANALYSIS-THEORY METHODS & APPLICATIONS, 1981, 5 (11) : 1257 - 1263
  • [23] Linear and non-linear filters for block based motion estimation
    Ruiz, VF
    [J]. ICASSP '99: 1999 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, PROCEEDINGS VOLS I-VI, 1999, : 3389 - 3392
  • [24] Linear and non-linear filters for clutter cancellation in radar systems
    Farina, A
    [J]. SIGNAL PROCESSING, 1997, 59 (01) : 101 - 112
  • [25] Feller property of the multiplicative coalescent with linear deletion
    Rath, Balazs
    [J]. BERNOULLI, 2019, 25 (01) : 221 - 240
  • [26] Quantitative evaluation of non-linear optical property
    Sekino, Hideo
    [J]. MOLECULAR PHYSICS, 2010, 108 (21-23) : 3027 - 3031
  • [27] INSITU NON-LINEAR SOIL PROPERTY MEASUREMENT
    IBANEZ, P
    CHITTY, DE
    [J]. GEOPHYSICS, 1981, 46 (04) : 453 - 453
  • [28] NON-LINEAR PROPERTY OF DOUBLE TEARING MODES
    LEE, JK
    [J]. BULLETIN OF THE AMERICAN PHYSICAL SOCIETY, 1980, 25 (08): : 930 - 930
  • [29] Study on non-linear creep property of weak layer in slope of open-pit coal mine
    Rui, Yongqin
    Xu, Xiaohe
    Ma, Xinmin
    Huo, Qiyuan
    Zhang, Youdi
    Zhou, Changshou
    [J]. Dongbei Daxue Xuebao/Journal of Northeastern University, 1999, 20 (06): : 612 - 614
  • [30] On the ergodic control of ensembles in the presence of non-linear filters
    Kungurtsev, Vyacheslav
    Marecek, Jakub
    Ghosh, Ramen
    Shorten, Robert
    [J]. AUTOMATICA, 2023, 152