Weak Feller property of non-linear filters

被引:16
|
作者
Kara, Ali Devran [1 ]
Saldi, Naci [2 ]
Yuksel, Serdar [1 ]
机构
[1] Queens Univ, Dept Math & Stat, Kingston, ON, Canada
[2] Ozyegin Univ, Dept Nat & Math Sci, Istanbul, Turkey
基金
加拿大自然科学与工程研究理事会;
关键词
Non-linear filtering; Partially observed stochastic control; MARKOV DECISION-PROCESSES; CONVERGENCE; INFORMATION; ERGODICITY; OPTIMALITY; CHAINS;
D O I
10.1016/j.sysconle.2019.104512
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Weak Feller property of controlled and control-free Markov chains leads to many desirable properties. In control-free setups this leads to the existence of invariant probability measures for compact spaces and applicability of numerical approximation methods. For controlled setups, this leads to existence and approximation results for optimal control policies. We know from stochastic control theory that partially observed systems can be converted to fully observed systems by replacing the original state space with a probability measure-valued state space, with the corresponding kernel acting on probability measures known as the non-linear filter process. Establishing sufficient conditions for the weak Feller property for such processes is a significant problem, studied under various assumptions and setups in the literature. In this paper, we prove the weak Feller property of the non-linear filter process (i) first under weak continuity of the transition probability of controlled Markov chain and total variation continuity of its observation channel, and then, (ii) under total variation continuity of the transition probability of controlled Markov chain. The former result (i) has first appeared in Feinberg et al. (2016). Here, we present a concise and easy to follow alternative proof for this existing result. The latter result (ii) establishes weak Feller property of non-linear filter process under conditions which have not been previously reported in the literature. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] On Weak Feller Continuity Properties of Non-linear Filters
    Kara, Ali Devran
    Saldi, Naci
    Yuksel, Serdar
    [J]. 2019 IEEE 58TH CONFERENCE ON DECISION AND CONTROL (CDC), 2019, : 654 - 659
  • [2] Irreducibility and strong Feller property for non-linear SPDEs
    Zhang, Shao-Qin
    [J]. STOCHASTICS-AN INTERNATIONAL JOURNAL OF PROBABILITY AND STOCHASTIC PROCESSES, 2019, 91 (03) : 352 - 382
  • [3] Image Denoising With Linear and Non-linear Filters
    Ahamed, B. Bazeer
    Yuvaraj, D.
    Priya, S. Shanmuga
    [J]. PROCEEDINGS OF 2019 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND KNOWLEDGE ECONOMY (ICCIKE' 2019), 2019, : 806 - 810
  • [4] A COMPARISON OF 3 NON-LINEAR FILTERS
    WISHNER, RP
    TABACZYNSKI, JA
    ATHANS, M
    [J]. AUTOMATICA, 1969, 5 (04) : 487 - +
  • [5] DIGITAL SYNTHESIS OF NON-LINEAR FILTERS
    BUCY, RS
    SENNE, KD
    [J]. AUTOMATICA, 1971, 7 (03) : 287 - &
  • [6] WEAK SUBCONTINUITY OF NON-LINEAR FUNCTIONALS
    GWINNER, J
    [J]. ZEITSCHRIFT FUR ANGEWANDTE MATHEMATIK UND MECHANIK, 1978, 58 (07): : T473 - T474
  • [7] Non-linear weak lensing forecasts
    Casarini, Luciano
    La Vacca, Giuseppe
    Amendola, Luca
    Bonometto, Silvio A.
    Maccio, Andrea V.
    [J]. JOURNAL OF COSMOLOGY AND ASTROPARTICLE PHYSICS, 2011, (03):
  • [8] OSCILLATOR WITH WEAK NON-LINEAR DAMPING
    SRIRANGARAJAN, HR
    [J]. JOURNAL OF SOUND AND VIBRATION, 1982, 84 (01) : 153 - 155
  • [9] LINEAR AND NON-LINEAR FILTERS FOR LINEAR, BUT NOT GAUSSIAN-PROCESSES
    RAO, TS
    YAR, M
    [J]. INTERNATIONAL JOURNAL OF CONTROL, 1984, 39 (01) : 235 - 246
  • [10] Non-linear effects in LMS adaptive filters
    Reuter, M
    Quirk, K
    Zeidler, J
    Milstein, L
    [J]. IEEE 2000 ADAPTIVE SYSTEMS FOR SIGNAL PROCESSING, COMMUNICATIONS, AND CONTROL SYMPOSIUM - PROCEEDINGS, 2000, : 141 - 146