A stochastic approximation approach to quasi-stationary distributions on finite spaces

被引:18
|
作者
Benaim, Michel [1 ]
Cloez, Bertrand [2 ,3 ]
机构
[1] Univ Neuchatel, Inst Math, CH-2000 Neuchatel, Switzerland
[2] UMR INRA SupAgro MISTEA, Montpellier, France
[3] EPI INRA INRIA MODEMIC, Sophia Antipolis, France
关键词
Quasi-stationary distributions; approximation method; reinforced random walks; random perturbations of dynamical; COUNTABLE SPACES; CONVERGENCE; ALGORITHMS; CHAINS;
D O I
10.1214/ECP.v20-3956
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This work is concerned with the analysis of a stochastic approximation algorithm for the simulation of quasi-stationary distributions on finite state spaces. This is a generalization of a method introduced by Aldous, Flannery and Palacios. It is shown that the asymptotic behavior of the empirical occupation measure of this process is precisely related to the asymptotic behavior of some deterministic dynamical system induced by a vector field on the unit simplex. This approach provides new proof of convergence as well as precise asymptotic rates for this type of algorithm. In the last part, our convergence results are compared with those of a particle system algorithm (a discrete-time version of the Fleming-Viot algorithm).
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [1] STOCHASTIC APPROXIMATION OF QUASI-STATIONARY DISTRIBUTIONS ON COMPACT SPACES AND APPLICATIONS
    Benaim, Michel
    Cloez, Bertrand
    Panloup, Fabien
    [J]. ANNALS OF APPLIED PROBABILITY, 2018, 28 (04): : 2370 - 2416
  • [2] Empirical analysis of a stochastic approximation approach for computing quasi-stationary distributions
    Blanchet, Jose
    Glynn, Peter
    Zheng, Shuheng
    [J]. Advances in Intelligent Systems and Computing, 2013, 175 ADVANCES : 19 - 37
  • [3] Empirical Analysis of a Stochastic Approximation Approach for Computing Quasi-stationary Distributions
    Blanchet, Jose
    Glynn, Peter
    Zheng, Shuheng
    [J]. EVOLVE - A BRIDGE BETWEEN PROBABILITY, SET ORIENTED NUMERICS, AND EVOLUTIONARY COMPUTATION II, 2013, 175 : 19 - +
  • [4] ANALYSIS OF A STOCHASTIC APPROXIMATION ALGORITHM FOR COMPUTING QUASI-STATIONARY DISTRIBUTIONS
    Blanchet, J.
    Glynn, P.
    Zheng, S.
    [J]. ADVANCES IN APPLIED PROBABILITY, 2016, 48 (03) : 792 - 811
  • [5] Stochastic approximation of quasi-stationary distributions for diffusion processes in a bounded domain
    Benaim, Michel
    Champagnat, Nicolas
    Villemonais, Denis
    [J]. ANNALES DE L INSTITUT HENRI POINCARE-PROBABILITES ET STATISTIQUES, 2021, 57 (02): : 726 - 739
  • [6] TOTAL VARIATION APPROXIMATION FOR QUASI-STATIONARY DISTRIBUTIONS
    Barbour, A. D.
    Pollett, P. K.
    [J]. JOURNAL OF APPLIED PROBABILITY, 2010, 47 (04) : 934 - 946
  • [7] QUASI-STATIONARY DISTRIBUTIONS OF A STOCHASTIC METAPOPULATION MODEL
    GYLLENBERG, M
    SILVESTROV, DS
    [J]. JOURNAL OF MATHEMATICAL BIOLOGY, 1994, 33 (01) : 35 - 70
  • [8] Simulation of Quasi-Stationary Distributions on Countable Spaces
    Groismani, P.
    Jonckheere, M.
    [J]. MARKOV PROCESSES AND RELATED FIELDS, 2013, 19 (03) : 521 - 542
  • [9] An approximation scheme for quasi-stationary distributions of killed diffusions
    Wang, Andi Q.
    Roberts, Gareth O.
    Steinsaltz, David
    [J]. STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 2020, 130 (05) : 3193 - 3219
  • [10] Quasi-stationary distributions for stochastic processes with an absorbing state
    Dickman, R
    Vidigal, R
    [J]. JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 2002, 35 (05): : 1145 - 1164