ACCELERATED STOCHASTIC APPROXIMATION

被引：36
|
作者：
Delyon, Bernard [1 ]
Juditsky, Anatoli [1 ]
机构：
[1] Inst Natl Rech Informat & Automat, Inst Rech Informat & Syst Aleatoires, F-35042 Rennes, France
来源：
SIAM JOURNAL ON OPTIMIZATION | 1993年 / 3卷 / 04期
关键词：
stochastic approximation; accelerated algorithms; optimal algorithms;
D O I：
10.1137/0803045
中图分类号：
O29 [应用数学];
学科分类号：
070104 ;
摘要：
A technique to accelerate convergence of stochastic approximation algorithms is studied. It is based on Kesten's idea of equalization of the gain coefficient for the Robbins-Monro algorithm. Convergence with probability is proved for the multidimensional analog of the Kesten accelerated stochastic approximation algorithm. Asymptotic normality of the delivered estimates is also shown. Results of numerical simulations are presented that demonstrate the efficiency of the acceleration procedure.
引用
收藏
页码：868 / 881
页数：14
相关论文
共 50 条
  • [21] STOCHASTIC-APPROXIMATION
    DERMAN, C
    ANNALS OF MATHEMATICAL STATISTICS, 1956, 27 (04): : 879 - 886
  • [22] STOCHASTIC APPROXIMATION COEFFICIENTS
    KIRVAITIS, K
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1974, MC 4 (02): : 217 - 219
  • [23] STOCHASTIC APPROXIMATION METHOD
    BUDIN, MA
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1972, SMC2 (03): : 438 - &
  • [24] ON STOCHASTIC-APPROXIMATION
    DERMAN, C
    SACKS, J
    ANNALS OF MATHEMATICAL STATISTICS, 1958, 29 (04): : 1289 - 1290
  • [25] STOCHASTIC APPROXIMATION METHOD
    SINHA, NK
    GRISCIK, MP
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1971, SMC1 (04): : 338 - +
  • [26] ON A STOCHASTIC APPROXIMATION METHOD
    CHUNG, KL
    ANNALS OF MATHEMATICAL STATISTICS, 1954, 25 (03): : 463 - 483
  • [27] Stochastic approximation: a survey
    Kushner, Harold
    WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL STATISTICS, 2010, 2 (01): : 87 - 96
  • [28] What Is Stochastic Approximation?
    不详
    IEEE CONTROL SYSTEMS MAGAZINE, 2023, 43 (05): : 112 - 112
  • [29] Quasi Stochastic Approximation
    Shirodkar, Darshan
    Meyn, Sean
    2011 AMERICAN CONTROL CONFERENCE, 2011, : 2429 - 2435
  • [30] METHODS OF STOCHASTIC APPROXIMATION
    LOGINOV, NV
    AUTOMATION AND REMOTE CONTROL, 1966, 27 (04) : 707 - &
12345