Stochastic gradient algorithm with random truncations

被引:5
|
作者
Tadic, V
机构
[1] Mihajlo Pupin Inst, Belgrade, Yugoslavia
关键词
gradient methods; stochastic optimization; stochastic approximation; uniform mixing;
D O I
10.1016/S0377-2217(96)00397-9
中图分类号
C93 [管理学];
学科分类号
12 ; 1201 ; 1202 ; 120202 ;
摘要
Let f : R-d x R-d' --> R be a Borel-measurable function which satisfies integral(Rd')\f(theta,x)\q(0)(dx) < infinity, For All theta is an element of R-d, where q(0)(.) is a probability measure on (R-d', B-d'). The problem of minimization of the function f(0)(theta) = integral(Rd') f(theta,x)q(0)(dx), theta is an element of R-d, is considered for the case when the probability measure q(0)(.), is unknown, but a realization of a non-stationary random process {X-n}(n greater than or equal to 1) whose single probability measures in a certain sense tend to q(0)(.), is available. The random process {X-n}(n greater than or equal to 1) is defined on a common probability space, R-d'-valued, correlated and satisfies certain uniform mixing conditions. The function f(.,.) is completely known. A stochastic gradient algorithm with random truncations is used for the minimization of f(0)(.), and its almost sure convergence is proved. (C) 1997 Elsevier Science B.V.
引用
收藏
页码:261 / 284
页数:24
相关论文
共 50 条
  • [31] Strong consistency of the distributed stochastic gradient algorithm
    Gan, Die
    Liu, Zhixin
    2019 IEEE 58TH CONFERENCE ON DECISION AND CONTROL (CDC), 2019, : 5082 - 5087
  • [32] Optimal stochastic gradient descent algorithm for filtering
    Turali, M. Yigit
    Koc, Ali T.
    Kozat, Suleyman S.
    DIGITAL SIGNAL PROCESSING, 2024, 155
  • [33] Stochastic Conjugate Gradient Algorithm With Variance Reduction
    Jin, Xiao-Bo
    Zhang, Xu-Yao
    Huang, Kaizhu
    Geng, Guang-Gang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (05) : 1360 - 1369
  • [34] Modified stochastic gradient algorithm for Hammerstein systems
    Lv, Lixing
    Chen, Jing
    INDUSTRIAL INSTRUMENTATION AND CONTROL SYSTEMS II, PTS 1-3, 2013, 336-338 : 2320 - 2323
  • [35] A generalised mixed norm stochastic gradient algorithm
    Boukis, C.
    Mandic, D. P.
    Constantinides, A. G.
    PROCEEDINGS OF THE 2007 15TH INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING, 2007, : 27 - +
  • [36] A Natural Gradient Algorithm for Stochastic Distribution Systems
    Zhang, Zhenning
    Sun, Huafei
    Peng, Linyu
    Jiu, Lin
    ENTROPY, 2014, 16 (08) : 4338 - 4352
  • [37] Distributed Adaptive Gradient Algorithm With Gradient Tracking for Stochastic Nonconvex Optimization
    Han, Dongyu
    Liu, Kun
    Lin, Yeming
    Xia, Yuanqing
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2024, 69 (09) : 6333 - 6340
  • [38] Recycling random numbers in the stochastic simulation algorithm
    Yates, Christian A.
    Klingbeil, Guido
    JOURNAL OF CHEMICAL PHYSICS, 2013, 138 (09):
  • [39] MONOTONE INFINITE STOCHASTIC MATRICES AND THEIR AUGMENTED TRUNCATIONS
    GIBSON, D
    SENETA, E
    STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 1987, 24 (02) : 287 - 292
  • [40] Truncations of random unitary matrices and Young tableaux
    Novak, J.
    ELECTRONIC JOURNAL OF COMBINATORICS, 2007, 14 (01):