Stochastic gradient algorithm with random truncations

被引:5
|
作者
Tadic, V
机构
[1] Mihajlo Pupin Inst, Belgrade, Yugoslavia
关键词
gradient methods; stochastic optimization; stochastic approximation; uniform mixing;
D O I
10.1016/S0377-2217(96)00397-9
中图分类号
C93 [管理学];
学科分类号
12 ; 1201 ; 1202 ; 120202 ;
摘要
Let f : R-d x R-d' --> R be a Borel-measurable function which satisfies integral(Rd')\f(theta,x)\q(0)(dx) < infinity, For All theta is an element of R-d, where q(0)(.) is a probability measure on (R-d', B-d'). The problem of minimization of the function f(0)(theta) = integral(Rd') f(theta,x)q(0)(dx), theta is an element of R-d, is considered for the case when the probability measure q(0)(.), is unknown, but a realization of a non-stationary random process {X-n}(n greater than or equal to 1) whose single probability measures in a certain sense tend to q(0)(.), is available. The random process {X-n}(n greater than or equal to 1) is defined on a common probability space, R-d'-valued, correlated and satisfies certain uniform mixing conditions. The function f(.,.) is completely known. A stochastic gradient algorithm with random truncations is used for the minimization of f(0)(.), and its almost sure convergence is proved. (C) 1997 Elsevier Science B.V.
引用
收藏
页码:261 / 284
页数:24
相关论文
共 50 条
  • [1] Distributed Stochastic Approximation Algorithm With Expanding Truncations
    Lei, Jinlong
    Chen, Han-Fu
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2020, 65 (02) : 664 - 679
  • [2] Source Seeking via Stochastic Approximation Algorithm with Expanding Truncations
    Ren, Xue-Jie
    Liu, Shu-Jun
    PROCEEDINGS OF THE 2016 12TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2016, : 274 - 279
  • [3] On Random Subset Generalization Error Bounds and the Stochastic Gradient Langevin Dynamics Algorithm
    Rodriguez-Galvez, Borja
    Bassi, German
    Thobaben, Ragnar
    Skoglund, Mikael
    2020 IEEE INFORMATION THEORY WORKSHOP (ITW), 2021,
  • [4] Stochastic sub-gradient algorithm for distributed optimization with random sleep scheme
    Yi P.
    Hong Y.
    Control Theory and Technology, 2015, 13 (04) : 333 - 347
  • [5] A Modification on Stochastic Approximation Algorithm with Expanding Truncations For Estimation of NARX Systems
    Sepahvand, Shayan
    Abedi, Mostafa
    Pourgholi, Mahdi
    2019 27TH IRANIAN CONFERENCE ON ELECTRICAL ENGINEERING (ICEE 2019), 2019, : 925 - 928
  • [6] Distributed Sourcing Seeking via Stochastic Approximation Algorithm with Expanding Truncations
    Ren, Xue-Jie
    Liu, Shu-Jun
    2017 13TH IEEE INTERNATIONAL CONFERENCE ON CONTROL & AUTOMATION (ICCA), 2017, : 367 - 372
  • [7] An Introduction to Development of Centralized and Distributed Stochastic Approximation Algorithm with Expanding Truncations
    Zhao, Wenxiao
    ALGORITHMS, 2021, 14 (06)
  • [8] Bridges and random truncations of random matrices
    Beffara, Vincent
    Donati-Martin, Catherine
    Rouault, Alain
    RANDOM MATRICES-THEORY AND APPLICATIONS, 2014, 3 (02)
  • [9] Research of stochastic parallel gradient descent algorithm based on segmentation random disturbance amplitude
    Wu, Jian
    Yang, Huizhen
    Gong, Chenglong
    Zhongguo Jiguang/Chinese Journal of Lasers, 2014, 41 (07):
  • [10] Truncations of random unitary matrices
    Zyczkowski, K
    Sommers, HJ
    JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 2000, 33 (10): : 2045 - 2057