Stochastic gradient algorithm with random truncations

被引:5
|
作者
Tadic, V
机构
[1] Mihajlo Pupin Inst, Belgrade, Yugoslavia
关键词
gradient methods; stochastic optimization; stochastic approximation; uniform mixing;
D O I
10.1016/S0377-2217(96)00397-9
中图分类号
C93 [管理学];
学科分类号
12 ; 1201 ; 1202 ; 120202 ;
摘要
Let f : R-d x R-d' --> R be a Borel-measurable function which satisfies integral(Rd')\f(theta,x)\q(0)(dx) < infinity, For All theta is an element of R-d, where q(0)(.) is a probability measure on (R-d', B-d'). The problem of minimization of the function f(0)(theta) = integral(Rd') f(theta,x)q(0)(dx), theta is an element of R-d, is considered for the case when the probability measure q(0)(.), is unknown, but a realization of a non-stationary random process {X-n}(n greater than or equal to 1) whose single probability measures in a certain sense tend to q(0)(.), is available. The random process {X-n}(n greater than or equal to 1) is defined on a common probability space, R-d'-valued, correlated and satisfies certain uniform mixing conditions. The function f(.,.) is completely known. A stochastic gradient algorithm with random truncations is used for the minimization of f(0)(.), and its almost sure convergence is proved. (C) 1997 Elsevier Science B.V.
引用
收藏
页码:261 / 284
页数:24
相关论文
共 50 条
  • [41] STOCHASTIC APPROXIMATION PROCEDURES WITH RANDOMLY VARYING TRUNCATIONS
    陈翰馥
    朱允民
    Science China Mathematics, 1986, (09) : 914 - 926
  • [42] STOCHASTIC APPROXIMATION PROCEDURES WITH RANDOMLY VARYING TRUNCATIONS
    陈翰馥
    朱允民
    ScienceinChina,SerA., 1986, Ser.A.1986 (09) : 914 - 926
  • [43] Convergences of regularized algorithms and stochastic gradient methods with random projections
    Lin, Junhong
    Cevher, Volkan
    1600, Microtome Publishing (21):
  • [44] Convergences of Regularized Algorithms and Stochastic Gradient Methods with Random Projections
    Lin, Junhong
    Cevher, Volkan
    JOURNAL OF MACHINE LEARNING RESEARCH, 2020, 21
  • [45] Stochastic gradient descent with random label noises: doubly stochastic models and inference stabilizer
    Xiong, Haoyi
    Li, Xuhong
    Yu, Boyang
    Wu, Dongrui
    Zhu, Zhanxing
    Dou, Dejing
    MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2024, 5 (01):
  • [46] Eigenvalue rigidity for truncations of random unitary matrices
    Meckes, Elizabeth
    Stewart, Kathryn
    RANDOM MATRICES-THEORY AND APPLICATIONS, 2021, 10 (01)
  • [47] DSA: Decentralized Double Stochastic Averaging Gradient Algorithm
    Mokhtari, Aryan
    Ribeiro, Alejandro
    JOURNAL OF MACHINE LEARNING RESEARCH, 2016, 17
  • [48] A new stochastic gradient descent possibilistic clustering algorithm
    Koutsimpela, Angeliki
    Koutroumbas, Konstantinos D.
    AI COMMUNICATIONS, 2022, 35 (02) : 47 - 64
  • [49] Fast Convergence Stochastic Parallel Gradient Descent Algorithm
    Hu Dongting
    Shen Wen
    Ma Wenchao
    Liu Xinyu
    Su Zhouping
    Zhu Huaxin
    Zhang Xiumei
    Que Lizhi
    Zhu Zhuowei
    Zhang Yixin
    Chen Guoqing
    Hu Lifa
    LASER & OPTOELECTRONICS PROGRESS, 2019, 56 (12)
  • [50] Convergence behavior of diffusion stochastic gradient descent algorithm
    Barani, Fatemeh
    Savadi, Abdorreza
    Yazdi, Hadi Sadoghi
    SIGNAL PROCESSING, 2021, 183