Towards Statistical and Computational Complexities of Polyak Step Size Gradient Descent

被引:0
|
作者
The University of Texas, Austin, United States [1 ]
机构
来源
Proc. Mach. Learn. Res. | / 3930-3961期
关键词
Compendex;
D O I
暂无
中图分类号
学科分类号
摘要
Computational complexity
引用
收藏
页码:3930 / 3961
相关论文
共 50 条
  • [31] A modified nonlinear Polak-Ribiere-Polyak conjugate gradient method with sufficient descent property
    Dong, Xiaoliang
    CALCOLO, 2020, 57 (03)
  • [32] GRADIENT DESCENT FOR TIKHONOV FUNCTIONALS WITH SPARSITY CONSTRAINTS: THEORY AND NUMERICAL COMPARISON OF STEP SIZE RULES
    Lorenz, Dirk A.
    Maass, Peter
    Muoi, Pham Q.
    ELECTRONIC TRANSACTIONS ON NUMERICAL ANALYSIS, 2012, 39 : 437 - 463
  • [33] Towards stability and optimality in stochastic gradient descent
    Toulis, Panos
    Tran, Dustin
    Airoldi, Edoardo M.
    ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 51, 2016, 51 : 1290 - 1298
  • [34] TESTICULAR DESCENT - THE FIRST STEP TOWARDS FERTILITY
    HUTSON, JM
    INTERNATIONAL JOURNAL OF ANDROLOGY, 1994, 17 (06): : 281 - 288
  • [35] Global convergence of modified Polak-Ribiere-Polyak conjugate gradient methods with sufficient descent property
    Yu, Gaohang
    Guan, Lutai
    Li, Guoyin
    JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2008, 4 (03) : 565 - 579
  • [36] AN EIGENVALUE STUDY ON THE SUFFICIENT DESCENT PROPERTY OF A MODIFIED POLAK-RIBIERE-POLYAK CONJUGATE GRADIENT METHOD
    Kafaki, S. Babaie
    BULLETIN OF THE IRANIAN MATHEMATICAL SOCIETY, 2014, 40 (01) : 235 - 242
  • [37] A new inexact stochastic recursive gradient descent algorithm with Barzilai–Borwein step size in machine learning
    Yi-ming Yang
    Fu-sheng Wang
    Jin-xiang Li
    Yuan-yuan Qin
    Nonlinear Dynamics, 2023, 111 : 3575 - 3586
  • [38] STATISTICAL INFERENCE FOR MODEL PARAMETERS IN STOCHASTIC GRADIENT DESCENT
    Chen, Xi
    Lee, Jason D.
    Tong, Xin T.
    Zhang, Yichen
    ANNALS OF STATISTICS, 2020, 48 (01): : 251 - 273
  • [39] On Kahan's automatic step-size control and an anadromic gradient descent iteration
    Gu, Zirui
    Jin, Kexin
    Meng, Yifeng
    Xue, Linuo
    Zhang, Lei-Hong
    OPTIMIZATION, 2023,
  • [40] ESTIMATING THE DIRECTION OF DESCENT BY THE STATISTICAL GRADIENT METHOD.
    Volynskii, E.I.
    Malyshev, S.A.
    Filatov, G.V.
    Automatic Control and Computer Sciences, 1976, 10 (06) : 50 - 52