Towards Statistical and Computational Complexities of Polyak Step Size Gradient Descent

被引：0
|
作者：
The University of Texas, Austin, United States [1 ]
机构：
来源：
Proc. Mach. Learn. Res. | / 3930-3961期
关键词：
Compendex;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
Computational complexity
引用
下载
收藏
页码：3930 / 3961
相关论文
共 50 条
  • [1] Towards Statistical and Computational Complexities of Polyak Step Size Gradient Descent
    Ren, Tongzheng
    Cui, Fuheng
    Atsidakou, Alexia
    Sanghavi, Sujay
    Ho, Nhat
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 151, 2022, 151
  • [2] Towards statistical and computational complexities of polyak step size gradient descent
    Department of Computer Science, University of Texas at Austin
    不详
    不详
    arXiv, 1600,
  • [3] Stochastic Gradient Descent with Preconditioned Polyak Step-Size
    Abdukhakimov, F.
    Xiang, C.
    Kamzolov, D.
    Takac, M.
    COMPUTATIONAL MATHEMATICS AND MATHEMATICAL PHYSICS, 2024, 64 (04) : 621 - 634
  • [4] Stochastic Gradient Descent with Polyak's Learning Rate
    Prazeres, Mariana
    Oberman, Adam M.
    JOURNAL OF SCIENTIFIC COMPUTING, 2021, 89 (01)
  • [5] New logarithmic step size for stochastic gradient descent
    Shamaee, Mahsa Soheil
    Hafshejani, Sajad Fathi
    Saeidian, Zeinab
    Frontiers of Computer Science, 2025, 19 (01)
  • [6] Stochastic Gradient Descent with Polyak’s Learning Rate
    Mariana Prazeres
    Adam M. Oberman
    Journal of Scientific Computing, 2021, 89
  • [7] Barzilai-Borwein Step Size for Stochastic Gradient Descent
    Tan, Conghui
    Ma, Shiqian
    Dai, Yu-Hong
    Qian, Yuqiu
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [8] Accelerated stochastic gradient descent with step size selection rules
    Yang, Zhuang
    Wang, Cheng
    Zhang, Zhemin
    Li, Jonathan
    SIGNAL PROCESSING, 2019, 159 : 171 - 186
  • [9] Constant Step Size Stochastic Gradient Descent for Probabilistic Modeling
    Babichev, Dmitry
    Bach, Francis
    UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, 2018, : 219 - 228
  • [10] Gradient-Descent Adaptive Filtering Using Gradient Adaptive Step-Size
    Talebi, Sayed Pouria
    Darvishi, Hossein
    Werner, Stefan
    Rossi, Pierluigi Salvo
    2022 IEEE 12TH SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING WORKSHOP (SAM), 2022, : 321 - 325
12345