Algorithms of Robust Stochastic Optimization Based on Mirror Descent Method

被引：21

作者：

Nazin, A., V ^{[1
]}

Nemirovsky, A. S. ^{[2
]}

Tsybakov, A. B. ^{[3
]}

Juditsky, A. B. ^{[4
]}

机构：

[1] Russian Acad Sci, Trapeznikov Inst Control Sci, Moscow, Russia

[2] Georgia Inst Technol, Atlanta, GA 30332 USA

[3] ENSAE, CREST, Palaiseau, France

[4] Univ Grenoble Alpes, Grenoble, France

来源：

AUTOMATION AND REMOTE CONTROL | 2019年 / 80卷 / 09期

基金：

俄罗斯科学基金会;

关键词：

robust iterative algorithms; stochastic optimization algorithms; convex composite stochastic optimization; mirror descent method; robust confidence sets; APPROXIMATION ALGORITHMS; CONVERGENCE;

D O I：

10.1134/S0005117919090042

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

We propose an approach to the construction of robust non-Euclidean iterative algorithms by convex composite stochastic optimization based on truncation of stochastic gradients. For such algorithms, we establish sub-Gaussian confidence bounds under weak assumptions about the tails of the noise distribution in convex and strongly convex settings. Robust estimates of the accuracy of general stochastic algorithms are also proposed.

引用

页码：1607 / 1627

页数：21

共 50 条

[1] Algorithms of Robust Stochastic Optimization Based on Mirror Descent Method
A. V. Nazin
A. S. Nemirovsky
A. B. Tsybakov
A. B. Juditsky
[J]. Automation and Remote Control, 2019, 80 : 1607 - 1627
[2] Algorithms of Inertial Mirror Descent in Convex Problems of Stochastic Optimization
Nazin, A. V.
[J]. AUTOMATION AND REMOTE CONTROL, 2018, 79 (01) : 78 - 88
[3] Algorithms of Inertial Mirror Descent in Convex Problems of Stochastic Optimization
A. V. Nazin
[J]. Automation and Remote Control, 2018, 79 : 78 - 88
[4] Momentum-based accelerated mirror descent stochastic approximation for robust topology optimization under stochastic loads
Li, Weichen
Zhang, Xiaojia Shelly
[J]. INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN ENGINEERING, 2021, 122 (17) : 4431 - 4457
[5] Policy Optimization with Stochastic Mirror Descent
Yang, Long
Zhang, Yu
Zheng, Gang
Zheng, Qian
Li, Pengfei
Huang, Jianghang
Pan, Gang
[J]. THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 8823 - 8831
[6] Stochastic mirror descent method for distributed multi-agent optimization
Jueyou Li
Guoquan Li
Zhiyou Wu
Changzhi Wu
[J]. Optimization Letters, 2018, 12 : 1179 - 1197
[7] Primal–Dual Mirror Descent Method for Constraint Stochastic Optimization Problems
A. S. Bayandina
A. V. Gasnikov
E. V. Gasnikova
S. V. Matsievskii
[J]. Computational Mathematics and Mathematical Physics, 2018, 58 : 1728 - 1736
[8] Stochastic mirror descent method for distributed multi-agent optimization
Li, Jueyou
Li, Guoquan
Wu, Zhiyou
Wu, Changzhi
[J]. OPTIMIZATION LETTERS, 2018, 12 (06) : 1179 - 1197
[9] An Accelerated Stochastic Mirror Descent Method
Jiang, Bo-Ou
Yuan, Ya-Xiang
[J]. JOURNAL OF THE OPERATIONS RESEARCH SOCIETY OF CHINA, 2024, 12 (03) : 549 - 571
[10] Adaptive Stochastic Mirror Descent for Constrained Optimization
Bayandina, Anastasia
[J]. 2017 CONSTRUCTIVE NONSMOOTH ANALYSIS AND RELATED TOPICS (DEDICATED TO THE MEMORY OF V.F. DEMYANOV) (CNSA), 2017, : 40 - 43

← 1 2 3 4 5 →