Projection-free accelerated method for convex optimization

被引:0
|
作者
Goncalves, Max L. N. [1 ]
Melo, Jefferson G. [1 ]
Monteiro, Renato D. C. [2 ]
机构
[1] Univ Fed Goias, IME, Goiania, Go, Brazil
[2] Georgia Inst Technol, Sch Ind & Syst Engn, Atlanta, GA 30332 USA
来源
OPTIMIZATION METHODS & SOFTWARE | 2022年 / 37卷 / 01期
基金
美国国家科学基金会;
关键词
Projection-free method; accelerated method; first-order methods; conditional gradient method; CONVERGENCE;
D O I
10.1080/10556788.2020.1734806
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this paper, we propose a projection-free accelerated method for solving convex optimization problems with unbounded feasible set. The method is an accelerated gradient scheme such that each projection subproblem is approximately solved by means of a conditional gradient scheme. Under reasonable assumptions, it is shown that an epsilon-approximate solution (concept related to the optimal value of the problem) is obtained in at most gradient evaluations and linear oracle calls. We also discuss a notion of approximate solution based on the first-order optimality condition of the problem and present iteration-complexity results for the proposed method to obtain an approximate solution in this sense. Finally, numerical experiments illustrating the practical behaviour of the proposed scheme are discussed.
引用
收藏
页码:214 / 240
页数:27
相关论文
共 50 条
  • [21] Distributed projection-free algorithm for constrained aggregative optimization
    Wang, Tongyu
    Yi, Peng
    [J]. INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2023, 33 (10) : 5273 - 5288
  • [22] Projection-Free Stochastic Bi-Level Optimization
    Akhtar, Zeeshan
    Bedi, Amrit Singh
    Thomdapu, Srujan Teja
    Rajawat, Ketan
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2022, 70 : 6332 - 6347
  • [23] Projection-free Online Exp-concave Optimization
    Garber, Dan
    Kretzu, Ben
    [J]. THIRTY SIXTH ANNUAL CONFERENCE ON LEARNING THEORY, VOL 195, 2023, 195
  • [24] Variance-Reduced and Projection-Free Stochastic Optimization
    Hazan, Elad
    Luo, Haipeng
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48
  • [25] Distributed gradient-free and projection-free algorithm for stochastic constrained optimization
    Hou J.
    Zeng X.
    Chen C.
    [J]. Autonomous Intelligent Systems, 4 (1):
  • [26] Distributed Optimization With Projection-Free Dynamics: A Frank-Wolfe Perspective
    Chen, Guanpu
    Yi, Peng
    Hong, Yiguang
    Chen, Jie
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (01) : 599 - 610
  • [27] Projection-Free Online Optimization with Stochastic Gradient: From Convexity to Submodularity
    Chen, Lin
    Harshaw, Christopher
    Hassani, Hamed
    Karbasi, Amin
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [28] A Projection-Free Adaptive Momentum Optimization Algorithm for Mobile Multimedia Computing
    Wang, Lin
    Zhou, Yangfan
    Wang, Xin
    Ji, Zhihang
    Liu, Xin
    [J]. WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [29] Riemannian Projection-free Online Learning
    Hu, Zihao
    Wang, Guanghui
    Abernethy, Jacob
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [30] AN ACCELERATED METHOD FOR DERIVATIVE-FREE SMOOTH STOCHASTIC CONVEX OPTIMIZATION
    Gorbunov, Eduard
    Dvurechensky, Pavel
    Gasnikov, Alexander
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2022, 32 (02) : 1210 - 1238