Projection-free accelerated method for convex optimization

被引:0
|
作者
Goncalves, Max L. N. [1 ]
Melo, Jefferson G. [1 ]
Monteiro, Renato D. C. [2 ]
机构
[1] Univ Fed Goias, IME, Goiania, Go, Brazil
[2] Georgia Inst Technol, Sch Ind & Syst Engn, Atlanta, GA 30332 USA
来源
OPTIMIZATION METHODS & SOFTWARE | 2022年 / 37卷 / 01期
基金
美国国家科学基金会;
关键词
Projection-free method; accelerated method; first-order methods; conditional gradient method; CONVERGENCE;
D O I
10.1080/10556788.2020.1734806
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this paper, we propose a projection-free accelerated method for solving convex optimization problems with unbounded feasible set. The method is an accelerated gradient scheme such that each projection subproblem is approximately solved by means of a conditional gradient scheme. Under reasonable assumptions, it is shown that an epsilon-approximate solution (concept related to the optimal value of the problem) is obtained in at most gradient evaluations and linear oracle calls. We also discuss a notion of approximate solution based on the first-order optimality condition of the problem and present iteration-complexity results for the proposed method to obtain an approximate solution in this sense. Finally, numerical experiments illustrating the practical behaviour of the proposed scheme are discussed.
引用
收藏
页码:214 / 240
页数:27
相关论文
共 50 条
  • [1] Projection-free accelerated method for convex optimization
    Gonçalves, Max L. N.
    Melo, Jefferson G.
    Monteiro, Renato D. C.
    [J]. Optimization Methods and Software, 2022, 37 (01) : 214 - 240
  • [2] Projection-Free Bandit Convex Optimization
    Chen, Lin
    Zhang, Mingrui
    Karbasi, Amin
    [J]. 22ND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 89, 2019, 89
  • [3] Projection-Free Optimization on Uniformly Convex Sets
    Kerdreux, Thomas
    d'Aspremont, Alexandre
    Pokutta, Sebastian
    [J]. 24TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS (AISTATS), 2021, 130 : 19 - +
  • [4] Quantized Distributed Online Projection-Free Convex Optimization
    Zhang, Wentao
    Shi, Yang
    Zhang, Baoyong
    Lu, Kaihong
    Yuan, Deming
    [J]. IEEE CONTROL SYSTEMS LETTERS, 2023, 7 : 1837 - 1842
  • [5] Faster Projection-free Convex Optimization over the Spectrahedron
    Garber, Dan
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [6] Projection-Free Bandit Convex Optimization over Strongly Convex Sets
    Zhang, Chenxu
    Wang, Yibo
    Tian, Peng
    Cheng, Xiao
    Wan, Yuanyu
    Song, Mingli
    [J]. ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PT III, PAKDD 2024, 2024, 14647 : 118 - 129
  • [7] Improved Regret Bounds for Projection-free Bandit Convex Optimization
    Garber, Dan
    Kretzu, Ben
    [J]. INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 108, 2020, 108 : 2196 - 2205
  • [8] Revisiting Projection-Free Optimization for Strongly Convex Constraint Sets
    Rector-Brooks, Jarrid
    Wang, Jun-Kun
    Mozafari, Barzan
    [J]. THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 1576 - 1583
  • [9] A PROJECTION-FREE DECENTRALIZED ALGORITHM FOR NON-CONVEX OPTIMIZATION
    Wai, Hoi-To
    Scaglione, Anna
    Lafond, Jean
    Moulines, Eric
    [J]. 2016 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2016, : 475 - 479
  • [10] Projection-Free Online Convex Optimization via Efficient Newton Iterations
    Gatmiry, Khashayar
    Mhammedi, Zakaria
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,