Projection-free accelerated method for convex optimization

被引:0
|
作者
Goncalves, Max L. N. [1 ]
Melo, Jefferson G. [1 ]
Monteiro, Renato D. C. [2 ]
机构
[1] Univ Fed Goias, IME, Goiania, Go, Brazil
[2] Georgia Inst Technol, Sch Ind & Syst Engn, Atlanta, GA 30332 USA
来源
OPTIMIZATION METHODS & SOFTWARE | 2022年 / 37卷 / 01期
基金
美国国家科学基金会;
关键词
Projection-free method; accelerated method; first-order methods; conditional gradient method; CONVERGENCE;
D O I
10.1080/10556788.2020.1734806
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this paper, we propose a projection-free accelerated method for solving convex optimization problems with unbounded feasible set. The method is an accelerated gradient scheme such that each projection subproblem is approximately solved by means of a conditional gradient scheme. Under reasonable assumptions, it is shown that an epsilon-approximate solution (concept related to the optimal value of the problem) is obtained in at most gradient evaluations and linear oracle calls. We also discuss a notion of approximate solution based on the first-order optimality condition of the problem and present iteration-complexity results for the proposed method to obtain an approximate solution in this sense. Finally, numerical experiments illustrating the practical behaviour of the proposed scheme are discussed.
引用
收藏
页码:214 / 240
页数:27
相关论文
共 50 条
  • [41] Generalization of Accelerated Successive Projection Method for Convex Sets Intersection Problems
    Etesami, Seyed Rasoul
    Nedic, Angelia
    Basar, Tamer
    [J]. 2016 AMERICAN CONTROL CONFERENCE (ACC), 2016, : 4422 - 4427
  • [42] Frank-Wolfe and friends: a journey into projection-free first-order optimization methods
    Bomze, Immanuel. M.
    Rinaldi, Francesco
    Zeffiro, Damiano
    [J]. ANNALS OF OPERATIONS RESEARCH, 2024,
  • [43] Projection-free Distributed Online Learning with Sublinear Communication Complexity
    Wan, Yuanyu
    Wang, Guanghui
    Tu, Wei-Wei
    Zhang, Lijun
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23
  • [44] Nesterov Accelerated Shuffling Gradient Method for Convex Optimization
    Tran, Trang H.
    Scheinberg, Katya
    Nguyen, Lam M.
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [45] Efficient Projection-Free Online Methods with Stochastic Recursive Gradient
    Xie, Jiahao
    Shen, Zebang
    Zhang, Chao
    Wang, Boyu
    Qian, Hui
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 6446 - 6453
  • [46] Fast Projection-Free Algorithm for Distributed Online Learning in Networks
    Wang, Jun-ya
    Li, De-quan
    Zhou, Yue-jin
    Lv, Jing-ge
    Dong, Qiao
    [J]. 2018 IEEE 18TH INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY (ICCT), 2018, : 1335 - 1341
  • [47] Projection-free approximate balanced truncation of large unstable systems
    Flinois, Thibault L. B.
    Morgans, Aimee S.
    [J]. PHYSICAL REVIEW E, 2015, 92 (02):
  • [48] PROJECTION-FREE APPROXIMATION OF GEOMETRICALLY CONSTRAINED PARTIAL DIFFERENTIAL EQUATIONS
    Bartels, Soeren
    [J]. MATHEMATICS OF COMPUTATION, 2016, 85 (299) : 1033 - 1049
  • [49] Projection-free Distributed Online Learning with Sublinear Communication Complexity
    Wan, Yuanyu
    Wang, Guanghui
    Tu, Wei-Wei
    Zhang, Lijun
    [J]. Journal of Machine Learning Research, 2022, 23 : 1 - 53
  • [50] A Universal Accelerated Primal–Dual Method for Convex Optimization Problems
    Hao Luo
    [J]. Journal of Optimization Theory and Applications, 2024, 201 : 280 - 312