An efficient adaptive accelerated inexact proximal point method for solving linearly constrained nonconvex composite problems

被引:9
|
作者
Kong, Weiwei [1 ]
Melo, Jefferson G. [2 ]
Monteiro, Renato D. C. [1 ]
机构
[1] Georgia Inst Technol, Sch Ind & Syst Engn, Atlanta, GA 30332 USA
[2] Univ Fed Goias, Inst Math & Stat, Campus 2,Caixa Postal 131, BR-74001970 Goiania, Go, Brazil
基金
加拿大自然科学与工程研究理事会;
关键词
Quadratic penalty method; Nonconvex program; Iteration-complexity; Proximal point method; First-order accelerated methods; SADDLE-POINT; ITERATION-COMPLEXITY; EXTRAGRADIENT METHOD; ALGORITHM; OPTIMIZATION;
D O I
10.1007/s10589-020-00188-w
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
This paper proposes an efficient adaptive variant of a quadratic penalty accelerated inexact proximal point (QP-AIPP) method proposed earlier by the authors. Both the QP-AIPP method and its variant solve linearly set constrained nonconvex composite optimization problems using a quadratic penalty approach where the generated penalized subproblems are solved by a variant of the underlying AIPP method. The variant, in turn, solves a given penalized subproblem by generating a sequence of proximal subproblems which are then solved by an accelerated composite gradient algorithm. The main difference between AIPP and its variant is that the proximal subproblems in the former are always convex while the ones in the latter are not necessarily convex due to the fact that their prox parameters are chosen as aggressively as possible so as to improve efficiency. The possibly nonconvex proximal subproblems generated by the AIPP variant are also tentatively solved by a novel adaptive accelerated composite gradient algorithm based on the validity of some key convergence inequalities. As a result, the variant generates a sequence of proximal subproblems where the stepsizes are adaptively changed according to the responses obtained from the calls to the accelerated composite gradient algorithm. Finally, numerical results are given to demonstrate the efficiency of the proposed AIPP and QP-AIPP variants.
引用
收藏
页码:305 / 346
页数:42
相关论文
共 50 条
  • [1] An efficient adaptive accelerated inexact proximal point method for solving linearly constrained nonconvex composite problems
    Weiwei Kong
    Jefferson G. Melo
    Renato D. C. Monteiro
    [J]. Computational Optimization and Applications, 2020, 76 : 305 - 346
  • [2] COMPLEXITY OF A QUADRATIC PENALTY ACCELERATED INEXACT PROXIMAL POINT METHOD FOR SOLVING LINEARLY CONSTRAINED NONCONVEX COMPOSITE PROGRAMS
    Kong, Weiwei
    Melo, Jefferson G.
    Monteiro, Renato D. C.
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2019, 29 (04) : 2566 - 2593
  • [3] An accelerated inexact dampened augmented Lagrangian method for linearly-constrained nonconvex composite optimization problems
    Weiwei Kong
    Renato D. C. Monteiro
    [J]. Computational Optimization and Applications, 2023, 85 : 509 - 545
  • [4] An accelerated inexact dampened augmented Lagrangian method for linearly-constrained nonconvex composite optimization problems
    Kong, Weiwei
    Monteiro, Renato D. C.
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2023, 85 (02) : 509 - 545
  • [5] AN ACCELERATED INEXACT PROXIMAL POINT METHOD FOR SOLVING NONCONVEX-CONCAVE MIN-MAX PROBLEMS
    Kong, Weiwei
    Monteiro, Renato D. C.
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2021, 31 (04) : 2558 - 2585
  • [6] A Proximal Augmented Lagrangian Method for Linearly Constrained Nonconvex Composite Optimization Problems
    Melo, Jefferson G.
    Monteiro, Renato D. C.
    Wang, Hairong
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2024, 202 (01) : 388 - 420
  • [7] An Adaptive Superfast Inexact Proximal Augmented Lagrangian Method for Smooth Nonconvex Composite Optimization Problems
    Arnesh Sujanani
    Renato D. C. Monteiro
    [J]. Journal of Scientific Computing, 2023, 97
  • [8] An Adaptive Superfast Inexact Proximal Augmented Lagrangian Method for Smooth Nonconvex Composite Optimization Problems
    Sujanani, Arnesh
    Monteiro, Renato D. C.
    [J]. JOURNAL OF SCIENTIFIC COMPUTING, 2023, 97 (02)
  • [9] AN INEXACT ACCELERATED PROXIMAL GRADIENT METHOD FOR LARGE SCALE LINEARLY CONSTRAINED CONVEX SDP
    Jiang, Kaifeng
    Sun, Defeng
    Toh, Kim-Chuan
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2012, 22 (03) : 1042 - 1064
  • [10] Efficient Inexact Proximal Gradient Algorithm for Nonconvex Problems
    Yao, Quanming
    Kwok, James T.
    Gao, Fei
    Chen, Wei
    Liu, Tie-Yan
    [J]. PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 3308 - 3314