A Semismooth Newton Method for Fast, Generic Convex Programming

被引:0
|
作者
Ali, Alnur [1 ]
Wong, Eric [1 ]
Kolter, J. Zico [2 ]
机构
[1] Carnegie Mellon Univ, Machine Learning Dept, Pittsburgh, PA 15213 USA
[2] Carnegie Mellon Univ, Comp Sci Dept, Pittsburgh, PA 15213 USA
关键词
NONSMOOTH; SEMIDEFINITE; ALGORITHM;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We introduce Newton-ADMM, a method for fast conic optimization. The basic idea is to view the residuals of consecutive iterates generated by the alternating direction method of multipliers (ADMM) as a set of fixed point equations, and then use a nonsmooth Newton method to find a solution; we apply the basic idea to the Splitting Cone Solver (SCS), a state-of-the-art method for solving generic conic optimization problems. We demonstrate theoretically, by extending the theory of semismooth operators, that Newton-ADMM converges rapidly (i.e., quadratically) to a solution; empirically, Newton-ADMM is significantly faster than SCS on a number of problems. The method also has essentially no tuning parameters, generates certificates of primal or dual infeasibility, when appropriate, and can be specialized to solve specific convex problems.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] A semismooth Newton method for nonlinear symmetric cone programming
    Kong, Lingchen
    Meng, Qingmin
    [J]. MATHEMATICAL METHODS OF OPERATIONS RESEARCH, 2012, 76 (02) : 129 - 145
  • [2] A semismooth Newton method for nonlinear symmetric cone programming
    Lingchen Kong
    Qingmin Meng
    [J]. Mathematical Methods of Operations Research, 2012, 76 : 129 - 145
  • [3] An Efficient Semismooth Newton Based Algorithm for Convex Clustering
    Yuan, Yancheng
    Sun, Defeng
    Toh, Kim-Chuan
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [4] A primal majorized semismooth Newton-CG augmented Lagrangian method for large-scale linearly constrained convex programming
    Chengjing Wang
    Peipei Tang
    [J]. Computational Optimization and Applications, 2017, 68 : 503 - 532
  • [5] A primal majorized semismooth Newton-CG augmented Lagrangian method for large-scale linearly constrained convex programming
    Wang, Chengjing
    Tang, Peipei
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2017, 68 (03) : 503 - 532
  • [6] Semismooth Reformulation and Nonsmooth Newton's Method for Solving Nonlinear Semidefinite Programming
    Benahmed, Boubakeur
    Alloun, Amina
    [J]. MODELLING, COMPUTATION AND OPTIMIZATION IN INFORMATION SYSTEMS AND MANAGEMENT SCIENCES - MCO 2015, PT 1, 2015, 359 : 411 - 417
  • [7] AN ASYMPTOTICALLY SUPERLINEARLY CONVERGENT SEMISMOOTH NEWTON AUGMENTED LAGRANGIAN METHOD FOR LINEAR PROGRAMMING
    Li, Xudong
    Sun, Defeng
    Toh, Kim-Chuan
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2020, 30 (03) : 2410 - 2440
  • [8] An Augmented Lagrangian based Semismooth Newton Method for a Class of Bilinear Programming Problems
    Su-xiang He
    Yan Liu
    Chuan-mei Wang
    [J]. Applied Mathematics-A Journal of Chinese Universities, 2019, 34 : 446 - 459
  • [9] An Augmented Lagrangian based Semismooth Newton Method for a Class of Bilinear Programming Problems
    He, Su-xiang
    Liu, Yan
    Wang, Chuan-mei
    [J]. APPLIED MATHEMATICS-A JOURNAL OF CHINESE UNIVERSITIES SERIES B, 2019, 34 (04) : 446 - 459
  • [10] An Augmented Lagrangian based Semismooth Newton Method for a Class of Bilinear Programming Problems
    HE Su-xiang
    LIU Yan
    WANG Chuan-mei
    [J]. Applied Mathematics:A Journal of Chinese Universities, 2019, 34 (04) : 446 - 459