An ADMM-based interior-point method for large-scale linear programming

被引:17
|
作者
Lin, Tianyi [1 ]
Ma, Shiqian [2 ]
Ye, Yinyu [3 ]
Zhang, Shuzhong [4 ,5 ]
机构
[1] Univ Calif Berkeley, Dept Elect Engn & Comp Sci, Berkeley, CA USA
[2] Univ Calif Davis, Dept Math, Davis, CA 95616 USA
[3] Stanford Univ, Dept Management Sci & Engn, Stanford, CA 94305 USA
[4] Univ Minnesota, Dept Ind & Syst Engn, Minneapolis, MN 55455 USA
[5] Chinese Univ Hong Kong, Shenzhen Res Inst Big Data, Shenzhen, Peoples R China
来源
OPTIMIZATION METHODS & SOFTWARE | 2021年 / 36卷 / 2-3期
关键词
Linear programming; homogeneous self-dual embedding; interior-point method; central path following; ADMM; iteration complexity; POLYNOMIAL-TIME ALGORITHM; PENALTY; IMPLEMENTATION;
D O I
10.1080/10556788.2020.1821200
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this paper, we propose a new framework to implement interior point method (IPM) in order to solve some very large-scale linear programs (LPs). Traditional IPMs typically use Newton's method to approximately solve a subproblem that aims to minimize a log-barrier penalty function at each iteration. Due its connection to Newton's method, IPM is often classified assecond-order method- a genre that is attached with stability and accuracy at the expense of scalability. Indeed, computing a Newton step amounts to solving a large system of linear equations, which can be efficiently implemented if the input data are reasonably sized and/or sparse and/or well-structured. However, in case the above premises fail, then the challenge still stands on the way for a traditional IPM. To deal with this challenge, one approach is to apply the iterative procedure, such as preconditioned conjugate gradient method, to solve the system of linear equations. Since the linear system is different in each iteration, it is difficult to find good pre-conditioner to achieve the overall solution efficiency. In this paper, an alternative approach is proposed. Instead of applying Newton's method, we resort to the alternating direction method of multipliers (ADMM) to approximately minimize the log-barrier penalty function at each iteration, under the framework of primal-dual path-following for a homogeneous self-dual embedded LP model. The resulting algorithm is an ADMM-Based Interior Point Method, abbreviated asABIPin this paper. The new method inherits stability from IPM and scalability from ADMM. Because of its self-dual embedding structure,ABIPis set to solve any LP without requiring prior knowledge about its feasibility. We conduct extensive numerical experiments testingABIPwith large-scale LPs from NETLIB and machine learning applications. The results demonstrate thatABIPcompares favourably with other LP solvers includingSDPT3,MOSEK,DSDP-CGandSCS.
引用
收藏
页码:389 / 424
页数:36
相关论文
共 50 条
  • [1] THE INTERIOR-POINT METHOD FOR LINEAR-PROGRAMMING
    ASTFALK, G
    LUSTIG, I
    MARSTEN, R
    SHANNO, D
    [J]. IEEE SOFTWARE, 1992, 9 (04) : 61 - 68
  • [2] Interior-Point Methods with Decomposition for Solving Large-Scale Linear Programs
    G. Y. Zhao
    [J]. Journal of Optimization Theory and Applications, 1999, 102 : 169 - 192
  • [3] Implementation Tricks of Interior-Point Methods for Large-Scale Linear Programs
    Yuan, Yuan
    [J]. INTERNATIONAL CONFERENCE ON GRAPHIC AND IMAGE PROCESSING (ICGIP 2011), 2011, 8285
  • [4] Interior-point methods with decomposition for solving large-scale linear programs
    Zhao, GY
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1999, 102 (01) : 169 - 192
  • [5] Interior-Point Solver for Large-Scale Quadratic Programming Problems with Bound Constraints
    S. Cafieri
    M. D’Apuzzo
    M. Marino
    A. Mucherino
    G. Toraldo
    [J]. Journal of Optimization Theory and Applications, 2006, 129 : 55 - 75
  • [6] Interior-point solver for large-scale quadratic programming problems with bound constraints
    Cafieri, S.
    D'Apuzzo, M.
    Marino, M.
    Mucherino, A.
    Toraldo, G.
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2006, 129 (01) : 55 - 75
  • [7] An interior-point smoothing technique for Lagrangian relaxation in large-scale convex programming
    Shida, Masayuki
    [J]. OPTIMIZATION, 2008, 57 (01) : 183 - 200
  • [8] AN INTERIOR-POINT METHOD FOR GENERALIZED LINEAR-FRACTIONAL PROGRAMMING
    NESTEROV, YE
    NEMIROVSKII, AS
    [J]. MATHEMATICAL PROGRAMMING, 1995, 69 (01) : 177 - 204
  • [9] Scaling Performance of Interior-Point Method on Large-Scale Chip Multiprocessor System
    Smelyanskiy, Mikhail
    Lee, Victor W.
    Kim, Daehyun
    Nguyen, Anthony D.
    Dubey, Pradeep
    [J]. 2007 ACM/IEEE SC07 CONFERENCE, 2010, : 400 - 410
  • [10] An interior-point piecewise linear penalty method for nonlinear programming
    Chen, Lifeng
    Goldfarb, Donald
    [J]. MATHEMATICAL PROGRAMMING, 2011, 128 (1-2) : 73 - 122