A dual gradient-projection method for large-scale strictly convex quadratic problems

被引:3
|
作者
Gould, Nicholas I. M. [1 ]
Robinson, Daniel P. [2 ]
机构
[1] STFC Rutherford Appleton Lab, Comp Sci Dept, Chilton OX11 0QX, Oxon, England
[2] Johns Hopkins Univ, Dept Appl Math & Stat, Baltimore, MD 21218 USA
基金
英国工程与自然科学研究理事会;
关键词
Convex optimization; Quadratic programming; Gradient projection; Large-scale optimization; Sparse factorizations; Dual method; 2ND-DERIVATIVE SQP METHOD; METHOD LOCAL CONVERGENCE; ACTIVE-SET; FILTER METHOD; POINT; ALGORITHMS; OPTIMIZATION; COMPLEMENTARITY; COMPUTATION; BOUNDS;
D O I
10.1007/s10589-016-9886-1
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
The details of a solver for minimizing a strictly convex quadratic objective function subject to general linear constraints are presented. The method uses a gradient projection algorithm enhanced with subspace acceleration to solve the bound-constrained dual optimization problem. Such gradient projection methods are well-known, but are typically employed to solve the primal problem when only simple bound-constraints are present. The main contributions of this work are threefold. First, we address the challenges associated with solving the dual problem, which is usually a convex problem even when the primal problem is strictly convex. In particular, for the dual problem, one must efficiently compute directions of infinite descent when they exist, which is precisely when the primal formulation is infeasible. Second, we show how the linear algebra may be arranged to take computational advantage of sparsity that is often present in the second-derivative matrix, mostly by showing how sparse updates may be performed for algorithmic quantities. We consider the case that the second-derivative matrix is explicitly available and sparse, and the case when it is available implicitly via a limited memory BFGS representation. Third, we present the details of our Fortran 2003 software package DQP, which is part of the GALAHAD suite of optimization routines. Numerical tests are performed on quadratic programming problems from the combined CUTEst and Maros and Meszaros test sets.
引用
收藏
页码:1 / 38
页数:38
相关论文
共 50 条
  • [1] A dual gradient-projection method for large-scale strictly convex quadratic problems
    Nicholas I. M. Gould
    Daniel P. Robinson
    [J]. Computational Optimization and Applications, 2017, 67 : 1 - 38
  • [2] A general regularized gradient-projection method for solving equilibrium and constrained convex minimization problems
    Tian, Ming
    Jiao, Si-Wen
    [J]. OPTIMIZATION, 2016, 65 (11) : 2007 - 2024
  • [3] A fully distributed dual gradient method with linear convergence for large-scale separable convex problems
    Necoara, Ion
    Nedich, Angelia
    [J]. 2015 EUROPEAN CONTROL CONFERENCE (ECC), 2015, : 304 - 309
  • [4] SOLUTION OF LARGE-SCALE SEPARABLE STRICTLY CONVEX QUADRATIC PROGRAMS ON THE SIMPLEX
    JUDICE, JJ
    PIRES, FM
    [J]. LINEAR ALGEBRA AND ITS APPLICATIONS, 1992, 170 : 214 - 220
  • [5] Regularized gradient-projection methods for equilibrium and constrained convex minimization problems
    Ming Tian
    Li-Hua Huang
    [J]. Journal of Inequalities and Applications, 2013
  • [6] An Inexact Dual Fast Gradient-Projection Method for Separable Convex Optimization with Linear Coupled Constraints
    Jueyou Li
    Zhiyou Wu
    Changzhi Wu
    Qiang Long
    Xiangyu Wang
    [J]. Journal of Optimization Theory and Applications, 2016, 168 : 153 - 171
  • [7] Regularized gradient-projection methods for equilibrium and constrained convex minimization problems
    Tian, Ming
    Huang, Li-Hua
    [J]. JOURNAL OF INEQUALITIES AND APPLICATIONS, 2013,
  • [8] An Inexact Dual Fast Gradient-Projection Method for Separable Convex Optimization with Linear Coupled Constraints
    Li, Jueyou
    Wu, Zhiyou
    Wu, Changzhi
    Long, Qiang
    Wang, Xiangyu
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2016, 168 (01) : 153 - 171
  • [9] A hybrid gradient method for strictly convex quadratic programming
    Oviedo, Harry
    Dalmau, Oscar
    Herrera, Rafael
    [J]. NUMERICAL LINEAR ALGEBRA WITH APPLICATIONS, 2021, 28 (04)
  • [10] GRADIENT PROJECTION TECHNIQUES FOR LARGE-SCALE OPTIMIZATION PROBLEMS
    MORE, JJ
    [J]. PROCEEDINGS OF THE 28TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-3, 1989, : 378 - 381