A d.c. optimization algorithm for solving the trust-region subproblem

被引:357
|
作者
Tao, PD [1 ]
An, LTH [1 ]
机构
[1] INSA Rouen, LMI, Math Modelling & Appl Optimizat Grp, CNRS,URA 1378, F-76131 Mt St Aignan, France
关键词
dc optimization; dc duality; global and local optimality conditions; regularization techniques; DCA; Lanczos method; trust-region subproblem;
D O I
10.1137/S1052623494274313
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper is devoted to difference of convex functions (d.c.) optimization: d.c. duality, local and global optimality conditions in d.c. programming, the d.c. algorithm (DCA), and its application to solving the trust-region problem. The DCA is an iterative method that is quite different from well-known related algorithms. Thanks to the particular structure of the trust-region problem, the DCA is very simple (requiring only matrix-vector products) and, in practice, converges to the global solution. The inexpensive implicitly restarted Lanczos method of Sorensen is used to check the optimality of solutions provided by the DCA. When a nonglobal solution is found, a simple numerical procedure is introduced both to find a feasible point having a smaller objective value and to restart the DCA at this point. It is shown that in the nonconvex case, the DCA converges to the global solution of the trust-region problem, using only matrix-vector products and requiring at most 2m+2 restarts, where m is the number of distinct negative eigenvalues of the coefficient matrix that defines the problem. Numerical simulations establish the robustness and efficiency of the DCA compared to standard related methods, especially for large-scale problems.
引用
收藏
页码:476 / 505
页数:30
相关论文
共 50 条
  • [1] A multilevel algorithm for solving the trust-region subproblem
    Toint, Philippe L.
    Tomanos, D.
    Weber-Mendonca, M.
    [J]. OPTIMIZATION METHODS & SOFTWARE, 2009, 24 (02): : 299 - 311
  • [2] Behavior of DCA sequences for solving the trust-region subproblem
    Hoai An Le Thi
    Tao Pham Dinh
    Nguyen Dong Yen
    [J]. Journal of Global Optimization, 2012, 53 : 317 - 329
  • [3] Solving the trust-region subproblem using the Lanczos method
    Gould, NIM
    Lucidi, S
    Roma, M
    Toint, PL
    [J]. SIAM JOURNAL ON OPTIMIZATION, 1999, 9 (02) : 504 - 525
  • [4] SOLVING THE TRUST-REGION SUBPROBLEM BY A GENERALIZED EIGENVALUE PROBLEM
    Adachi, Satoru
    Iwata, Satoru
    Nakatsukasa, Yuji
    Takeda, Akiko
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2017, 27 (01) : 269 - 291
  • [5] Behavior of DCA sequences for solving the trust-region subproblem
    Hoai An Le Thi
    Tao Pham Dinh
    Nguyen Dong Yen
    [J]. JOURNAL OF GLOBAL OPTIMIZATION, 2012, 53 (02) : 317 - 329
  • [6] On the branch and bound algorithm for the extended trust-region subproblem
    Saeid Ansary Karbasy
    Maziar Salahi
    [J]. Journal of Global Optimization, 2022, 83 : 221 - 233
  • [7] On the branch and bound algorithm for the extended trust-region subproblem
    Karbasy, Saeid Ansary
    Salahi, Maziar
    [J]. JOURNAL OF GLOBAL OPTIMIZATION, 2022, 83 (02) : 221 - 233
  • [8] Solving trust-region subproblem augmented with linear inequality constraints
    Bergmann, Orjan
    Steihaug, Trond
    [J]. OPTIMIZATION METHODS & SOFTWARE, 2013, 28 (01): : 26 - 36
  • [9] THE CONVERGENCE OF THE GENERALIZED LANCZOS TRUST-REGION METHOD FOR THE TRUST-REGION SUBPROBLEM
    Jia, Zhongxiao
    Wang, Fa
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2021, 31 (01) : 887 - 914
  • [10] An efficient algorithm for solving the generalized trust region subproblem
    Salahi, M.
    Taati, A.
    [J]. COMPUTATIONAL & APPLIED MATHEMATICS, 2018, 37 (01): : 395 - 413