Analysis of a symmetric rank-one trust region method

被引:42
|
作者
Byrd, RH [1 ]
Khalfan, HF [1 ]
Schnabel, RB [1 ]
机构
[1] UNITED ARAB EMIRATES UNIV, DEPT MATH & COMP SCI, AL AIN, U ARAB EMIRATES
关键词
quasi-Newton method; symmetric rank-one update; superlinear convergence;
D O I
10.1137/S1052623493252985
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Several recent computational studies have shown that the symmetric rank-one (SR1) update is a very competitive quasi-Newton update in optimization algorithms. This paper gives a new analysis of a trust region SR1 method for unconstrained optimization and shows that the method has an n+1 step g-superlinear rate of convergence. The analysis makes neither of the assumptions of uniform linear independence of the iterates nor positive definiteness of the Hessian approximations that have been made in other recent analyses of SR1 methods. The trust region method that is analyzed is fairly standard, except that it includes the feature that the Hessian approximation is updated after all steps, including rejected steps. We also present computational results that show that this feature, safeguarded in a way that is consistent with the convergence analysis, does not harm the efficiency of the SR1 trust region method.
引用
收藏
页码:1025 / 1039
页数:15
相关论文
共 50 条
  • [1] A Riemannian symmetric rank-one trust-region method
    Wen Huang
    P.-A. Absil
    K. A. Gallivan
    Mathematical Programming, 2015, 150 : 179 - 216
  • [2] A Riemannian symmetric rank-one trust-region method
    Huang, Wen
    Absil, P. -A.
    Gallivan, K. A.
    MATHEMATICAL PROGRAMMING, 2015, 150 (02) : 179 - 216
  • [3] A Limited-Memory Riemannian Symmetric Rank-One Trust-Region Method with a Restart Strategy
    Huang, Wen
    Gallivan, Kyle A.
    JOURNAL OF SCIENTIFIC COMPUTING, 2022, 93 (01)
  • [4] A Limited-Memory Riemannian Symmetric Rank-One Trust-Region Method with a Restart Strategy
    Wen Huang
    Kyle A. Gallivan
    Journal of Scientific Computing, 2022, 93
  • [5] A limited-memory Riemannian symmetric rank-one trust-region method with an efficient algorithm for its subproblem
    Huang, Wen
    Gallivan, Kyle A.
    IFAC PAPERSONLINE, 2021, 54 (09): : 572 - 577
  • [6] Structured symmetric rank-one method for unconstrained optimization
    Modarres, Farzin
    Abu Hassan, Malik
    Leong, Wah June
    INTERNATIONAL JOURNAL OF COMPUTER MATHEMATICS, 2011, 88 (12) : 2608 - 2617
  • [7] A modified scaled memoryless symmetric rank-one method
    Babaie-Kafaki, Saman
    BOLLETTINO DELLA UNIONE MATEMATICA ITALIANA, 2020, 13 (03): : 369 - 379
  • [8] On the perturbation of rank-one symmetric tensors
    O'Hara, Michael J.
    NUMERICAL LINEAR ALGEBRA WITH APPLICATIONS, 2014, 21 (01) : 1 - 12
  • [9] Rank-one approximation of a higher-order tensor by a Riemannian trust-region method
    Chen, Jianheng
    Huang, Wen
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2025, 90 (02) : 515 - 556
  • [10] RANK-ONE MODIFICATION OF SYMMETRIC EIGENPROBLEM
    BUNCH, JR
    NIELSEN, CP
    SORENSEN, DC
    NUMERISCHE MATHEMATIK, 1978, 31 (01) : 31 - 48