A Riemannian symmetric rank-one trust-region method

被引:51
|
作者
Huang, Wen [1 ]
Absil, P. -A. [2 ]
Gallivan, K. A. [1 ]
机构
[1] Florida State Univ, Dept Math, Tallahassee, FL 32306 USA
[2] Catholic Univ Louvain, Dept Engn Math, ICTEAM Inst, B-1348 Louvain, Belgium
关键词
Riemannian optimization; Optimization on manifolds; Symmetric rank-one update; Rayleigh quotient; Joint diagonalization; Stiefel manifold; QUASI-NEWTON MATRICES; ONE UPDATE; MANIFOLDS; OPTIMIZATION; CONVERGENCE; TENSORS;
D O I
10.1007/s10107-014-0765-1
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The well-known symmetric rank-one trust-region method-where the Hessian approximation is generated by the symmetric rank-one update-is generalized to the problem of minimizing a real-valued function over a -dimensional Riemannian manifold. The generalization relies on basic differential-geometric concepts, such as tangent spaces, Riemannian metrics, and the Riemannian gradient, as well as on the more recent notions of (first-order) retraction and vector transport. The new method, called RTR-SR1, is shown to converge globally and -step q-superlinearly to stationary points of the objective function. A limited-memory version, referred to as LRTR-SR1, is also introduced. In this context, novel efficient strategies are presented to construct a vector transport on a submanifold of a Euclidean space. Numerical experiments-Rayleigh quotient minimization on the sphere and a joint diagonalization problem on the Stiefel manifold-illustrate the value of the new methods.
引用
收藏
页码:179 / 216
页数:38
相关论文
共 50 条
  • [31] On rank-one corrections of complex symmetric matrices
    Dana M.
    Ikramov Kh.D.
    [J]. Journal of Mathematical Sciences, 2007, 141 (6) : 1614 - 1617
  • [32] Local Convergence of the Symmetric Rank-One Iteration
    C.T. Kelley
    E.W. Sachs
    [J]. Computational Optimization and Applications, 1998, 9 : 43 - 63
  • [33] A RIEMANNIAN TRUST REGION METHOD FOR THE CANONICAL TENSOR RANK APPROXIMATION PROBLEM
    Breiding, Paul
    Vannieuwenhoven, Nick
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2018, 28 (03) : 2435 - 2465
  • [34] Complete Dictionary Recovery Over the Sphere II: Recovery by Riemannian Trust-Region Method
    Sun, Ju
    Qu, Qing
    Wright, John
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2017, 63 (02) : 885 - 914
  • [35] Improved Hessian approximation with modified secant equations for symmetric rank-one method
    Modarres, Farzin
    Malik, Abu Hassan
    Leong, Wah June
    [J]. JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2011, 235 (08) : 2423 - 2431
  • [36] A symmetric rank-one method based on extra updating techniques for unconstrained optimization
    Modarres, Farzin
    Abu Hassan, Malik
    Leong, Wah June
    [J]. COMPUTERS & MATHEMATICS WITH APPLICATIONS, 2011, 62 (01) : 392 - 400
  • [37] A new trust-region method with line search for solving symmetric nonlinear equations
    Yuan, Gonglin
    Lu, Sha
    Wei, Zengxin
    [J]. INTERNATIONAL JOURNAL OF COMPUTER MATHEMATICS, 2011, 88 (10) : 2109 - 2123
  • [38] Metric-Based Symmetric Rank-One Updates
    B. Smith
    J.L. Nazareth
    [J]. Computational Optimization and Applications, 1997, 8 : 219 - 244
  • [39] NONLINEAR RANK-ONE MODIFICATION OF THE SYMMETRIC EIGENVALUE PROBLEM
    Huang, Xin
    Bai, Zhaojun
    Su, Yangfeng
    [J]. JOURNAL OF COMPUTATIONAL MATHEMATICS, 2010, 28 (02) : 218 - 234
  • [40] Nonstandard rank-one nonincreasing maps on symmetric matrices
    Orel, Marko
    [J]. LINEAR & MULTILINEAR ALGEBRA, 2019, 67 (02): : 391 - 432