A Riemannian trust-region method for low-rank tensor completion

被引:18
|
作者
Heidel, Gennadij [1 ]
Schulz, Volker [1 ]
机构
[1] Univ Trier, Fachbereich Math 4, D-54286 Trier, Germany
关键词
low-rank tensors; multilinear rank; Riemannian Hessian; Riemannian optimization; trust-region methods; Tucker decomposition; OPTIMIZATION; APPROXIMATION;
D O I
10.1002/nla.2175
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The goal of tensor completion is to fill in missing entries of a partially known tensor (possibly including some noise) under a low-rank constraint. This may be formulated as a least-squares problem. The set of tensors of a given multilinear rank is known to admit a Riemannian manifold structure; thus, methods of Riemannian optimization are applicable. In our work, we derive the Riemannian Hessian of an objective function on the low-rank tensor manifolds using the Weingarten map, a concept from differential geometry. We discuss the convergence properties of Riemannian trust-region methods based on the exact Hessian and standard approximations, both theoretically and numerically. We compare our approach with Riemannian tensor completion methods from recent literature, both in terms of convergence behavior and computational complexity. Our examples include the completion of randomly generated data with and without noise and the recovery of multilinear data from survey statistics.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Riemannian conjugate gradient method for low-rank tensor completion
    Duan, Shan-Qi
    Duan, Xue-Feng
    Li, Chun-Mei
    Li, Jiao-Fen
    [J]. ADVANCES IN COMPUTATIONAL MATHEMATICS, 2023, 49 (03)
  • [2] Riemannian conjugate gradient method for low-rank tensor completion
    Shan-Qi Duan
    Xue-Feng Duan
    Chun-Mei Li
    Jiao-Fen Li
    [J]. Advances in Computational Mathematics, 2023, 49
  • [3] Low-rank tensor completion by Riemannian optimization
    Daniel Kressner
    Michael Steinlechner
    Bart Vandereycken
    [J]. BIT Numerical Mathematics, 2014, 54 : 447 - 468
  • [4] Low-rank tensor completion by Riemannian optimization
    Kressner, Daniel
    Steinlechner, Michael
    Vandereycken, Bart
    [J]. BIT NUMERICAL MATHEMATICS, 2014, 54 (02) : 447 - 468
  • [5] Low-rank tensor completion: a Riemannian manifold preconditioning approach
    Kasai, Hiroyuki
    Mishra, Bamdev
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48
  • [6] A Riemannian symmetric rank-one trust-region method
    Huang, Wen
    Absil, P. -A.
    Gallivan, K. A.
    [J]. MATHEMATICAL PROGRAMMING, 2015, 150 (02) : 179 - 216
  • [7] A Riemannian symmetric rank-one trust-region method
    Wen Huang
    P.-A. Absil
    K. A. Gallivan
    [J]. Mathematical Programming, 2015, 150 : 179 - 216
  • [8] Tensor Completion using Low-Rank Tensor Train Decomposition by Riemannian Optimization
    Wang, Junli
    Zhao, Guangshe
    Wang, Dingheng
    Li, Guoqi
    [J]. 2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 3380 - 3384
  • [9] Low-Rank Tensor Completion Method for Implicitly Low-Rank Visual Data
    Ji, Teng-Yu
    Zhao, Xi-Le
    Sun, Dong-Lin
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 1162 - 1166
  • [10] A Weighted Tensor Factorization Method for Low-rank Tensor Completion
    Cheng, Miaomiao
    Jing, Liping
    Ng, Michael K.
    [J]. 2019 IEEE FIFTH INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM 2019), 2019, : 30 - 38