A Randomized Algorithm for Tensor Singular Value Decomposition Using an Arbitrary Number of Passes

被引:1
|
作者
Ahmadi-Asl, Salman [1 ]
Phan, Anh-Huy [1 ]
Cichocki, Andrzej [2 ]
机构
[1] Skolkovo Inst Sci & Technol, Ctr Artificial Intelligence Technol, Moscow, Russia
[2] Polish Acad Sci, Syst Res Inst, Warsaw, Poland
关键词
Tensor singular value decomposition; Randomization; Pass-efficient algorithms; MATRIX; FACTORIZATION; APPROXIMATION;
D O I
10.1007/s10915-023-02411-2
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Efficient and fast computation of a tensor singular value decomposition (t-SVD) with a few passes over the underlying data tensor is crucial because of its many potential applications. The current/existing subspace randomized algorithms need (2q + 2) passes over the data tensor to compute a t-SVD, where q is a non-negative integer number (power iteration parameter). In this paper, we propose an efficient and flexible randomized algorithm that can handle any number of passes q, which not necessary need be even. The flexibility of the proposed algorithm in using fewer passes naturally leads to lower computational and communication costs. This advantage makes it particularly appropriate when our task calls for several tensor decompositions or when the data tensors are huge. The proposed algorithm is a generalization of the methods developed for matrices to tensors. The expected/average error bound of the proposed algorithm is derived. Extensive numerical experiments on random and real-world data sets are conducted, and the proposed algorithm is compared with some baseline algorithms. The extensive computer simulation experiments demonstrate that the proposed algorithm is practical, efficient, and in general outperforms the state of the arts algorithms. We also demonstrate how to use the proposed method to develop a fast algorithm for the tensor completion problem.
引用
收藏
页数:25
相关论文
共 50 条
  • [11] Tensor approximation algorithm based on high order singular value decomposition
    Zhu, Yan-li
    Wang, Jian-ping
    Guo, Xiao-juan
    Liu, Chang
    Journal of Convergence Information Technology, 2012, 7 (15) : 211 - 218
  • [12] Quantum tensor singular value decomposition
    Wang, Xiaoqiang
    Gu, Lejia
    Lee, Heung-wing
    Zhang, Guofeng
    JOURNAL OF PHYSICS COMMUNICATIONS, 2021, 5 (07):
  • [13] MPEG video watermarking using tensor singular value decomposition
    Abdallah, Emad E.
    Ben Hamza, A.
    Bhattacharya, Prabir
    IMAGE ANALYSIS AND RECOGNITION, PROCEEDINGS, 2007, 4633 : 772 - 783
  • [14] An efficient randomized QLP algorithm for approximating the singular value decomposition
    Kaloorazi, M. F.
    Liu, K.
    Chen, J.
    de Lamare, R. C.
    INFORMATION SCIENCES, 2023, 648
  • [15] An Efficient Randomized Fixed-Precision Algorithm for Tensor Singular Value Decomposition (vol 5, 1564, 2023)
    Ahmadi-Asl, Salman
    COMMUNICATIONS ON APPLIED MATHEMATICS AND COMPUTATION, 2024, : 2332 - 2335
  • [16] ALGORITHM FOR SINGULAR VALUE DECOMPOSITION
    ROSS, DC
    PROCEEDINGS OF THE SOCIETY OF PHOTO-OPTICAL INSTRUMENTATION ENGINEERS, 1984, 495 : 22 - 29
  • [17] IMPLEMENTING MARQUARDTS ALGORITHM USING SINGULAR VALUE DECOMPOSITION
    SHRAGER, RI
    SIAM REVIEW, 1976, 18 (04) : 827 - 827
  • [18] NSVD: Normalized Singular Value Deviation Reveals Number of Latent Factors in Tensor Decomposition
    Tsitsikas, Yorgos
    Papalexakis, Evangelos E.
    BIG DATA, 2020, 8 (05) : 412 - 430
  • [19] NSVD: Normalized Singular Value Deviation Reveals Number of Latent Factors in Tensor Decomposition
    Tsitsikas, Yorgos
    Papalexakis, Evangelos E.
    PROCEEDINGS OF THE 2020 SIAM INTERNATIONAL CONFERENCE ON DATA MINING (SDM), 2020, : 667 - 675
  • [20] Guaranteed Functional Tensor Singular Value Decomposition
    Han, Rungang
    Shi, Pixu
    Zhang, Anru R.
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2024, 119 (546) : 995 - 1007