Low-Rank Tucker Approximation of a Tensor from Streaming Data

被引:49
|
作者
Sun, Yiming [1 ]
Guo, Yang [2 ]
Luo, Charlene [3 ]
Tropp, Joel [4 ]
Udell, Madeleine [5 ]
机构
[1] Cornell Univ, Dept Stat & Data Sci, Ithaca, NY 14853 USA
[2] Univ Wisconsin Madison, Dept Comp Sci, Madison, WI 53706 USA
[3] Columbia Univ, New York, NY 10027 USA
[4] CALTECH, Dept Comp Math Sci, Pasadena, CA 91125 USA
[5] Cornell Univ, Sch Operat Res & Informat Engn, Ithaca, NY 14853 USA
来源
关键词
Tucker decomposition; tensor compression; dimension reduction; sketching method; randomized algorithm; streaming algorithm; ALGORITHMS; DECOMPOSITIONS;
D O I
10.1137/19M1257718
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper describes a new algorithm for computing a low-Tucker-rank approximation of a tensor. The method applies a randomized linear map to the tensor to obtain a sketch that captures the important directions within each mode, as well as the interactions among the modes. The sketch can be extracted from streaming or distributed data or with a single pass over the tensor, and it uses storage proportional to the degrees of freedom in the output Tucker approximation. The algorithm does not require a second pass over the tensor, although it can exploit another view to compute a superior approximation. The paper provides a rigorous theoretical guarantee on the approximation error. Extensive numerical experiments show that the algorithm produces useful results that improve on the state-of-the-art for streaming Tucker decomposition.
引用
收藏
页码:1123 / 1150
页数:28
相关论文
共 50 条
  • [1] Imputation of Streaming Low-Rank Tensor Data
    Mardani, Morteza
    Mateos, Gonzalo
    Giannakis, Georgios B.
    [J]. 2014 IEEE 8TH SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING WORKSHOP (SAM), 2014, : 433 - 436
  • [2] ONLINE TENSOR LOW-RANK REPRESENTATION FOR STREAMING DATA
    Wu, Tong
    [J]. PROCEEDINGS OF THE 2020 IEEE 30TH INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2020,
  • [3] Greedy low-rank approximation in Tucker format of solutions of tensor linear systems
    Georgieva, I
    Hofreither, C.
    [J]. JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2019, 358 : 206 - 220
  • [4] Online Tensor Low-Rank Representation for Streaming Data Clustering
    Wu, Tong
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (02) : 602 - 617
  • [5] A DEIM Tucker tensor cross algorithm and its application to dynamical low-rank approximation
    Ghahremani, Behzad
    Babaee, Hessam
    [J]. COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING, 2024, 423
  • [6] Optimality conditions for Tucker low-rank tensor optimization
    Luo, Ziyan
    Qi, Liqun
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2023, 86 (03) : 1275 - 1298
  • [7] Optimality conditions for Tucker low-rank tensor optimization
    Ziyan Luo
    Liqun Qi
    [J]. Computational Optimization and Applications, 2023, 86 : 1275 - 1298
  • [8] Online Robust Low-Rank Tensor Modeling for Streaming Data Analysis
    Li, Ping
    Feng, Jiashi
    Jin, Xiaojie
    Zhang, Luming
    Xu, Xianghua
    Yan, Shuicheng
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (04) : 1061 - 1075
  • [9] A sequential multilinear Nyström algorithm for streaming low-rank approximation of tensors in Tucker format
    Bucci, Alberto
    Hashemi, Behnam
    [J]. APPLIED MATHEMATICS LETTERS, 2025, 159
  • [10] On Approximation Algorithm for Orthogonal Low-Rank Tensor Approximation
    Yuning Yang
    [J]. Journal of Optimization Theory and Applications, 2022, 194 : 821 - 851