MULTIRESOLUTION LOW-RANK TENSOR FORMATS

被引:2
|
作者
Mickelin, Oscar [1 ]
Karaman, Sertac [2 ]
机构
[1] MIT, Dept Math, Cambridge, MA 02139 USA
[2] MIT, Dept Aeronaut & Astronaut, Cambridge, MA 02139 USA
关键词
tensors; tensor-train format; multiresolution linear algebra; ONE APPROXIMATION; DATA ASSIMILATION; DECOMPOSITIONS; CONVERGENCE; ALGORITHM; SPARSE;
D O I
10.1137/19M1284579
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We describe a simple, black-box compression format for tensors with a multiscale structure. By representing the tensor as a sum of compressed tensors defined on increasingly coarse grids, we capture low-rank structures on each grid-scale, and we show how this leads to an increase in compression for a fixed accuracy. We devise an alternating algorithm to represent a given tensor in the multiresolution format and prove local convergence guarantees. In two dimensions, we provide examples that show that this approach can beat the Eckart-Young theorem, and for dimensions higher than two, we achieve higher compression than the tensor-train format on six real-world datasets. We also provide results on the closedness and stability of the tensor format and discuss how to perform common linear algebra operations on the level of the compressed tensors.
引用
收藏
页码:1086 / 1114
页数:29
相关论文
共 50 条
  • [1] Constructive Representation of Functions in Low-Rank Tensor Formats
    I. V. Oseledets
    [J]. Constructive Approximation, 2013, 37 : 1 - 18
  • [2] Constructive Representation of Functions in Low-Rank Tensor Formats
    Oseledets, I. V.
    [J]. CONSTRUCTIVE APPROXIMATION, 2013, 37 (01) : 1 - 18
  • [3] Bayesian inversion for electromyography using low-rank tensor formats
    Roerich, Anna
    Werthmann, Tim A.
    Goeddeke, Dominik
    Grasedyck, Lars
    [J]. INVERSE PROBLEMS, 2021, 37 (05)
  • [4] Efficient low-rank approximation of the stochastic Galerkin matrix in tensor formats
    Espig, Mike
    Hackbusch, Wolfgang
    Litvinenko, Alexander
    Matthies, Hermann G.
    Waehnert, Philipp
    [J]. COMPUTERS & MATHEMATICS WITH APPLICATIONS, 2014, 67 (04) : 818 - 829
  • [5] Robust Low-Rank and Sparse Tensor Decomposition for Low-Rank Tensor Completion
    Shi, Yuqing
    Du, Shiqiang
    Wang, Weilan
    [J]. PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 7138 - 7143
  • [6] Low-rank tensor structure of linear diffusion operators in the TT and QTT formats
    Kazeev, Vladimir
    Reichmann, Oleg
    Schwab, Christoph
    [J]. LINEAR ALGEBRA AND ITS APPLICATIONS, 2013, 438 (11) : 4204 - 4221
  • [7] FAST MULTIDIMENSIONAL CONVOLUTION IN LOW-RANK TENSOR FORMATS VIA CROSS APPROXIMATION
    Rakhuba, M. V.
    Oseledets, I. V.
    [J]. SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2015, 37 (02): : A565 - A582
  • [8] Low-rank Tensor Tracking
    Javed, Sajid
    Dias, Jorge
    Werghi, Naoufel
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 605 - 614
  • [9] Low-Rank Tensor Completion by Approximating the Tensor Average Rank
    Wang, Zhanliang
    Dong, Junyu
    Liu, Xinguo
    Zeng, Xueying
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 4592 - 4600
  • [10] Tensor Factorization for Low-Rank Tensor Completion
    Zhou, Pan
    Lu, Canyi
    Lin, Zhouchen
    Zhang, Chao
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (03) : 1152 - 1163