MULTIRESOLUTION LOW-RANK TENSOR FORMATS

被引:2
|
作者
Mickelin, Oscar [1 ]
Karaman, Sertac [2 ]
机构
[1] MIT, Dept Math, Cambridge, MA 02139 USA
[2] MIT, Dept Aeronaut & Astronaut, Cambridge, MA 02139 USA
关键词
tensors; tensor-train format; multiresolution linear algebra; ONE APPROXIMATION; DATA ASSIMILATION; DECOMPOSITIONS; CONVERGENCE; ALGORITHM; SPARSE;
D O I
10.1137/19M1284579
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We describe a simple, black-box compression format for tensors with a multiscale structure. By representing the tensor as a sum of compressed tensors defined on increasingly coarse grids, we capture low-rank structures on each grid-scale, and we show how this leads to an increase in compression for a fixed accuracy. We devise an alternating algorithm to represent a given tensor in the multiresolution format and prove local convergence guarantees. In two dimensions, we provide examples that show that this approach can beat the Eckart-Young theorem, and for dimensions higher than two, we achieve higher compression than the tensor-train format on six real-world datasets. We also provide results on the closedness and stability of the tensor format and discuss how to perform common linear algebra operations on the level of the compressed tensors.
引用
收藏
页码:1086 / 1114
页数:29
相关论文
共 50 条
  • [31] Low-rank Tensor Restoration for ERP extraction
    Bonab, Zahra Sohrabi
    Shamsollahi, Mohammad B.
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 87
  • [32] Locally Linear Low-rank Tensor Approximation
    Ozdemir, Alp
    Iwen, Mark A.
    Aviyente, Selin
    [J]. 2015 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2015, : 839 - 843
  • [33] Optimal Low-Rank Tensor Tree Completion
    Li, Zihan
    Zhu, Ce
    Long, Zhen
    Liu, Yipeng
    [J]. 2023 IEEE 25TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, MMSP, 2023,
  • [34] Low-Rank Tensor Thresholding Ridge Regression
    Guo, Kailing
    Zhang, Tong
    Xu, Xiangmin
    Xing, Xiaofen
    [J]. IEEE ACCESS, 2019, 7 : 153761 - 153772
  • [35] Tensor low-rank sparse representation for tensor subspace learning
    Du, Shiqiang
    Shi, Yuqing
    Shan, Guangrong
    Wang, Weilan
    Ma, Yide
    [J]. NEUROCOMPUTING, 2021, 440 : 351 - 364
  • [36] Statistical mechanics of low-rank tensor decomposition
    Kadmon, Jonathan
    Ganguli, Surya
    [J]. JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT, 2019, 2019 (12):
  • [37] A dual framework for low-rank tensor completion
    Nimishakavi, Madhav
    Jawanpuria, Pratik
    Mishra, Bamdev
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [38] Statistical mechanics of low-rank tensor decomposition
    Kadmon, Jonathan
    Ganguli, Surya
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [39] Boosted Sparse and Low-Rank Tensor Regression
    He, Lifang
    Chen, Kun
    Xu, Wanwan
    Zhou, Jiayu
    Wang, Fei
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [40] Scalable and Sound Low-Rank Tensor Learning
    Cheng, Hao
    Yu, Yaoliang
    Zhang, Xinhua
    Xing, Eric
    Schuurmans, Dale
    [J]. ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 51, 2016, 51 : 1114 - 1123