Optimization of Symmetric Tensor Computations

被引:0
|
作者
Cai, Jonathon [1 ]
Baskaran, Muthu [2 ]
Meister, Benoit [2 ]
Lethin, Richard [2 ]
机构
[1] Yale Univ, Dept Comp Sci, POB 2158, New Haven, CT 06520 USA
[2] Reservoir Labs Inc, New York, NY 10012 USA
关键词
D O I
暂无
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
For applications that deal with large amounts of high dimensional multi-aspect data, it is natural to represent such data as tensors or multi-way arrays. Tensor computations, such as tensor decompositions, are increasingly being used to extract and explain properties of such data. An important class of tensors is the symmetric tensor, which shows up in real-world applications such as signal processing, biomedical engineering, and data analysis. In this work, we describe novel optimizations that exploit the symmetry in tensors in order to reduce redundancy in computations and storage and effectively parallelize operations involving symmetric tensors. Specifically, we apply our optimizations on the matricized tensor times Khatri Rao product (mttkrp) operation, a key operation in tensor decomposition algorithms such as INDSCAL (individual differences in scaling) for symmetric tensors. We demonstrate improved performance for both sequential and parallel execution using our techniques on various synthetic and real data sets.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] Numerical optimization for symmetric tensor decomposition
    Kolda, Tamara G.
    MATHEMATICAL PROGRAMMING, 2015, 151 (01) : 225 - 248
  • [2] Numerical optimization for symmetric tensor decomposition
    Tamara G. Kolda
    Mathematical Programming, 2015, 151 : 225 - 248
  • [3] Symmetric tensor networks for generative modeling and constrained combinatorial optimization
    Lopez-Piqueres, Javier
    Chen, Jing
    Perdomo-Ortiz, Alejandro
    MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2023, 4 (03):
  • [4] Riemannian Newton optimization methods for the symmetric tensor approximation problem
    Khouja, Rima
    Khalil, Houssam
    Mourrain, Bernard
    LINEAR ALGEBRA AND ITS APPLICATIONS, 2022, 637 : 175 - 211
  • [5] Computations in quantum tensor networks
    Huckle, T.
    Waldherr, K.
    Schulte-Herbrueggen, T.
    LINEAR ALGEBRA AND ITS APPLICATIONS, 2013, 438 (02) : 750 - 781
  • [6] Tensor ranks and symmetric tensor ranks are the same for points with low symmetric tensor rank
    E. Ballico
    Archiv der Mathematik, 2011, 96 : 531 - 534
  • [7] Tensor ranks and symmetric tensor ranks are the same for points with low symmetric tensor rank
    Ballico, E.
    ARCHIV DER MATHEMATIK, 2011, 96 (06) : 531 - 534
  • [8] Prefix computations on symmetric multiprocessors
    Helman, DR
    Jálá, J
    IPPS/SPDP 1999: 13TH INTERNATIONAL PARALLEL PROCESSING SYMPOSIUM & 10TH SYMPOSIUM ON PARALLEL AND DISTRIBUTED PROCESSING, PROCEEDINGS, 1999, : 7 - 13
  • [9] SYMMETRIC TENSORS AND SYMMETRIC TENSOR RANK
    Comon, Pierre
    Golub, Gene
    Lim, Lek-Heng
    Mourrain, Bernard
    SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2008, 30 (03) : 1254 - 1279
  • [10] On Distributing Symmetric Streaming Computations
    Feldman, Jon
    Muthukrishnan, S.
    Sidiropoulos, Anastasios
    Stein, Cliff
    Svitkina, Zoya
    PROCEEDINGS OF THE NINETEENTH ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, 2008, : 710 - +