Alternating proximal gradient method for sparse nonnegative Tucker decomposition

被引:61
|
作者
Xu, Yangyang [1 ]
机构
[1] Rice Univ, Dept Computat & Appl Math, Houston, TX 77005 USA
关键词
Sparse nonnegative Tucker decomposition; Alternating proximal gradient method; Non-convex optimization; Sparse optimization;
D O I
10.1007/s12532-014-0074-y
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Multi-way data arises in many applications such as electroencephalography classification, face recognition, text mining and hyperspectral data analysis. Tensor decomposition has been commonly used to find the hidden factors and elicit the intrinsic structures of the multi-way data. This paper considers sparse nonnegative Tucker decomposition (NTD), which is to decompose a given tensor into the product of a core tensor and several factor matrices with sparsity and nonnegativity constraints. An alternating proximal gradient method is applied to solve the problem. The algorithm is then modified to sparse NTD with missing values. Per-iteration cost of the algorithm is estimated scalable about the data size, and global convergence is established under fairly loose conditions. Numerical experiments on both synthetic and real world data demonstrate its superiority over a few state-of-the-art methods for (sparse) NTD from partial and/or full observations. The MATLAB code along with demos are accessible from the author's homepage.
引用
收藏
页码:39 / 70
页数:32
相关论文
共 50 条
  • [21] Computation of the nonnegative canonical tensor decomposition with two accelerated proximal gradient algorithms
    Nazih, Marouane
    Minaoui, Khalid
    Sobhani, Elaheh
    Comon, Pierre
    [J]. DIGITAL SIGNAL PROCESSING, 2022, 129
  • [22] Discriminative Nonnegative Tucker Decomposition for Tensor Data Representation
    Jing, Wenjing
    Lu, Linzhang
    Liu, Qilong
    [J]. MATHEMATICS, 2022, 10 (24)
  • [23] Sequential Alternating Proximal Method for Scalable Sparse Structural SVMs
    Balamurugan, P.
    Shevade, Shirish
    Babu, T. Ravindra
    [J]. 12TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2012), 2012, : 61 - 70
  • [24] Fast Recursive Nonnegative Standard and Hierarchical Tucker Decomposition
    Fonal, Krzysztof
    Zdunek, Rafal
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2019, 26 (09) : 1265 - 1269
  • [25] DYNAMIC SPARSE CODING WITH SMOOTHING PROXIMAL GRADIENT METHOD
    Chalasani, Rakesh
    Principe, Jose C.
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [26] A Fast Gradient Method for Nonnegative Sparse Regression With Self-Dictionary
    Gillis, Nicolas
    Luce, Robert
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) : 24 - 37
  • [27] SPARSE NONNEGATIVE DYNAMIC MODE DECOMPOSITION
    Takeishi, Naoya
    Kawahara, Yoshinobu
    Yairi, Takehisa
    [J]. 2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 2682 - 2686
  • [28] The Alternating Descent Conditional Gradient Method for Sparse Inverse Problems
    Boyd, Nicholas
    Schiebinger, Geoffrey
    Recht, Benjamin
    [J]. 2015 IEEE 6TH INTERNATIONAL WORKSHOP ON COMPUTATIONAL ADVANCES IN MULTI-SENSOR ADAPTIVE PROCESSING (CAMSAP), 2015, : 57 - 60
  • [29] THE ALTERNATING DESCENT CONDITIONAL GRADIENT METHOD FOR SPARSE INVERSE PROBLEMS
    Boyd, Nicholas
    Schiebinger, Geoffrey
    Recht, Benjamin
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2017, 27 (02) : 616 - 639
  • [30] A Proximal Approach for Nonnegative Tensor Decomposition
    Vu, Xuan
    Chaux, Caroline
    Thirion-Moreau, Nadege
    Maire, Sylvain
    [J]. LATENT VARIABLE ANALYSIS AND SIGNAL SEPARATION (LVA/ICA 2017), 2017, 10169 : 201 - 210