DAMPED GAUSS-NEWTON ALGORITHM FOR NONNEGATIVE TUCKER DECOMPOSITION

被引:0
|
作者
Anh Huy Phan [1 ,2 ]
Tichavsky, Petr [2 ]
Cichocki, Andrzej [1 ,2 ]
机构
[1] RIKEN, Brain Sci Inst, Wako, Japan
[2] Inst Informat Theory & Automat, Prague, Czech Republic
关键词
nonnegative Tucker decomposition; Gauss-Newton; Levenberg-Marquardt; low rank approximation; face clustering;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Algorithms based on alternating optimization for nonnegative Tucker decompositions (NTD) such as ALS, multiplicative least squares, HALS have been confirmed effective and efficient. However, those algorithms often converge very slowly. To this end, we propose a novel algorithm for NTD using the Levenberg-Marquardt technique with fast computation method to construct the approximate Hessian and gradient without building up the large-scale Jacobian. The proposed algorithm has been verified to overwhelmingly outperform "state-of-the-art" NTD algorithms for difficult benchmarks, and application of face clustering.
引用
收藏
页码:665 / 668
页数:4
相关论文
共 50 条
  • [1] FAST DAMPED GAUSS-NEWTON ALGORITHM FOR SPARSE AND NONNEGATIVE TENSOR FACTORIZATION
    Anh Huy Phan
    Tichavsky, Petr
    Cichocki, Andrzej
    2011 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2011, : 1988 - 1991
  • [2] A FURTHER IMPROVEMENT OF A FAST DAMPED GAUSS-NEWTON ALGORITHM FOR CANDECOMP-PARAFAC TENSOR DECOMPOSITION
    Tichavsky, Petr
    Anh Huy Phan
    Cichocki, Andrzej
    2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 5964 - 5968
  • [3] A Robust Gauss-Newton Algorithm for the Optimization of Hydrological Models: From Standard Gauss-Newton to Robust Gauss-Newton
    Qin, Youwei
    Kavetski, Dmitri
    Kuczera, George
    WATER RESOURCES RESEARCH, 2018, 54 (11) : 9655 - 9683
  • [4] Low-complexity Proximal Gauss-Newton Algorithm for Nonnegative Matrix Factorization
    Huang, Kejun
    Fu, Xiao
    2019 7TH IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (IEEE GLOBALSIP), 2019,
  • [5] Large-scale Sparse Tensor Decomposition Using a Damped Gauss-Newton Method
    Ranadive, Teresa M.
    Baskaran, Muthu M.
    2020 IEEE HIGH PERFORMANCE EXTREME COMPUTING CONFERENCE (HPEC), 2020,
  • [6] A Constrained Gauss-Newton Algorithm for Material Decomposition in Spectral Computed Tomography
    Hohweiller, Tom
    Ducros, Nicolas
    Peyrin, Francoise
    Sixou, Bruno
    2018 IEEE 15TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2018), 2018, : 336 - 339
  • [7] A nonmonotone damped Gauss-Newton method for nonlinear complementarity problems
    Dong, Li
    ITALIAN JOURNAL OF PURE AND APPLIED MATHEMATICS, 2023, (49): : 206 - 215
  • [8] LOW COMPLEXITY DAMPED GAUSS-NEWTON ALGORITHMS FOR CANDECOMP/PARAFAC
    Anh-Huy Phan
    Tichavsky, Petr
    Cichocki, Andrzej
    SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2013, 34 (01) : 126 - 147
  • [9] CONVERGENCE ANALYSIS OF THE GENERAL GAUSS-NEWTON ALGORITHM
    SCHABACK, R
    NUMERISCHE MATHEMATIK, 1985, 46 (02) : 281 - 309
  • [10] A MULTI-RESPONSE GAUSS-NEWTON ALGORITHM
    BATES, DM
    WATTS, DG
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 1984, 13 (05) : 705 - 715