DAMPED GAUSS-NEWTON ALGORITHM FOR NONNEGATIVE TUCKER DECOMPOSITION

被引:0
|
作者
Anh Huy Phan [1 ,2 ]
Tichavsky, Petr [2 ]
Cichocki, Andrzej [1 ,2 ]
机构
[1] RIKEN, Brain Sci Inst, Wako, Japan
[2] Inst Informat Theory & Automat, Prague, Czech Republic
关键词
nonnegative Tucker decomposition; Gauss-Newton; Levenberg-Marquardt; low rank approximation; face clustering;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Algorithms based on alternating optimization for nonnegative Tucker decompositions (NTD) such as ALS, multiplicative least squares, HALS have been confirmed effective and efficient. However, those algorithms often converge very slowly. To this end, we propose a novel algorithm for NTD using the Levenberg-Marquardt technique with fast computation method to construct the approximate Hessian and gradient without building up the large-scale Jacobian. The proposed algorithm has been verified to overwhelmingly outperform "state-of-the-art" NTD algorithms for difficult benchmarks, and application of face clustering.
引用
收藏
页码:665 / 668
页数:4
相关论文
共 50 条
  • [31] Convergence and application of a modified iteratively regularized Gauss-Newton algorithm
    Smirnova, Alexandra
    Renaut, Rosemary A.
    Khan, Taufiquar
    INVERSE PROBLEMS, 2007, 23 (04) : 1547 - 1563
  • [32] Convergence and Applications of a Gossip-Based Gauss-Newton Algorithm
    Li, Xiao
    Scaglione, Anna
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2013, 61 (21) : 5231 - 5246
  • [33] SEPARABLE LEAST SQUARES, VARIABLE PROJECTION, AND THE GAUSS-NEWTON ALGORITHM
    Osborne, M. R.
    ELECTRONIC TRANSACTIONS ON NUMERICAL ANALYSIS, 2007, 28 : 1 - 15
  • [34] Electrical Impedance Tomography Imaging Using Gauss-Newton Algorithm
    Islam, Md Rabiul
    Kiber, Md Adnan
    2014 INTERNATIONAL CONFERENCE ON INFORMATICS, ELECTRONICS & VISION (ICIEV), 2014,
  • [35] A globally convergent damped Gauss-Newton method for solving the extended linear complementarity problem
    Huang, Na
    Ma, Changfeng
    JOURNAL OF NUMERICAL MATHEMATICS, 2015, 23 (03) : 247 - 256
  • [36] Hybrid Newton Gauss-Newton algorithm for time-domain analysis of A/D converters
    Haddadi, D
    Dallet, D
    Marchegay, P
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-ANALOG AND DIGITAL SIGNAL PROCESSING, 2000, 47 (07): : 655 - 659
  • [37] Modeling temperature drift of FOG by improved BP algorithm and by Gauss-Newton algorithm
    Chen, XY
    ADVANCES IN NEURAL NETWORKS - ISNN 2004, PT 2, 2004, 3174 : 805 - 812
  • [38] Performance enhancement of Gauss-Newton trust-region solver for distributed Gauss-Newton optimization method
    Guohua Gao
    Hao Jiang
    Jeroen C. Vink
    Paul P. H. van Hagen
    Terence J. Wells
    Computational Geosciences, 2020, 24 : 837 - 852
  • [39] Performance enhancement of Gauss-Newton trust-region solver for distributed Gauss-Newton optimization method
    Gao, Guohua
    Jiang, Hao
    Vink, Jeroen C.
    van Hagen, Paul P. H.
    Wells, Terence J.
    COMPUTATIONAL GEOSCIENCES, 2020, 24 (02) : 837 - 852
  • [40] A multiplicative Gauss-Newton minimization algorithm:Theory and application to exponential functions
    Anmol Gupta
    Sanjay Kumar
    Applied Mathematics:A Journal of Chinese Universities, 2021, 36 (03) : 370 - 389