DAMPED GAUSS-NEWTON ALGORITHM FOR NONNEGATIVE TUCKER DECOMPOSITION

被引:0
|
作者
Anh Huy Phan [1 ,2 ]
Tichavsky, Petr [2 ]
Cichocki, Andrzej [1 ,2 ]
机构
[1] RIKEN, Brain Sci Inst, Wako, Japan
[2] Inst Informat Theory & Automat, Prague, Czech Republic
关键词
nonnegative Tucker decomposition; Gauss-Newton; Levenberg-Marquardt; low rank approximation; face clustering;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Algorithms based on alternating optimization for nonnegative Tucker decompositions (NTD) such as ALS, multiplicative least squares, HALS have been confirmed effective and efficient. However, those algorithms often converge very slowly. To this end, we propose a novel algorithm for NTD using the Levenberg-Marquardt technique with fast computation method to construct the approximate Hessian and gradient without building up the large-scale Jacobian. The proposed algorithm has been verified to overwhelmingly outperform "state-of-the-art" NTD algorithms for difficult benchmarks, and application of face clustering.
引用
收藏
页码:665 / 668
页数:4
相关论文
共 50 条
  • [21] Gauss-Newton and Inverse Gauss-Newton Methods for Coefficient Identification in Linear Elastic Systems
    David L. Russell
    Acta Applicandae Mathematicae, 2012, 118 : 221 - 235
  • [22] A Damped Gauss-Newton Method for the Second-Order Cone Complementarity Problem
    Pan, Shaohua
    Chen, Jein-Shan
    APPLIED MATHEMATICS AND OPTIMIZATION, 2009, 59 (03): : 293 - 318
  • [23] Gauss-Newton and Inverse Gauss-Newton Methods for Coefficient Identification in Linear Elastic Systems
    Russell, David L.
    ACTA APPLICANDAE MATHEMATICAE, 2012, 118 (01) : 221 - 235
  • [24] Damped Gauss-Newton type methods for ill-posed optimization problems
    Parts, Inga
    Vaarmann, Otu
    INTERNATIONAL CONFERENCE ON OPERATIONAL RESEARCH: SIMULATION AND OPTIMISATION IN BUSINESS AND INDUSTRY, 2006, : 119 - 123
  • [25] A Damped Gauss-Newton Method for the Second-Order Cone Complementarity Problem
    Shaohua Pan
    Jein-Shan Chen
    Applied Mathematics and Optimization, 2009, 59
  • [26] Gauss-Newton particle filter
    Cao, Hui
    Ohnishi, Noboru
    Takeuchi, Yoshinori
    Matsumoto, Tetsuya
    Kudo, Hiroaki
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2007, E90A (06) : 1235 - 1239
  • [27] Separable least squares, variable projection, and the Gauss-Newton algorithm
    Osborne, M.R.
    Electronic Transactions on Numerical Analysis, 2007, 28 : 1 - 15
  • [28] Nonnegative tucker decomposition
    Kim, Yong-Deok
    Choi, Seungjin
    2007 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-8, 2007, : 3104 - +
  • [29] An extension of the Gauss-Newton algorithm for estimation under asymmetric loss
    Demetrescu, M
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2006, 50 (02) : 379 - 401
  • [30] A Fast Gauss-Newton Algorithm for Islanding Detection in Distributed Generation
    Padhee, Malhar
    Dash, P. K.
    Krishnanand, K. R.
    Rout, P. K.
    IEEE TRANSACTIONS ON SMART GRID, 2012, 3 (03) : 1181 - 1191