Nonnegative matrix factorization with quadratic programming

被引:17
|
作者
Zdunek, Rafal [1 ,2 ]
Cichocki, Andrzej [1 ,3 ]
机构
[1] RIKEN, Brain Sci Inst, Lab Adv Brain Signal Proc, Wako, Saitama 3510198, Japan
[2] Wroclaw Univ Technol, Inst Telecommun Teleinformat & Acoust, PL-50370 Wroclaw, Poland
[3] Polish Acad Sci, IBS PAN, PL-00901 Warsaw, Poland
关键词
nonnegative matrix factorization; blind source separation; quadratic programming;
D O I
10.1016/j.neucom.2007.01.013
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nonnegative matrix factorization (NMF) solves the following problem: find such nonnegative matrices A is an element of R-+(IxJ) and X is an element of R-+(JxK) that Y congruent to AX, given only Y is an element of R-IxK and the assigned index J (K >> 1 >= J). Basically, the factorization is achieved by alternating minimization of a given cost function subject to nonnegativity constraints. In the paper, we propose to use quadratic programming (QP) to solve the minimization problems. The Tikhonov regularized squared Euclidean cost function is extended with a logarithmic barrier function (which satisfies nonnegativity constraints), and then using second-order Taylor expansion, a QP problem is formulated. This problem is solved with some trust-region subproblem algorithm. The numerical tests are performed on the blind source separation problems. (C) 2008 Elsevier B.V. All rights reserved.
引用
收藏
页码:2309 / 2320
页数:12
相关论文
共 50 条
  • [1] Quadratic nonnegative matrix factorization
    Yang, Zhirong
    Oja, Erkki
    [J]. PATTERN RECOGNITION, 2012, 45 (04) : 1500 - 1510
  • [2] DC Programming and DCA for Nonnegative Matrix Factorization
    Hoai An Le Thi
    Tao Pham Dinh
    Xuan Thanh Vo
    [J]. COMPUTATIONAL COLLECTIVE INTELLIGENCE: TECHNOLOGIES AND APPLICATIONS, ICCCI 2014, 2014, 8733 : 573 - 582
  • [3] Adaptive multiplicative updates for quadratic nonnegative matrix factorization
    Zhang, He
    Yang, Zhirong
    Oja, Erkki
    [J]. NEUROCOMPUTING, 2014, 134 : 206 - 213
  • [4] Efficient Nonnegative Matrix Factorization by DC Programming and DCA
    Hoai An Le Thi
    Xuan Thanh Vo
    Tao Pham Dinh
    [J]. NEURAL COMPUTATION, 2016, 28 (06) : 1163 - 1216
  • [5] Robust Nonnegative Matrix Factorization Via Half-Quadratic Minimization
    Du, Liang
    Li, Xuan
    Shen, Yi-Dong
    [J]. 12TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2012), 2012, : 201 - 210
  • [6] Quadratic regularization projected Barzilai–Borwein method for nonnegative matrix factorization
    Yakui Huang
    Hongwei Liu
    Shuisheng Zhou
    [J]. Data Mining and Knowledge Discovery, 2015, 29 : 1665 - 1684
  • [7] Unified Development of Multiplicative Algorithms for Linear and Quadratic Nonnegative Matrix Factorization
    Yang, Zhirong
    Oja, Erkki
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2011, 22 (12): : 1878 - 1891
  • [8] Nonnegative Matrix Factorization
    不详
    [J]. IEEE CONTROL SYSTEMS MAGAZINE, 2021, 41 (03): : 102 - 102
  • [9] Sequential quadratic programming algorithm utilizing or matrix factorization
    Kao, Chiang
    Chen, Shih Pen
    [J]. Engineering Optimization, 1994, 22 (04)
  • [10] Nonnegative Matrix Factorization
    SAIBABA, A. R. V. I. N. D. K.
    [J]. SIAM REVIEW, 2022, 64 (02) : 510 - 511