An alternating projected gradient algorithm for nonnegative matrix factorization

被引:15
|
作者
Lin, Lu [1 ]
Liu, Zhong-Yun [2 ]
机构
[1] Xiamen Univ, Sch Math Sci, Xiamen 361005, Peoples R China
[2] Changsha Univ Sci & Technol, Sch Math, Changsha 410076, Hunan, Peoples R China
基金
中国国家自然科学基金;
关键词
Nonnegative matrix factorization; Projected gradient algorithm; Multiplicative updating method; Low-rank decomposition; HERMITIAN SPLITTING METHODS; DEFINITE LINEAR-SYSTEMS;
D O I
10.1016/j.amc.2011.04.070
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Due to the extensive applications of nonnegative matrix factorizations (NMFs) of nonnegative matrices, such as in image processing, text mining, spectral data analysis, speech processing, etc., algorithms for NMF have been studied for years. In this paper, we propose a new algorithm for NMF, which is based on an alternating projected gradient (APG) approach. In particular, no zero entries appear in denominators in our algorithm which implies no breakdown occurs, and even if some zero entries appear in numerators new updates can always be improved in our algorithm. It is shown that the effect of our algorithm is better than that of Lee and Seung's algorithm when we do numerical experiments on two known facial databases and one iris database. (C) 2011 Elsevier Inc. All rights reserved.
引用
收藏
页码:9997 / 10002
页数:6
相关论文
共 50 条
  • [1] Projected gradient methods for nonnegative matrix factorization
    Lin, Chih-Jen
    [J]. NEURAL COMPUTATION, 2007, 19 (10) : 2756 - 2779
  • [2] Nonnegative matrix factorization based on projected hybrid conjugate gradient algorithm
    Mohamed Abd El Aziz
    Wael Khidr
    [J]. Signal, Image and Video Processing, 2015, 9 : 1825 - 1831
  • [3] Nonnegative matrix factorization based on projected hybrid conjugate gradient algorithm
    Abd El Aziz, Mohamed
    Khidr, Wael
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2015, 9 (08) : 1825 - 1831
  • [4] Multilayer nonnegative matrix factorization using projected gradient approaches
    Cichocki, Andrzej
    Zdunek, Rafal
    [J]. INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2007, 17 (06) : 431 - 446
  • [5] ALTERNATING PROJECTED BARZILAI-BORWEIN METHODS FOR NONNEGATIVE MATRIX FACTORIZATION
    Han, Lixing
    Neumann, Michael
    Prasad, Upendra
    [J]. ELECTRONIC TRANSACTIONS ON NUMERICAL ANALYSIS, 2009, 36 : 54 - 82
  • [6] Image Classification with Nonnegative Matrix Factorization Based on Spectral Projected Gradient
    Zdunek, Rafal
    Anh Huy Phan
    Cichocki, Andrzej
    [J]. ARTIFICIAL NEURAL NETWORKS, 2015, : 31 - 50
  • [7] Projected gradient method for kernel discriminant nonnegative matrix factorization and the applications
    Liang, Zhizheng
    Li, Youfu
    Zhao, Tuo
    [J]. SIGNAL PROCESSING, 2010, 90 (07) : 2150 - 2163
  • [8] Nonnegative Matrix Factorization Using Projected Gradient Algorithms with Sparseness Constraints
    Mohammadiha, Nasser
    Leijon, Arne
    [J]. 2009 IEEE INTERNATIONAL SYMPOSIUM ON SIGNAL PROCESSING AND INFORMATION TECHNOLOGY (ISSPIT 2009), 2009, : 418 - 423
  • [9] An alternating nonmonotone projected Barzilai–Borwein algorithm of nonnegative factorization of big matrices
    Ting Li
    Jiayi Tang
    Zhong Wan
    [J]. Data Mining and Knowledge Discovery, 2021, 35 : 1972 - 2008
  • [10] An alternating nonmonotone projected Barzilai-Borwein algorithm of nonnegative factorization of big matrices
    Li, Ting
    Tang, Jiayi
    Wan, Zhong
    [J]. DATA MINING AND KNOWLEDGE DISCOVERY, 2021, 35 (05) : 1972 - 2008