CASNMF: A Converged Algorithm for symmetrical nonnegative matrix factorization

被引:13
|
作者
Tian, Li-Ping [1 ]
Luo, Ping [2 ]
Wang, Haiying [3 ]
Zheng, Huiru [3 ]
Wu, Fang-Xiang [4 ,5 ,6 ]
机构
[1] Beijing Wuzi Univ, Sch Informat, Beijing 101149, Peoples R China
[2] Univ Saskatchewan, Div Biomed Engn, Saskatoon, SK S7N 5A9, Canada
[3] Univ Ulster, Sch Comp & Math, Jordanstown Campus, Newtownabbey BT37 0QB, North Ireland
[4] Nankai Univ, Sch Math Sci, Tianjin 300071, Peoples R China
[5] Univ Saskatchewan, Dept Mech Engn, Saskatoon, SK S7N 5A9, Canada
[6] Univ Saskatchewan, Div Biomed Engn, Saskatoon, SK S7N 5A9, Canada
基金
加拿大自然科学与工程研究理事会; 中国国家自然科学基金;
关键词
Symmetrical nonnegative matrix factorization (SNMF); Convergence; Initialization; Karush-Kuhn-Tucher (KKT) optimality condition; Stationary point; Local auxiliary function; IDENTIFYING PROTEIN COMPLEXES; LEAST-SQUARES; NETWORKS;
D O I
10.1016/j.neucom.2017.10.039
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nonnegative matrix factorization (NMF) is a very popular unsupervised or semi-supervised learning method useful in various applications including data clustering, image processing, and semantic analysis of documents. This study focuses on Symmetric NMF (SNMF), which is a special case of NMF and can be useful in network analysis. Although there exist several algorithms for SNMF in literature, their convergence and initialization have not been well addressed. In this paper, we first discuss the convergence and initialization of existing algorithms for SNMF. We then propose a Converged Algorithm for SNMF (called CASNMF) which minimizes the Euclidean distance between a symmetrical matrix and its approximation of SNMF. Based on the optimization principle and the local auxiliary function method, we prove that our presented CASNMF does not only converge to a stationary point, but also could be applied to the wider range of SNMF problems. In addition, CASNMF does not require that the initial values are nonzero. To verify our theoretical results, experiments on three data sets are conducted by comparing our proposed CASNMF with other existing methods. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:2031 / 2040
页数:10
相关论文
共 50 条
  • [41] On Rationality of Nonnegative Matrix Factorization
    Chistikov, Dmitry
    Kiefer, Stefan
    Marusic, Ines
    Shirmohammadi, Mahsa
    Worrell, James
    [J]. PROCEEDINGS OF THE TWENTY-EIGHTH ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, 2017, : 1290 - 1305
  • [42] WEIGHTED NONNEGATIVE MATRIX FACTORIZATION
    Kim, Yang-Deok
    Choi, Seungjin
    [J]. 2009 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS 1- 8, PROCEEDINGS, 2009, : 1541 - 1544
  • [43] COSEPARABLE NONNEGATIVE MATRIX FACTORIZATION
    Pan, Junjun
    Ng, Michael K.
    [J]. SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2023, 44 (03) : 1393 - 1420
  • [44] ON A GUIDED NONNEGATIVE MATRIX FACTORIZATION
    Vendrow, Joshua
    Haddock, Jamie
    Rebrova, Elizaveta
    Needell, Deanna
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 3265 - 3269
  • [45] Nonnegative Matrix Factorization With Regularizations
    Ren, Weiya
    Li, Guohui
    Tu, Dan
    Jia, Li
    [J]. IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2014, 4 (01) : 153 - 164
  • [46] On Identifiability of Nonnegative Matrix Factorization
    Fu, Xiao
    Huang, Kejun
    Sidiropoulos, Nicholas D.
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2018, 25 (03) : 328 - 332
  • [47] Nonnegative Discriminant Matrix Factorization
    Lu, Yuwu
    Lai, Zhihui
    Xu, Yong
    Li, Xuelong
    Zhang, David
    Yuan, Chun
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2017, 27 (07) : 1392 - 1405
  • [48] Nonnegative matrix and tensor factorization
    Cichocki, Andrzej
    Zdunek, Rafal
    Amari, Shun-Ichi
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2008, 25 (01) : 142 - 145
  • [49] NONNEGATIVE UNIMODAL MATRIX FACTORIZATION
    Ang, Andersen Man Shun
    Gillis, Nicolas
    Vandaele, Arnaud
    De Sterck, Hans
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 3270 - 3274
  • [50] Simplicial Nonnegative Matrix Factorization
    Nguyen, Duy Khuong
    Than, Khoat
    Ho, Tu Bao
    [J]. PROCEEDINGS OF 2013 IEEE RIVF INTERNATIONAL CONFERENCE ON COMPUTING AND COMMUNICATION TECHNOLOGIES: RESEARCH, INNOVATION, AND VISION FOR THE FUTURE (RIVF), 2013, : 47 - 52