CASNMF: A Converged Algorithm for symmetrical nonnegative matrix factorization

被引:13
|
作者
Tian, Li-Ping [1 ]
Luo, Ping [2 ]
Wang, Haiying [3 ]
Zheng, Huiru [3 ]
Wu, Fang-Xiang [4 ,5 ,6 ]
机构
[1] Beijing Wuzi Univ, Sch Informat, Beijing 101149, Peoples R China
[2] Univ Saskatchewan, Div Biomed Engn, Saskatoon, SK S7N 5A9, Canada
[3] Univ Ulster, Sch Comp & Math, Jordanstown Campus, Newtownabbey BT37 0QB, North Ireland
[4] Nankai Univ, Sch Math Sci, Tianjin 300071, Peoples R China
[5] Univ Saskatchewan, Dept Mech Engn, Saskatoon, SK S7N 5A9, Canada
[6] Univ Saskatchewan, Div Biomed Engn, Saskatoon, SK S7N 5A9, Canada
基金
加拿大自然科学与工程研究理事会; 中国国家自然科学基金;
关键词
Symmetrical nonnegative matrix factorization (SNMF); Convergence; Initialization; Karush-Kuhn-Tucher (KKT) optimality condition; Stationary point; Local auxiliary function; IDENTIFYING PROTEIN COMPLEXES; LEAST-SQUARES; NETWORKS;
D O I
10.1016/j.neucom.2017.10.039
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nonnegative matrix factorization (NMF) is a very popular unsupervised or semi-supervised learning method useful in various applications including data clustering, image processing, and semantic analysis of documents. This study focuses on Symmetric NMF (SNMF), which is a special case of NMF and can be useful in network analysis. Although there exist several algorithms for SNMF in literature, their convergence and initialization have not been well addressed. In this paper, we first discuss the convergence and initialization of existing algorithms for SNMF. We then propose a Converged Algorithm for SNMF (called CASNMF) which minimizes the Euclidean distance between a symmetrical matrix and its approximation of SNMF. Based on the optimization principle and the local auxiliary function method, we prove that our presented CASNMF does not only converge to a stationary point, but also could be applied to the wider range of SNMF problems. In addition, CASNMF does not require that the initial values are nonzero. To verify our theoretical results, experiments on three data sets are conducted by comparing our proposed CASNMF with other existing methods. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:2031 / 2040
页数:10
相关论文
共 50 条
  • [1] A Topographical Nonnegative Matrix Factorization algorithm
    Rogovschi, Nicoleta
    Labiod, Lazhar
    Nadif, Mohamed
    [J]. 2013 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2013,
  • [2] A convergent algorithm for orthogonal nonnegative matrix factorization
    Mirzal, Andri
    [J]. JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2014, 260 : 149 - 166
  • [3] A HYBRID ITERATIVE ALGORITHM FOR NONNEGATIVE MATRIX FACTORIZATION
    Soltuz, Stefan M.
    Wang, Wenwu
    Jackson, Philip J. B.
    [J]. 2009 IEEE/SP 15TH WORKSHOP ON STATISTICAL SIGNAL PROCESSING, VOLS 1 AND 2, 2009, : 409 - 412
  • [4] Slope One algorithm based on nonnegative matrix factorization
    Dong, Li-Yan
    Jin, Jia-Huan
    Fang, Yuan-Cheng
    Wang, Yue-Qun
    Li, Yong-Li
    Sun, Ming-Hui
    [J]. Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2019, 53 (07): : 1349 - 1353
  • [5] Distributed Nonnegative Matrix Factorization with HALS Algorithm on MapReduce
    Zdunek, Rafal
    Fonal, Krzysztof
    [J]. ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2017, 2017, 10393 : 211 - 222
  • [6] A Fast Algorithm for Nonnegative Matrix Factorization and Its Convergence
    Li, Li-Xin
    Wu, Lin
    Zhang, Hui-Sheng
    Wu, Fang-Xiang
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2014, 25 (10) : 1855 - 1863
  • [7] HYPERSPECTRAL UNMIXING ALGORITHM BASED ON NONNEGATIVE MATRIX FACTORIZATION
    Bao, Wenxing
    Li, Qin
    Xin, Liping
    Qu, Kewen
    [J]. 2016 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2016, : 6982 - 6985
  • [8] An alternating projected gradient algorithm for nonnegative matrix factorization
    Lin, Lu
    Liu, Zhong-Yun
    [J]. APPLIED MATHEMATICS AND COMPUTATION, 2011, 217 (24) : 9997 - 10002
  • [9] Jacobi Algorithm For Nonnegative Matrix Factorization With Transform Learning
    Wendt, Herwig
    Fagot, Dylan
    Fevotte, Cedric
    [J]. 2018 26TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2018, : 1062 - 1066
  • [10] Efficient algorithm for sparse symmetric nonnegative matrix factorization
    Belachew, Melisew Tefera
    [J]. PATTERN RECOGNITION LETTERS, 2019, 125 : 735 - 741