A NONCONVEX SPLITTING METHOD FOR SYMMETRIC NONNEGATIVE MATRIX FACTORIZATION: CONVERGENCE ANALYSIS AND OPTIMALITY

被引:0
|
作者
Lu, Songtao [1 ]
Hong, Mingyi [2 ]
Wang, Zhengdao [1 ]
机构
[1] Iowa State Univ, Dept Elect & Comp Engn, Ames, IA 50011 USA
[2] Iowa State Univ, Ind & Mfg Syst Engn, Ames, IA 50011 USA
关键词
Symmetric Nonnegative Matrix Factorization; Karush-Kuhn-Tucker points; variable splitting; global and local optimality; clustering; ALGORITHM;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Symmetric non-negative matrix factorization (SymNMF) has important applications in data analytics problems such as document clustering, community detection and image segmentation. In this paper, we propose a novel nonconvex variable splitting method for solving SymNMF. Different from the existing works, we prove that the algorithm converges to the set of Karush-Kuhn-Tucker (KKT) points of the nonconvex SymNMF problem with a global sublinear convergence rate. We also show that the algorithm can be efficiently implemented in a distributed manner. Further, we provide sufficient conditions that guarantee the global and local optimality of the obtained solutions. Extensive numerical results performed on both synthetic and real data sets suggest that the proposed algorithm yields high quality of the solutions and converges quickly to the set of local minimum solutions compared with other algorithms.
引用
收藏
页码:2572 / 2576
页数:5
相关论文
共 50 条
  • [1] A Nonconvex Splitting Method for Symmetric Nonnegative Matrix Factorization: Convergence Analysis and Optimality
    Lu, Songtao
    Hong, Mingyi
    Wang, Zhengdao
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2017, 65 (12) : 3120 - 3135
  • [2] A Stochastic Nonconvex Splitting Method for Symmetric Nonnegative Matrix Factorization
    Lu, Songtao
    Hong, Mingyi
    Wang, Zhengdao
    [J]. ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 54, 2017, 54 : 812 - 821
  • [3] A Provable Splitting Approach for Symmetric Nonnegative Matrix Factorization
    Li, Xiao
    Zhu, Zhihui
    Li, Qiuwei
    Liu, Kai
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (03) : 2206 - 2219
  • [4] A novel initialization method for symmetric nonnegative matrix factorization
    Wu, Jian-Qiang
    Huang, Hao-Xia
    [J]. PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON COMMUNICATION AND ELECTRONIC INFORMATION ENGINEERING (CEIE 2016), 2016, 116 : 152 - 157
  • [5] Symmetric Nonnegative Matrix Factorization-Based Community Detection Models and Their Convergence Analysis
    Luo, Xin
    Liu, Zhigang
    Jin, Long
    Zhou, Yue
    Zhou, MengChu
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (03) : 1203 - 1215
  • [6] NONNEGATIVE MATRIX FACTORIZATION USING ADMM: ALGORITHM AND CONVERGENCE ANALYSIS
    Hajinezhad, Davood
    Chang, Tsung-Hui
    Wang, Xiangfeng
    Shi, Qingpang
    Hong, Mingyi
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 4742 - 4746
  • [7] On reduced rank nonnegative matrix factorization for symmetric nonnegative matrices
    Catral, M
    Han, LX
    Neumann, M
    Plemmons, RJ
    [J]. LINEAR ALGEBRA AND ITS APPLICATIONS, 2004, 393 : 107 - 126
  • [8] Symmetric nonnegative matrix factorization: A systematic review
    Chen, Wen-Sheng
    Xie, Kexin
    Liu, Rui
    Pan, Binbin
    [J]. NEUROCOMPUTING, 2023, 557
  • [9] Nonconvex Nonseparable Sparse Nonnegative Matrix Factorization for Hyperspectral Unmixing
    Xiong, Fengchao
    Zhou, Jun
    Lu, Jianfeng
    Qian, Yuntao
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 : 6088 - 6100
  • [10] A UNIFIED CONVERGENCE ANALYSIS OF THE MULTIPLICATIVE UPDATE ALGORITHM FOR NONNEGATIVE MATRIX FACTORIZATION
    Zhao, Renbo
    Tan, Vincent Y. F.
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 2562 - 2566