Nonnegative Matrix Factorization with Rank Regularization and Hard Constraint

被引:0
|
作者
Shang, Ronghua [1 ]
Liu, Chiyang [1 ]
Meng, Yang [1 ]
Jiao, Licheng [1 ]
Stolkin, Rustam [2 ]
机构
[1] Xidian Univ, Key Lab Intelligent Percept & Image Understanding, Minist Educ, Xian 710071, Shaanxi, Peoples R China
[2] Univ Birmingham, Extreme Robot Lab, Birmingham B15 2TT, W Midlands, England
基金
中国国家自然科学基金;
关键词
DIMENSIONALITY REDUCTION; LAPLACIAN EIGENMAPS; ALGORITHMS; SELECTION;
D O I
10.1162/neco_a_00995
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nonnegative matrix factorization (NMF) is well known to be an effective tool for dimensionality reduction in problems involving big data. For this reason, it frequently appears in many areas of scientific and engineering literature. This letter proposes a novel semisupervised NMF algorithm for overcoming a variety of problems associated with NMF algorithms, including poor use of prior information, negative impact on manifold structure of the sparse constraint, and inaccurate graph construction. Our proposed algorithm, nonnegative matrix factorization with rank regularization and hard constraint (NMFRC), incorporates label information into data representation as a hard constraint, which makes full use of prior information. NMFRC also measures pairwise similarity according to geodesic distance rather than Euclidean distance. This results in more accurate measurement of pairwise relationships, resulting in more effective manifold information. Furthermore, NMFRC adopts rank constraint instead of norm constraints for regularization to balance the sparseness and smoothness of data. In this way, the new data representation is more representative and has better interpretability. Experiments on real data sets suggest that NMFRC outperforms four other state-of-the-art algorithms in terms of clustering accuracy.
引用
收藏
页码:2553 / 2579
页数:27
相关论文
共 50 条
  • [1] Nonnegative rank factorization of a nonnegative matrix A with A† A≥0
    Jain, SK
    Tynan, J
    [J]. LINEAR & MULTILINEAR ALGEBRA, 2003, 51 (01): : 83 - 95
  • [2] THE NONNEGATIVE MATRIX FACTORIZATION: REGULARIZATION AND COMPLEXITY
    Ito, K.
    Landi, A. K.
    [J]. SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2016, 38 (02): : B327 - B346
  • [3] NONNEGATIVE MATRIX FACTORIZATION WITH BAND CONSTRAINT
    Zhu, Xiangxiang
    Li, Jicheng
    Zhang, Zhuosheng
    [J]. JOURNAL OF COMPUTATIONAL MATHEMATICS, 2018, 36 (06) : 761 - 775
  • [4] Robust nonnegative matrix factorization with structure regularization
    Huang, Qi
    Yin, Xuesong
    Chen, Songcan
    Wang, Yigang
    Chen, Bowen
    [J]. NEUROCOMPUTING, 2020, 412 : 72 - 90
  • [5] Convex nonnegative matrix factorization with manifold regularization
    Hu, Wenjun
    Choi, Kup-Sze
    Wang, Peiliang
    Jiang, Yunliang
    Wang, Shitong
    [J]. NEURAL NETWORKS, 2015, 63 : 94 - 103
  • [6] Parallel Nonnegative Matrix Factorization with Manifold Regularization
    Liu, Fudong
    Shan, Zheng
    Chen, Yihang
    [J]. JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING, 2018, 2018
  • [7] On reduced rank nonnegative matrix factorization for symmetric nonnegative matrices
    Catral, M
    Han, LX
    Neumann, M
    Plemmons, RJ
    [J]. LINEAR ALGEBRA AND ITS APPLICATIONS, 2004, 393 : 107 - 126
  • [8] Virtual Label Constraint Nonnegative Matrix Factorization
    Pei, Xiaobing
    Chen, Changqing
    Gong, Weihua
    [J]. 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), 2015, : 959 - 963
  • [9] Virtual Label Constraint Nonnegative Matrix Factorization
    Pei, Xiaobing
    Chen, Changqing
    Gong, Weihua
    [J]. 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), 2015, : 460 - 464
  • [10] Deep and wide nonnegative matrix factorization with embedded regularization
    Moayed, Hojjat
    Mansoori, Eghbal G.
    [J]. PATTERN RECOGNITION, 2024, 153