Nonnegative Matrix Factorization with Rank Regularization and Hard Constraint

被引:0
|
作者
Shang, Ronghua [1 ]
Liu, Chiyang [1 ]
Meng, Yang [1 ]
Jiao, Licheng [1 ]
Stolkin, Rustam [2 ]
机构
[1] Xidian Univ, Key Lab Intelligent Percept & Image Understanding, Minist Educ, Xian 710071, Shaanxi, Peoples R China
[2] Univ Birmingham, Extreme Robot Lab, Birmingham B15 2TT, W Midlands, England
基金
中国国家自然科学基金;
关键词
DIMENSIONALITY REDUCTION; LAPLACIAN EIGENMAPS; ALGORITHMS; SELECTION;
D O I
10.1162/neco_a_00995
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nonnegative matrix factorization (NMF) is well known to be an effective tool for dimensionality reduction in problems involving big data. For this reason, it frequently appears in many areas of scientific and engineering literature. This letter proposes a novel semisupervised NMF algorithm for overcoming a variety of problems associated with NMF algorithms, including poor use of prior information, negative impact on manifold structure of the sparse constraint, and inaccurate graph construction. Our proposed algorithm, nonnegative matrix factorization with rank regularization and hard constraint (NMFRC), incorporates label information into data representation as a hard constraint, which makes full use of prior information. NMFRC also measures pairwise similarity according to geodesic distance rather than Euclidean distance. This results in more accurate measurement of pairwise relationships, resulting in more effective manifold information. Furthermore, NMFRC adopts rank constraint instead of norm constraints for regularization to balance the sparseness and smoothness of data. In this way, the new data representation is more representative and has better interpretability. Experiments on real data sets suggest that NMFRC outperforms four other state-of-the-art algorithms in terms of clustering accuracy.
引用
收藏
页码:2553 / 2579
页数:27
相关论文
共 50 条
  • [21] Low-rank nonnegative matrix factorization on Stiefel manifold
    He, Ping
    Xu, Xiaohua
    Ding, Jie
    Fan, Baichuan
    [J]. INFORMATION SCIENCES, 2020, 514 : 131 - 148
  • [22] Incremental Nonnegative Matrix Factorization with Sparseness Constraint for Image Representation
    Sun, Jing
    Wang, Zhihui
    Li, Haojie
    Sun, Fuming
    [J]. ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2018, PT II, 2018, 11165 : 351 - 360
  • [23] Nonnegative Matrix Factorization with Piecewise Smoothness Constraint for Hyperspectral Unmixing
    Jia, Sen
    Qian, Yun-Ta
    Ji, Zhen
    [J]. PROCEEDINGS OF 2008 INTERNATIONAL CONFERENCE ON WAVELET ANALYSIS AND PATTERN RECOGNITION, VOLS 1 AND 2, 2008, : 815 - +
  • [24] Rank-constrained nonnegative matrix factorization for data representation
    Shu, Zhenqiu
    Wu, Xiao-Jun
    You, Congzhe
    Liu, Zhen
    Li, Peng
    Fan, Honghui
    Ye, Feiyue
    [J]. INFORMATION SCIENCES, 2020, 528 : 133 - 146
  • [25] The Nonnegative Rank of a Matrix: Hard Problems, Easy Solutions
    Shitov, Yaroslav
    [J]. SIAM REVIEW, 2017, 59 (04) : 794 - 800
  • [26] Community Detection using Nonnegative Matrix Factorization with Orthogonal Constraint
    Qin, Yaoyao
    Jia, Caiyan
    Li, Yafang
    [J]. 2016 EIGHTH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE (ICACI), 2016, : 49 - 54
  • [27] Sparsity induced convex nonnegative matrix factorization algorithm with manifold regularization
    Qiu, Feiyue
    Chen, Bowen
    Chen, Tieming
    Zhang, Guodao
    [J]. Tongxin Xuebao/Journal on Communications, 2020, 41 (05): : 84 - 95
  • [28] Nonnegative Matrix Factorization With Basis Clustering Using Cepstral Distance Regularization
    Kameoka, Hirokazu
    Higuchi, Takuya
    Tanaka, Mikihiro
    Li, Li
    [J]. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2018, 26 (06) : 1025 - 1036
  • [29] Speech Enhancement Using Convolutive Nonnegative Matrix Factorization with Cosparsity Regularization
    Mirbagheri, Majid
    Xu, Yanbo
    Akram, Sahar
    Shamma, Shihab
    [J]. 14TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2013), VOLS 1-5, 2013, : 456 - 459
  • [30] RANK FACTORIZATION OF NONNEGATIVE MATRICES
    THOMAS, LB
    [J]. SIAM REVIEW, 1974, 16 (03) : 393 - 394