Dual semi-supervised convex nonnegative matrix factorization for data representation

被引:20
|
作者
Peng, Siyuan [1 ]
Yang, Zhijing [1 ]
Ling, Bingo Wing-Kuen [1 ]
Chen, Badong [2 ]
Lin, Zhiping [3 ]
机构
[1] Guangdong Univ Technol, Sch Informat Engn, Guangzhou 510006, Peoples R China
[2] Xi An Jiao Tong Univ, Inst Artificial Intelligence & Robot, Xian 710049, Peoples R China
[3] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
关键词
Semi-supervised learning; Convex nonnegative matrix factorization; data representation; clustering; REGULARIZED CONCEPT FACTORIZATION; ALGORITHMS;
D O I
10.1016/j.ins.2021.11.045
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Semi-supervised nonnegative matrix factorization (NMF) has received considerable attention in machine learning and data mining. A new semi-supervised NMF method, called dual semi-supervised convex nonnegative matrix factorization (DCNMF), is proposed in this paper for fully using the limited label information. Specifically, DCNMF simultaneously incorporates the pointwise and pairwise constraints of labeled samples as dual supervisory information into convex NMF, which results in a better low-dimensional data representation. Moreover, DCNMF imposes the nonnegative constraint only on the coefficient matrix but not on the base matrix. Consequently, DCNMF can process mixed-sign data, and hence enlarge the range of applications. We derive an efficient alternating iterative algorithm for DCNMF to solve the optimization, and analyze the proposed DCNMF method in terms of the convergence and computational complexity. We also discuss the relationships between DCNMF and several typical NMF based methods. Experimental results illustrate that DCNMF outperforms the related state-of-the-art NMF methods on nonnegative and mixed-sign datasets for clustering applications.(c) 2021 Elsevier Inc. All rights reserved.
引用
收藏
页码:571 / 593
页数:23
相关论文
共 50 条
  • [1] Semi-Supervised Nonnegative Matrix Factorization
    Lee, Hyekyoung
    Yoo, Jiho
    Choi, Seungjin
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2010, 17 (01) : 4 - 7
  • [2] Continuous Semi-Supervised Nonnegative Matrix Factorization
    Lindstrom, Michael R. R.
    Ding, Xiaofu
    Liu, Feng
    Somayajula, Anand
    Needell, Deanna
    [J]. ALGORITHMS, 2023, 16 (04)
  • [3] Robust Semi-supervised Nonnegative Matrix Factorization
    Wang, Jing
    Tian, Feng
    Liu, Chang Hong
    Wang, Xiao
    [J]. 2015 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2015,
  • [4] Robust semi-supervised data representation and imputation by correntropy based constraint nonnegative matrix factorization
    Zhou, Nan
    Du, Yuanhua
    Liu, Jun
    Huang, Xiuyu
    Shen, Xiao
    Choi, Kup-Sze
    [J]. APPLIED INTELLIGENCE, 2023, 53 (10) : 11599 - 11617
  • [5] Robust semi-supervised data representation and imputation by correntropy based constraint nonnegative matrix factorization
    Nan Zhou
    Yuanhua Du
    Jun Liu
    Xiuyu Huang
    Xiao Shen
    Kup-Sze Choi
    [J]. Applied Intelligence, 2023, 53 : 11599 - 11617
  • [6] Semi-supervised Nonnegative Matrix Factorization with Commonness Extraction
    Teng, Yueyang
    Qi, Shouliang
    Dai, Yin
    Xu, Lisheng
    Qian, Wei
    Kang, Yan
    [J]. NEURAL PROCESSING LETTERS, 2017, 45 (03) : 1063 - 1076
  • [7] A nonnegative matrix factorization framework for semi-supervised document clustering with dual constraints
    Huifang Ma
    Weizhong Zhao
    Zhongzhi Shi
    [J]. Knowledge and Information Systems, 2013, 36 : 629 - 651
  • [8] Semi-supervised Nonnegative Matrix Factorization with Commonness Extraction
    Yueyang Teng
    Shouliang Qi
    Yin Dai
    Lisheng Xu
    Wei Qian
    Yan Kang
    [J]. Neural Processing Letters, 2017, 45 : 1063 - 1076
  • [9] A nonnegative matrix factorization framework for semi-supervised document clustering with dual constraints
    Ma, Huifang
    Zhao, Weizhong
    Shi, Zhongzhi
    [J]. KNOWLEDGE AND INFORMATION SYSTEMS, 2013, 36 (03) : 629 - 651
  • [10] Semi-supervised convex nonnegative matrix factorizations with graph regularized for image representation
    Li, Guopeng
    Zhang, Xinyu
    Zheng, Siyi
    Li, Deyi
    [J]. NEUROCOMPUTING, 2017, 237 : 1 - 11