Nonnegative matrix factorization with local similarity learning

被引:38
|
作者
Peng, Chong [1 ]
Zhang, Zhilu [1 ]
Kang, Zhao [2 ]
Chen, Chenglizhao [1 ]
Cheng, Qiang [3 ,4 ]
机构
[1] Qingdao Univ, Coll Comp Sci & Technol, Qingdao, Peoples R China
[2] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu, Peoples R China
[3] Univ Kentucky, Dept Comp Sci, Lexington, KY 40506 USA
[4] Univ Kentucky, Inst Biomed Informat, Lexington, KY 40506 USA
关键词
Nonnegative matrix factorization; Clustering; Local similarity; OBJECTS; PARTS;
D O I
10.1016/j.ins.2021.01.087
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
High-dimensional data are ubiquitous in the learning community and it has become increasingly challenging to learn from such data [1]. For example, as one of the most important tasks in multimedia and data mining, information retrieval has drawn considerable attentions in recent years [2-4], where there is often a need to handle high-dimensional data. Often times, it is desirable and demanding to seek a data representation to reveal latent data structures of high-dimensional data, which is usually helpful for further data processing. It is thus a critical problem to find a suitable representation of the data in many learning tasks, such as image clustering and classification [5,1], foreground-background separation in surveillance video [6,7], matrix completion [8], community detection [9], link prediction [10], etc. To this end, a number of methods have been developed to seek proper representations of data, among which matrix factorization technique has been widely used to handle high-dimensional data. Matrix factorization seeks two or more low-dimensional matrices to approximate the original data such that the high-dimensional data can be represented with reduced dimensions [11,12]. For some types of data, such as images and documents, the entries are naturally nonnegative. For such data, nonnegative Existing nonnegative matrix factorization methods usually focus on learning global struc-ture of the data to construct basis and coefficient matrices, which ignores the local struc-ture that commonly exists among data. To overcome this drawback, in this paper, we propose a new type of nonnegative matrix factorization method, which learns local simi-larity and clustering in a mutually enhanced way. The learned new representation is more representative in that it better reveals inherent geometric property of the data. Moreover, the new representation is performed in the kernel space, which enhances the capability of the proposed model in discovering nonlinear structures of data. Multiplicative updating rules are developed with theoretical convergence guarantees. Extensive experimental results have confirmed the effectiveness of the proposed model. (c) 2021 Elsevier Inc. All rights reserved.
引用
收藏
页码:325 / 346
页数:22
相关论文
共 50 条
  • [1] Local Learning Regularized Nonnegative Matrix Factorization
    Gu, Quanquan
    Zhou, Jie
    [J]. 21ST INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI-09), PROCEEDINGS, 2009, : 1046 - 1051
  • [2] Global and local similarity learning in multi-kernel space for nonnegative matrix factorization
    Peng, Chong
    Hou, Xingrong
    Chen, Yongyong
    Kang, Zhao
    Chen, Chenglizhao
    Cheng, Qiang
    [J]. KNOWLEDGE-BASED SYSTEMS, 2023, 279
  • [3] Fast Local Learning Regularized Nonnegative Matrix Factorization
    Jiang, Jiaojiao
    Zhang, Haibin
    Xue, Yi
    [J]. ADVANCES IN COMPUTATIONAL ENVIRONMENT SCIENCE, 2012, 142 : 67 - 75
  • [4] Constrained nonnegative matrix factorization based on local learning
    Shu, Zhenqiu
    Zhao, Chunxia
    [J]. Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2015, 43 (07): : 82 - 86
  • [5] Learning latent features by nonnegative matrix factorization combining similarity judgments
    Zhang, Jiang-She
    Wang, Chang-Peng
    Yang, Yu-Qian
    [J]. NEUROCOMPUTING, 2015, 155 : 43 - 52
  • [6] Regularized nonnegative matrix factorization with adaptive local structure learning
    Huang, Shudong
    Xu, Zenglin
    Kang, Zhao
    Ren, Yazhou
    [J]. NEUROCOMPUTING, 2020, 382 : 196 - 209
  • [7] Similarity Learning-Induced Symmetric Nonnegative Matrix Factorization for Image Clustering
    Yan, Wei
    Zhang, Bob
    Yang, Zuyuan
    Xie, Shengli
    [J]. IEEE ACCESS, 2019, 7 : 166380 - 166389
  • [8] Adaptive local learning regularized nonnegative matrix factorization for data clustering
    Sheng, Yongpan
    Wang, Meng
    Wu, Tianxing
    Xu, Han
    [J]. APPLIED INTELLIGENCE, 2019, 49 (06) : 2151 - 2168
  • [9] Adaptive local learning regularized nonnegative matrix factorization for data clustering
    Yongpan Sheng
    Meng Wang
    Tianxing Wu
    Han Xu
    [J]. Applied Intelligence, 2019, 49 : 2151 - 2168
  • [10] NONNEGATIVE MATRIX FACTORIZATION WITH TRANSFORM LEARNING
    Fagot, Dylan
    Wendt, Herwig
    Fevotte, Cedric
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 2431 - 2435