Nonnegative matrix factorization with local similarity learning

被引:38
|
作者
Peng, Chong [1 ]
Zhang, Zhilu [1 ]
Kang, Zhao [2 ]
Chen, Chenglizhao [1 ]
Cheng, Qiang [3 ,4 ]
机构
[1] Qingdao Univ, Coll Comp Sci & Technol, Qingdao, Peoples R China
[2] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu, Peoples R China
[3] Univ Kentucky, Dept Comp Sci, Lexington, KY 40506 USA
[4] Univ Kentucky, Inst Biomed Informat, Lexington, KY 40506 USA
关键词
Nonnegative matrix factorization; Clustering; Local similarity; OBJECTS; PARTS;
D O I
10.1016/j.ins.2021.01.087
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
High-dimensional data are ubiquitous in the learning community and it has become increasingly challenging to learn from such data [1]. For example, as one of the most important tasks in multimedia and data mining, information retrieval has drawn considerable attentions in recent years [2-4], where there is often a need to handle high-dimensional data. Often times, it is desirable and demanding to seek a data representation to reveal latent data structures of high-dimensional data, which is usually helpful for further data processing. It is thus a critical problem to find a suitable representation of the data in many learning tasks, such as image clustering and classification [5,1], foreground-background separation in surveillance video [6,7], matrix completion [8], community detection [9], link prediction [10], etc. To this end, a number of methods have been developed to seek proper representations of data, among which matrix factorization technique has been widely used to handle high-dimensional data. Matrix factorization seeks two or more low-dimensional matrices to approximate the original data such that the high-dimensional data can be represented with reduced dimensions [11,12]. For some types of data, such as images and documents, the entries are naturally nonnegative. For such data, nonnegative Existing nonnegative matrix factorization methods usually focus on learning global struc-ture of the data to construct basis and coefficient matrices, which ignores the local struc-ture that commonly exists among data. To overcome this drawback, in this paper, we propose a new type of nonnegative matrix factorization method, which learns local simi-larity and clustering in a mutually enhanced way. The learned new representation is more representative in that it better reveals inherent geometric property of the data. Moreover, the new representation is performed in the kernel space, which enhances the capability of the proposed model in discovering nonlinear structures of data. Multiplicative updating rules are developed with theoretical convergence guarantees. Extensive experimental results have confirmed the effectiveness of the proposed model. (c) 2021 Elsevier Inc. All rights reserved.
引用
收藏
页码:325 / 346
页数:22
相关论文
共 50 条
  • [41] Nonnegative Matrix Factorization With Regularizations
    Ren, Weiya
    Li, Guohui
    Tu, Dan
    Jia, Li
    [J]. IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2014, 4 (01) : 153 - 164
  • [42] COSEPARABLE NONNEGATIVE MATRIX FACTORIZATION
    Pan, Junjun
    Ng, Michael K.
    [J]. SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2023, 44 (03) : 1393 - 1420
  • [43] Nonnegative matrix and tensor factorization
    Cichocki, Andrzej
    Zdunek, Rafal
    Amari, Shun-Ichi
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2008, 25 (01) : 142 - 145
  • [44] NONNEGATIVE UNIMODAL MATRIX FACTORIZATION
    Ang, Andersen Man Shun
    Gillis, Nicolas
    Vandaele, Arnaud
    De Sterck, Hans
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 3270 - 3274
  • [45] On Identifiability of Nonnegative Matrix Factorization
    Fu, Xiao
    Huang, Kejun
    Sidiropoulos, Nicholas D.
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2018, 25 (03) : 328 - 332
  • [46] Nonnegative Discriminant Matrix Factorization
    Lu, Yuwu
    Lai, Zhihui
    Xu, Yong
    Li, Xuelong
    Zhang, David
    Yuan, Chun
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2017, 27 (07) : 1392 - 1405
  • [47] Simplicial Nonnegative Matrix Factorization
    Nguyen, Duy Khuong
    Than, Khoat
    Ho, Tu Bao
    [J]. PROCEEDINGS OF 2013 IEEE RIVF INTERNATIONAL CONFERENCE ON COMPUTING AND COMMUNICATION TECHNOLOGIES: RESEARCH, INNOVATION, AND VISION FOR THE FUTURE (RIVF), 2013, : 47 - 52
  • [48] CAUCHY NONNEGATIVE MATRIX FACTORIZATION
    Liutkus, Antoine
    Fitzgerald, Derry
    Badeau, Roland
    [J]. 2015 IEEE WORKSHOP ON APPLICATIONS OF SIGNAL PROCESSING TO AUDIO AND ACOUSTICS (WASPAA), 2015,
  • [49] Randomized nonnegative matrix factorization
    Erichson, N. Benjamin
    Mendible, Ariana
    Wihlborn, Sophie
    Kutz, J. Nathan
    [J]. PATTERN RECOGNITION LETTERS, 2018, 104 : 1 - 7
  • [50] Affinity Matrix Learning Via Nonnegative Matrix Factorization for Hyperspectral Imagery Clustering
    Qin, Yao
    Li, Biao
    Ni, Weiping
    Quan, Sinong
    Wang, Peizhong
    Bian, Hui
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 402 - 415