Log-based sparse nonnegative matrix factorization for data representation

被引:18
|
作者
Peng, Chong [1 ]
Zhang, Yiqun [1 ]
Chen, Yongyong [1 ,2 ]
Kang, Zhao [3 ]
Chen, Chenglizhao [1 ]
Cheng, Qiang [4 ,5 ]
机构
[1] Qingdao Univ, Coll Comp Sci & Technol, Qingdao, Shandong, Peoples R China
[2] Harbin Inst Technol, Dept Comp Sci, Harbin, Heilongjiang, Peoples R China
[3] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu, Sichuan, Peoples R China
[4] Univ Kentucky, Dept Comp Sci, Lexington, KY USA
[5] Univ Kentucky, Inst Biomed Informat, Lexington, KY USA
关键词
Nonnegative matrix factorization; Sparse; Robust; Convergence; RECOGNITION; PARTS; OBJECTS;
D O I
10.1016/j.knosys.2022.109127
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nonnegative matrix factorization (NMF) has been widely studied in recent years due to its effectiveness in representing nonnegative data with parts-based representations. For NMF, a sparser solution implies better parts-based representation. However, current NMF methods do not always generate sparse solutions. In this paper, we propose a new NMF method with log-norm imposed on the factor matrices to enhance the sparseness. Moreover, we propose a novel column-wisely sparse norm, named l(2,log)-(pseudo) norm to enhance the robustness of the proposed method. The l(2,log)-(pseudo) norm is invariant, continuous, and differentiable. For the l(2,log) regularized shrinkage problem, we derive a closed-form solution, which can be used for other general problems. Efficient multiplicative updating rules are developed for the optimization, which theoretically guarantees the convergence of the objective value sequence. Extensive experimental results confirm the effectiveness of the proposed method, as well as the enhanced sparseness and robustness. (C) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Dual Graph Regularized Sparse Nonnegative Matrix Factorization for Data Representation
    Peng, Siyuan
    Ser, Wee
    Lin, Zhiping
    Chen, Badong
    [J]. 2019 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2019,
  • [2] Graph regularized and sparse nonnegative matrix factorization with hard constraints for data representation
    Sun, Fuming
    Xu, Meixiang
    Hu, Xuekao
    Jiang, Xiaojun
    [J]. NEUROCOMPUTING, 2016, 173 : 233 - 244
  • [3] Improved hypergraph regularized Nonnegative Matrix Factorization with sparse representation
    Huang, Sheng
    Wang, Hongxing
    Ge, Yongxin
    Huangfu, Luwen
    Zhang, Xiaohong
    Yang, Dan
    [J]. PATTERN RECOGNITION LETTERS, 2018, 102 : 8 - 14
  • [4] Nonnegative matrix factorization with Log Gabor wavelets for image representation and classification
    Zheng Zhonglong & Yang JieInst. of Image Processing and Pattern Recognition of Shanghai Jiaotong Univ.
    [J]. Journal of Systems Engineering and Electronics, 2005, (04) : 738 - 745
  • [5] Constrained Nonnegative Matrix Factorization Based on Label Propagation for Data Representation
    Liu, Junmin
    Wang, Yicheng
    Ma, Jing
    Han, Di
    Huang, Yifan
    [J]. IEEE Transactions on Artificial Intelligence, 2024, 5 (02): : 590 - 601
  • [6] Graph Regularized Nonnegative Matrix Factorization for Data Representation
    Cai, Deng
    He, Xiaofei
    Han, Jiawei
    Huang, Thomas S.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (08) : 1548 - 1560
  • [7] Document clustering based on nonnegative sparse matrix factorization
    Yang, CF
    Ye, M
    Zhao, J
    [J]. ADVANCES IN NATURAL COMPUTATION, PT 2, PROCEEDINGS, 2005, 3611 : 557 - 563
  • [8] Sparse Deep Nonnegative Matrix Factorization
    Guo, Zhenxing
    Zhang, Shihua
    [J]. BIG DATA MINING AND ANALYTICS, 2020, 3 (01) : 13 - 28
  • [9] Binary Sparse Nonnegative Matrix Factorization
    Yuan, Yuan
    Li, Xuelong
    Pang, Yanwei
    Lu, Xin
    Tao, Dacheng
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2009, 19 (05) : 772 - 777
  • [10] Sparse and Unique Nonnegative Matrix Factorization Through Data Preprocessing
    Gillis, Nicolas
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2012, 13 : 3349 - 3386