Log-based sparse nonnegative matrix factorization for data representation

被引:18
|
作者
Peng, Chong [1 ]
Zhang, Yiqun [1 ]
Chen, Yongyong [1 ,2 ]
Kang, Zhao [3 ]
Chen, Chenglizhao [1 ]
Cheng, Qiang [4 ,5 ]
机构
[1] Qingdao Univ, Coll Comp Sci & Technol, Qingdao, Shandong, Peoples R China
[2] Harbin Inst Technol, Dept Comp Sci, Harbin, Heilongjiang, Peoples R China
[3] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu, Sichuan, Peoples R China
[4] Univ Kentucky, Dept Comp Sci, Lexington, KY USA
[5] Univ Kentucky, Inst Biomed Informat, Lexington, KY USA
关键词
Nonnegative matrix factorization; Sparse; Robust; Convergence; RECOGNITION; PARTS; OBJECTS;
D O I
10.1016/j.knosys.2022.109127
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nonnegative matrix factorization (NMF) has been widely studied in recent years due to its effectiveness in representing nonnegative data with parts-based representations. For NMF, a sparser solution implies better parts-based representation. However, current NMF methods do not always generate sparse solutions. In this paper, we propose a new NMF method with log-norm imposed on the factor matrices to enhance the sparseness. Moreover, we propose a novel column-wisely sparse norm, named l(2,log)-(pseudo) norm to enhance the robustness of the proposed method. The l(2,log)-(pseudo) norm is invariant, continuous, and differentiable. For the l(2,log) regularized shrinkage problem, we derive a closed-form solution, which can be used for other general problems. Efficient multiplicative updating rules are developed for the optimization, which theoretically guarantees the convergence of the objective value sequence. Extensive experimental results confirm the effectiveness of the proposed method, as well as the enhanced sparseness and robustness. (C) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Adaptive graph regularized nonnegative matrix factorization for data representation
    Zhang, Lin
    Liu, Zhonghua
    Pu, Jiexin
    Song, Bin
    [J]. APPLIED INTELLIGENCE, 2020, 50 (02) : 438 - 447
  • [22] Bayesian nonnegative matrix factorization in an incremental manner for data representation
    Lijun Yang
    Lulu Yan
    Xiaohui Yang
    Xin Xin
    Liugen Xue
    [J]. Applied Intelligence, 2023, 53 : 9580 - 9597
  • [23] Error Graph Regularized Nonnegative Matrix Factorization for Data Representation
    Qiang Zhu
    Meijun Zhou
    Junping Liu
    [J]. Neural Processing Letters, 2023, 55 : 7321 - 7335
  • [24] Robust Structured Convex Nonnegative Matrix Factorization for Data Representation
    Yang, Qing
    Yin, Xuesong
    Kou, Simin
    Wang, Yigang
    [J]. IEEE ACCESS, 2021, 9 : 155087 - 155102
  • [25] A Fast Non-Smooth Nonnegative Matrix Factorization for Learning Sparse Representation
    Yang, Zuyuan
    Zhang, Yu
    Yan, Wei
    Xiang, Yong
    Xie, Shengli
    [J]. IEEE ACCESS, 2016, 4 : 5161 - 5168
  • [26] Bayesian nonnegative matrix factorization in an incremental manner for data representation
    Yang, Lijun
    Yan, Lulu
    Yang, Xiaohui
    Xin, Xin
    Xue, Liugen
    [J]. APPLIED INTELLIGENCE, 2023, 53 (08) : 9580 - 9597
  • [27] Blind Spectral Unmixing Based on Sparse Nonnegative Matrix Factorization
    Yang, Zuyuan
    Zhou, Guoxu
    Xie, Shengli
    Ding, Shuxue
    Yang, Jun-Mei
    Zhang, Jun
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (04) : 1112 - 1125
  • [28] Sparse Nonnegative Matrix Factorization Based on Collaborative Neurodynamic Optimization
    Che, Hangjun
    Wang, Jun
    [J]. 2019 9TH INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND TECHNOLOGY (ICIST2019), 2019, : 114 - 121
  • [29] A constrained sparse algorithm for nonnegative matrix factorization
    Collage of Computer and Info. Eng., Hohai Univ., Nanjing
    211100, China
    [J]. Sichuan Daxue Xuebao (Gongcheng Kexue Ban), 1600, 2 (108-111):
  • [30] Nonredundancy regularization based nonnegative matrix factorization with manifold learning for multiview data representation
    Cui, Guosheng
    Li, Ye
    [J]. INFORMATION FUSION, 2022, 82 : 86 - 98