Randomized Algorithms for Orthogonal Nonnegative Matrix Factorization

被引:1
|
作者
Chen, Yong-Yong [1 ]
Xu, Fang-Fang [1 ]
机构
[1] Shandong Univ Sci & Technol, Coll Math & Syst Sci, Qingdao 266590, Shandong, Peoples R China
基金
中国国家自然科学基金;
关键词
Orthogonal nonnegative matrix factorization; Random projection method; Dimensionality reduction; Augmented lagrangian method; Hierarchical alternating least squares algorithm; INITIALIZATION;
D O I
10.1007/s40305-020-00322-9
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
Orthogonal nonnegative matrix factorization (ONMF) is widely used in blind image separation problem, document classification, and human face recognition. The model of ONMF can be efficiently solved by the alternating direction method of multipliers and hierarchical alternating least squares method. When the given matrix is huge, the cost of computation and communication is too high. Therefore, ONMF becomes challenging in the large-scale setting. The random projection is an efficient method of dimensionality reduction. In this paper, we apply the random projection to ONMF and propose two randomized algorithms. Numerical experiments show that our proposed algorithms perform well on both simulated and real data.
引用
收藏
页码:327 / 345
页数:19
相关论文
共 50 条
  • [31] EXACT AND HEURISTIC ALGORITHMS FOR SEMI-NONNEGATIVE MATRIX FACTORIZATION
    Gillis, Nicolas
    Kumar, Abhishek
    [J]. SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2015, 36 (04) : 1404 - 1424
  • [32] Fast and Robust Recursive Algorithms for Separable Nonnegative Matrix Factorization
    Gillis, Nicolas
    Vavasis, Stephen A.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (04) : 698 - 714
  • [33] Sparse nonnegative matrix factorization with genetic algorithms for microarray analysis
    Stadlthanner, K.
    Lutter, D.
    Theis, F. J.
    Lang, E. W.
    Tome, A. M.
    Georgieva, P.
    Puntonet, C. G.
    [J]. 2007 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-6, 2007, : 294 - +
  • [34] Algorithms for Nonnegative Matrix Factorization with the Kullback-Leibler Divergence
    Hien, Le Thi Khanh
    Gillis, Nicolas
    [J]. JOURNAL OF SCIENTIFIC COMPUTING, 2021, 87 (03)
  • [35] Novel Algorithms Based on Majorization Minimization for Nonnegative Matrix Factorization
    Jyothi, R.
    Babu, Prabhu
    Bahl, Rajendar
    [J]. IEEE ACCESS, 2019, 7 : 115682 - 115695
  • [36] Algorithms for audio inpainting based on probabilistic nonnegative matrix factorization
    Mokry, Ondrej
    Magron, Paul
    Oberlin, Thomas
    Fevotte, Cedric
    [J]. SIGNAL PROCESSING, 2023, 206
  • [37] Symmetric Nonnegative Matrix Factorization: Algorithms and Applications to Probabilistic Clustering
    He, Zhaoshui
    Xie, Shengli
    Zdunek, Rafal
    Zhou, Guoxu
    Cichocki, Andrzej
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2011, 22 (12): : 2117 - 2131
  • [38] Conic optimization-based algorithms for nonnegative matrix factorization
    Leplat, Valentin
    Nesterov, Yurii
    Gillis, Nicolas
    Glineur, Francois
    [J]. OPTIMIZATION METHODS & SOFTWARE, 2023, 38 (04): : 837 - 859
  • [39] Orthogonal Nonnegative Matrix Factorization using a novel deep Autoencoder Network
    Yang, Mingming
    Xu, Songhua
    [J]. KNOWLEDGE-BASED SYSTEMS, 2021, 227
  • [40] Orthogonal nonnegative matrix tri-factorization based on Tweedie distributions
    Hiroyasu Abe
    Hiroshi Yadohisa
    [J]. Advances in Data Analysis and Classification, 2019, 13 : 825 - 853