An Algorithm for Randomized Nonnegative Matrix Factorization and Its Global Convergence

被引:0
|
作者
Masuda, Takao [1 ]
Migita, Tsuyoshi [1 ]
Takahashi, Norikazu [1 ]
机构
[1] Okayama Univ, Okayama, Japan
关键词
nonnegative matrix factorization; hierarchical alternating least squares algorithm; randomized NMF; global convergence;
D O I
10.1109/SSCI50451.2021.9659900
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nonnegative Matrix Factorization (NMF) is to decompose a given nonnegative matrix into two nonnegative factor matrices. Recently, randomized NMF has been proposed as an approach to fast NMF of large nonnegative matrices. The main idea of this approach is to perform NMF after reducing the dimensionality of the given nonnegative matrix by multiplying it by a random matrix. Since randomized NMF is formulated as a constrained optimization problem which is slightly different from the one for original NMF, it is necessary to develop suitable algorithms for solving it. However, the conventional algorithm has a serious drawback that the constraints are not satisfied. In addition, the convergence of the algorithm has not been analyzed. In this paper, in order to overcome these drawbacks, we propose to modify the optimization problem and design an algorithm based on the hierarchical alternating least squares method to solve the modified optimization problem. We also prove the global convergence of the designed algorithm.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] A Fast Algorithm for Nonnegative Matrix Factorization and Its Convergence
    Li, Li-Xin
    Wu, Lin
    Zhang, Hui-Sheng
    Wu, Fang-Xiang
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2014, 25 (10) : 1855 - 1863
  • [2] Global Convergence of a Modified HALS Algorithm for Nonnegative Matrix Factorization
    Kimura, Takumi
    Takahashi, Norikazu
    [J]. 2015 IEEE 6TH INTERNATIONAL WORKSHOP ON COMPUTATIONAL ADVANCES IN MULTI-SENSOR ADAPTIVE PROCESSING (CAMSAP), 2015, : 21 - 24
  • [3] A Modified Multiplicative Update Algorithm for Euclidean Distance-Based Nonnegative Matrix Factorization and Its Global Convergence
    Hibi, Ryota
    Takahashi, Norikazu
    [J]. NEURAL INFORMATION PROCESSING, PT II, 2011, 7063 : 655 - 662
  • [4] Global convergence of modified multiplicative updates for nonnegative matrix factorization
    Takahashi, Norikazu
    Hibi, Ryota
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2014, 57 (02) : 417 - 440
  • [5] Global convergence of modified multiplicative updates for nonnegative matrix factorization
    Norikazu Takahashi
    Ryota Hibi
    [J]. Computational Optimization and Applications, 2014, 57 : 417 - 440
  • [6] NONNEGATIVE MATRIX FACTORIZATION USING ADMM: ALGORITHM AND CONVERGENCE ANALYSIS
    Hajinezhad, Davood
    Chang, Tsung-Hui
    Wang, Xiangfeng
    Shi, Qingpang
    Hong, Mingyi
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 4742 - 4746
  • [7] A novel update rule of HALS algorithm for nonnegative matrix factorization and Zangwill's global convergence
    Sano, Takehiro
    Migita, Tsuyoshi
    Takahashi, Norikazu
    [J]. JOURNAL OF GLOBAL OPTIMIZATION, 2022, 84 (03) : 755 - 781
  • [8] A novel update rule of HALS algorithm for nonnegative matrix factorization and Zangwill’s global convergence
    Takehiro Sano
    Tsuyoshi Migita
    Norikazu Takahashi
    [J]. Journal of Global Optimization, 2022, 84 : 755 - 781
  • [9] Randomized nonnegative matrix factorization
    Erichson, N. Benjamin
    Mendible, Ariana
    Wihlborn, Sophie
    Kutz, J. Nathan
    [J]. PATTERN RECOGNITION LETTERS, 2018, 104 : 1 - 7
  • [10] A UNIFIED CONVERGENCE ANALYSIS OF THE MULTIPLICATIVE UPDATE ALGORITHM FOR NONNEGATIVE MATRIX FACTORIZATION
    Zhao, Renbo
    Tan, Vincent Y. F.
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 2562 - 2566