UNILATERAL ORTHOGONAL NONNEGATIVE MATRIX FACTORIZATION

被引:0
|
作者
Shang, Jun [1 ]
Chen, Tongwen [2 ]
机构
[1] Tongji Univ, Dept Control Sci & Engn, Shanghai 200092, Peoples R China
[2] Univ Alberta, Dept Elect & Comp Engn, Edmonton, AB T6G IH9, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
unilateral orthogonal nonnegative matrix factorization; switched systems; alternating minimization; convergence analysis; local minimum; ALGORITHMS; CONVERGENCE;
D O I
10.1137/22M1508315
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A type of matrix decomposition called unilateral orthogonal nonnegative matrix factorization is proposed for decomposing real-valued matrices. The associated optimization problem is nonconvex and nonlinear. We design an iterative algorithm based on alternating minimization, where a data compensation mechanism is used to avoid ill-conditioned problems. We also show that there is an interesting connection between the iterative algorithm and switched nonlinear systems. By analyzing the switched systems, we prove that each iteration of the algorithm is rank-preserving and thus avoids ill-conditioned problems. The solution to the optimization problem is also strictly feasible without any approximations. The optimization variables are proved to be convergent, and the limit satisfies the Karush-Kuhn-Tucker conditions. Furthermore, it is proved that the limit is almost surely a local minimizer rather than a saddle point. For the equivalent switched systems, the states of all subsystems are convergent.
引用
收藏
页码:2497 / 2519
页数:23
相关论文
共 50 条
  • [1] Nonnegative Matrix Factorization on Orthogonal Subspace
    Li, Zhao
    Wu, Xindong
    Peng, Hong
    [J]. PATTERN RECOGNITION LETTERS, 2010, 31 (09) : 905 - 911
  • [2] Algorithms for Orthogonal Nonnegative Matrix Factorization
    Choi, Seungjin
    [J]. 2008 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-8, 2008, : 1828 - 1832
  • [3] Randomized Algorithms for Orthogonal Nonnegative Matrix Factorization
    Yong-Yong Chen
    Fang-Fang Xu
    [J]. Journal of the Operations Research Society of China, 2023, 11 : 327 - 345
  • [4] Randomized Algorithms for Orthogonal Nonnegative Matrix Factorization
    Chen, Yong-Yong
    Xu, Fang-Fang
    [J]. JOURNAL OF THE OPERATIONS RESEARCH SOCIETY OF CHINA, 2023, 11 (02) : 327 - 345
  • [5] A convergent algorithm for orthogonal nonnegative matrix factorization
    Mirzal, Andri
    [J]. JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2014, 260 : 149 - 166
  • [6] AN EFFECTIVE INITIALIZATION FOR ORTHOGONAL NONNEGATIVE MATRIX FACTORIZATION
    Wang, Xuansheng
    Xie, Xiaoyao
    Lu, Linzhang
    [J]. JOURNAL OF COMPUTATIONAL MATHEMATICS, 2012, 30 (01) : 34 - 46
  • [7] Two Efficient Algorithms for Orthogonal Nonnegative Matrix Factorization
    Wu, Jing
    Chen, Bin
    Han, Tao
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2021, 2021
  • [8] Orthogonal Nonnegative Matrix Factorization for Blind Image Separation
    Mirzal, Andri
    [J]. ADVANCES IN VISUAL INFORMATICS, 2013, 8237 : 25 - 35
  • [9] ORTHOGONAL NONNEGATIVE MATRIX FACTORIZATION BY SPARSITY AND NUCLEAR NORM OPTIMIZATION
    Pan, Junjun
    Ng, Michael K.
    [J]. SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2018, 39 (02) : 856 - 875
  • [10] Two Efficient Algorithms for Approximately Orthogonal Nonnegative Matrix Factorization
    Li, Bo
    Zhou, Guoxu
    Cichocki, Andrzej
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2015, 22 (07) : 843 - 846