Gradient algorithms for principal component analysis

被引:9
|
作者
Mahony, RE [1 ]
Helmke, U [1 ]
Moore, JB [1 ]
机构
[1] UNIV REGENSBURG,DEPT MATH,W-8400 REGENSBURG,GERMANY
关键词
D O I
10.1017/S033427000001078X
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The problem of principal component analysis of a symmetric matrix (finding a p-dimensional eigenspace associated with the largest p eigenvalues) can be viewed as a smooth optimization problem on a homogeneous space. A solution in terms of the limiting value of a continuous-time dynamical system is presented, A discretization of the dynamical system is proposed that exploits the geometry of the homogeneous space. The relationship between the proposed algorithm and classical methods are investigated.
引用
收藏
页码:430 / 450
页数:21
相关论文
共 50 条
  • [31] Dual Principal Component Pursuit: Improved Analysis and Efficient Algorithms
    Zhu, Zhihui
    Wang, Yifan
    Robinson, Daniel
    Naiman, Daniel
    Vidal, Rene
    Tsakiris, Manolis C.
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [32] Recursive algorithms for principal component extraction
    Leung, ACS
    Wong, KW
    Tsoi, AC
    [J]. NETWORK-COMPUTATION IN NEURAL SYSTEMS, 1997, 8 (03) : 323 - 334
  • [33] Efficient and Structural Gradient Compression with Principal Component Analysis for Distributed Training
    Tan, Jiaxin
    Yao, Chao
    Guo, Zehua
    [J]. PROCEEDINGS OF THE 7TH ASIA-PACIFIC WORKSHOP ON NETWORKING, APNET 2023, 2023, : 217 - 218
  • [34] Fast Ridge Regression with Randomized Principal Component Analysis and Gradient Descent
    Lu, Yichao
    Foster, Dean P.
    [J]. UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, 2014, : 525 - 532
  • [35] AUTOMATIC CLASSIFICATION OF STAPHYLOCOCCI BY PRINCIPAL-COMPONENT ANALYSIS AND A GRADIENT METHOD
    HILL, LR
    SILVESTR.LG
    IHM, P
    FARCHI, G
    LANCIANI, P
    [J]. JOURNAL OF BACTERIOLOGY, 1965, 89 (05) : 1393 - &
  • [36] An improved stochastic gradient algorithm for principal component analysis and subspace tracking
    Dehaene, J
    Moonen, M
    Vandewalle, J
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1997, 45 (10) : 2582 - 2586
  • [37] Projection algorithms for nonconvex minimization with application to sparse principal component analysis
    William W. Hager
    Dzung T. Phan
    Jiajie Zhu
    [J]. Journal of Global Optimization, 2016, 65 : 657 - 676
  • [38] FAST ALGORITHMS FOR ROBUST PRINCIPAL COMPONENT ANALYSIS WITH AN UPPER BOUND ON THE RANK
    Sha, Ningyu
    Shi, Lei
    Yan, Ming
    [J]. INVERSE PROBLEMS AND IMAGING, 2021, 15 (01) : 109 - 128
  • [39] N-WAY PRINCIPAL COMPONENT ANALYSIS - THEORY, ALGORITHMS AND APPLICATIONS
    HENRION, R
    [J]. CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 1994, 25 (01) : 1 - 23
  • [40] Face recognition using kernel Principal Component Analysis and Genetic Algorithms
    Zhang, YK
    Liu, CQ
    [J]. NEURAL NETWORKS FOR SIGNAL PROCESSING XII, PROCEEDINGS, 2002, : 337 - 343