Dual subspace learning via geodesic search on Stiefel manifold

被引：4
|
作者：
Liu, Lijun [1 ]
Ge, Rendong [1 ]
Meng, Jiana [2 ]
You, Guangjie [3 ]
机构：
[1] Dalian National Univ, Sch Sci, Dalian 116600, Peoples R China
[2] Dalian National Univ, Coll Comp Sci & Technol, Dalian 116600, Peoples R China
[3] Dalian National Univ, Coll Foreign Languages & Cultures, Dalian 116600, Peoples R China
来源：
INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS | 2014年 / 5卷 / 05期
基金：
中国国家自然科学基金;
关键词：
Principal subspace analysis; Minor subspace analysis; Dual learning; Stiefel manifold; MINOR COMPONENTS EXTRACTION; PURPOSE PRINCIPAL; NEURAL NETWORKS; ALGORITHMS; FLOW;
D O I：
10.1007/s13042-013-0217-x
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
Oja's principal subspace algorithm is a well-known and powerful technique for learning and tracking principal information of time series. However, Oja's algorithm is divergent when performing the task of minor subspace analysis. In the present paper, we transform Oja's algorithm into a dual learning algorithm in the sense of fulfilling principal subspace analysis as well as minor subspace analysis via geodesic search on Stiefel manifold. Also inherent stability is guaranteed for the proposed geodesic based algorithm due to the fact the weight matrix rigourously evolves on the compact Stiefel manifold. The effectiveness of the proposed algorithm is further verified in the section of numerical simulation.
引用
收藏
页码：753 / 759
页数：7
相关论文
共 50 条
  • [1] Dual subspace learning via geodesic search on Stiefel manifold
    Lijun Liu
    Rendong Ge
    Jiana Meng
    Guangjie You
    [J]. International Journal of Machine Learning and Cybernetics, 2014, 5 : 753 - 759
  • [2] Learning algorithms utilizing quasi-geodesic flows on the Stiefel manifold
    Nishimori, Y
    Akaho, S
    [J]. NEUROCOMPUTING, 2005, 67 : 106 - 135
  • [3] Volume of Geodesic Balls in the Complex Stiefel Manifold
    Krishnamachari, Rajesh T.
    Varanasi, Mahesh K.
    [J]. 2008 46TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING, VOLS 1-3, 2008, : 902 - 909
  • [4] Volume of geodesic balls in the real Stiefel manifold
    Krishnamachari, Rajesh T.
    Varanasi, Mahesh K.
    [J]. 2008 42ND ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS, VOLS 1-3, 2008, : 402 - 406
  • [5] PARTICLE FILTERING ON THE COMPLEX STIEFEL MANIFOLD WITH APPLICATION TO SUBSPACE TRACKING
    Bordin Jr, Claudio J.
    Bruno, Marcelo G. S.
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 5485 - 5489
  • [6] Discriminative subspace learning via optimization on Riemannian manifold
    Yin, Wanguang
    Ma, Zhengming
    Liu, Quanying
    [J]. PATTERN RECOGNITION, 2023, 139
  • [7] Multivariate regression via Stiefel manifold constraints
    Bakir, GH
    Gretton, A
    Franz, M
    Schölkopf, B
    [J]. PATTERN RECOGNITION, 2004, 3175 : 262 - 269
  • [8] Special Issue on Subspace and Manifold Learning for Image and Video Indexing and Search
    Fu, Yun
    Hua, Xian-Sheng
    Li, Zhu
    Katsaggelos, Aggelos K.
    Huang, Thomas S.
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2012, 42 (02): : 294 - 297
  • [9] Learning image manifold via local tensor subspace alignment
    Wu, Songsong
    Jing, Xiaoyuan
    Wei, Zhisen
    Yang, Jian
    Yang, Jingyu
    [J]. NEUROCOMPUTING, 2014, 139 : 22 - 33
  • [10] Numerical study of learning algorithms on Stiefel manifold
    Kanamori, Takafumi
    Takeda, Akiko
    [J]. COMPUTATIONAL MANAGEMENT SCIENCE, 2014, 11 (04) : 319 - 340
12345