On the rotational invariant L1-norm PCA

被引:5
|
作者
Neumayer, Sebastian [1 ]
Nimmer, Max [1 ]
Setzer, Simon [2 ]
Steidl, Gabriele [1 ,3 ]
机构
[1] Tech Univ Kaiserslautern, Paul Ehrlich Str 31, D-67663 Kaiserslautern, Germany
[2] Engineers Gate, London, England
[3] Fraunhofer ITWM, Fraunhofer Pl 1, D-67663 Kaiserslautern, Germany
基金
美国国家科学基金会;
关键词
Principal component analysis; Dimensionality reduction; Robust subspace fitting; Conditional gradient algorithm; Frank-Wolfe algorithm; Optimization on Grassmann manifolds; ROBUST PCA; ALGORITHMS;
D O I
10.1016/j.laa.2019.10.030
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Principal component analysis (PCA) is a powerful tool for dimensionality reduction. Unfortunately, it is sensitive to outliers, so that various robust PCA variants were proposed in the literature. One of the most frequently applied methods for high dimensional data reduction is the rotational invariant L-1-norm PCA of Ding and coworkers. So far no convergence proof for this algorithm was available. The main topic of this paper is to fill this gap. We reinterpret this robust approach as a conditional gradient algorithm and show moreover that it coincides with a gradient descent algorithm on Grassmann manifolds. Based on the latter point of view, we prove global convergence of the whole series of iterates to a critical point using the Kurdyka-Lojasiewicz property of the objective function, where we have to pay special attention to so-called anchor points, where the function is not differentiable. (C) 2019 Elsevier Inc. All rights reserved.
引用
收藏
页码:243 / 270
页数:28
相关论文
共 50 条
  • [1] A Simple and Fast Algorithm for L1-Norm Kernel PCA
    Kim, Cheolmin
    Klabjan, Diego
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (08) : 1842 - 1855
  • [2] Robust Singular Values based on L1-norm PCA
    Le, Duc H.
    Markopoulos, Panos P.
    [J]. 2022 IEEE WORKSHOP ON SIGNAL PROCESSING SYSTEMS (SIPS), 2022, : 67 - 72
  • [3] Improve robustness of sparse PCA by L1-norm maximization
    Meng, Deyu
    Zhao, Qian
    Xu, Zongben
    [J]. PATTERN RECOGNITION, 2012, 45 (01) : 487 - 497
  • [4] Rotational Motion Control by Feedback with Minimum L1-Norm
    Majima, Minoru
    Ichikawa, Akira
    [J]. JOURNAL OF GUIDANCE CONTROL AND DYNAMICS, 2009, 32 (02) : 635 - 643
  • [5] BINARIZATION OF NATURAL SCENE TEXT BASED ON L1-NORM PCA
    Bai, Jinfeng
    Feng, Bailan
    Xu, Bo
    [J]. ELECTRONIC PROCEEDINGS OF THE 2013 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (ICMEW), 2013,
  • [6] Pruning filters with L1-norm and capped L1-norm for CNN compression
    Kumar, Aakash
    Shaikh, Ali Muhammad
    Li, Yun
    Bilal, Hazrat
    Yin, Baoqun
    [J]. APPLIED INTELLIGENCE, 2021, 51 (02) : 1152 - 1160
  • [7] Pruning filters with L1-norm and capped L1-norm for CNN compression
    Aakash Kumar
    Ali Muhammad Shaikh
    Yun Li
    Hazrat Bilal
    Baoqun Yin
    [J]. Applied Intelligence, 2021, 51 : 1152 - 1160
  • [8] Notes on quantum coherence with l1-norm and convex-roof l1-norm
    Zhu, Jiayao
    Ma, Jian
    Zhang, Tinggui
    [J]. QUANTUM INFORMATION PROCESSING, 2021, 20 (12)
  • [9] Semi-Blind Signal Recovery in Impulsive Noise with L1-Norm PCA
    Gannon, Adam
    Sklivanitis, George
    Markopoulos, Panos P.
    Pados, Dimitris A.
    Batalama, Stella N.
    [J]. 2018 CONFERENCE RECORD OF 52ND ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2018, : 477 - 481
  • [10] Protein functional annotation refinement based on graph regularized l1-norm PCA
    Sun, Dengdi
    Liang, Huadong
    Ge, Meiling
    Ding, Zhuanlian
    Cai, Wanting
    Luo, Bin
    [J]. PATTERN RECOGNITION LETTERS, 2017, 87 : 212 - 221