Robust and Sparse Principal Component Analysis With Adaptive Loss Minimization for Feature Selection

被引:12
|
作者
Bian, Jintang [1 ,2 ]
Zhao, Dandan [3 ]
Nie, Feiping [1 ,4 ]
Wang, Rong [4 ]
Li, Xuelong [1 ,4 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Ctr Opt Imagery Anal & Learning, Xian 710072, Peoples R China
[3] Chongqing Univ, Coll Automat, Chongqing 400044, Peoples R China
[4] Northwestern Polytech Univ, Sch Artificial Intelligence Opt & Elect iOPEN, Xian 710072, Peoples R China
基金
中国国家自然科学基金;
关键词
Adaptive loss minimization; robust principal component analysis (RPCA); structural sparsity constraint; unsupervised feature selection; UNSUPERVISED FEATURE-SELECTION; SUPERVISED FEATURE-SELECTION;
D O I
10.1109/TNNLS.2022.3194896
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Principal component analysis (PCA) is one of the most successful unsupervised subspace learning methods and has been used in many practical applications. To deal with the outliers in real-world data, robust principal analysis models based on various measure are proposed. However, conventional PCA models can only transform features to unknown subspace for dimensionality reduction and cannot perform features' selection task. In this article, we propose a novel robust PCA (RPCA) model to mitigate the impact of outliers and conduct feature selection, simultaneously. First, we adopt sigma-norm as reconstruction error (RE), which plays an important role in robust reconstruction. Second, to conduct feature selection task, we apply l(2,0)-norm constraint to subspace projection. Furthermore, an efficient iterative optimization algorithm is proposed to solve the objective function with nonconvex and nonsmooth constraint. Extensive experiments conducted on several real-world datasets demonstrate the effectiveness and superiority of the proposed feature selection model.
引用
下载
收藏
页码:3601 / 3614
页数:14
相关论文
共 50 条
  • [41] COMBINING FEATURE SELECTION WITH EXTRACTION: UNSUPERVISED FEATURE SELECTION BASED ON PRINCIPAL COMPONENT ANALYSIS
    Li, Yun
    Lu, Bao-Liang
    Zhang, Teng-Fei
    INTERNATIONAL JOURNAL ON ARTIFICIAL INTELLIGENCE TOOLS, 2009, 18 (06) : 883 - 904
  • [42] Robust Principal Component Analysis via Truncated Nuclear Norm Minimization
    张艳
    郭继昌
    赵洁
    王博
    Journal of Shanghai Jiaotong University(Science), 2016, 21 (05) : 576 - 583
  • [43] Robust principal component analysis via truncated nuclear norm minimization
    Zhang Y.
    Guo J.
    Zhao J.
    Wang B.
    Journal of Shanghai Jiaotong University (Science), 2016, 21 (5) : 576 - 583
  • [44] A new adaptive elastic loss for robust unsupervised feature selection
    Pan, Jinyan
    Xie, Youwei
    Wang, Xinjing
    Zhang, Haifeng
    Cao, Chao
    Gao, Yunlong
    NEUROCOMPUTING, 2024, 601
  • [45] Sparse principal component analysis
    Zou, Hui
    Hastie, Trevor
    Tibshirani, Robert
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2006, 15 (02) : 265 - 286
  • [46] Feature selection of stabilometric parameters based on principal component analysis
    Rocchi, L
    Chiari, L
    Cappello, A
    MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2004, 42 (01) : 71 - 79
  • [47] Feature selection of stabilometric parameters based on principal component analysis
    L. Rocchi
    L. Chiari
    A. Cappello
    Medical and Biological Engineering and Computing, 2004, 42 : 71 - 79
  • [48] Sparse Robust Principal Component Analysis with Applications to Fault Detection and Diagnosis
    Luo, Lijia
    Bao, Shiyi
    Tong, Chudong
    INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH, 2019, 58 (03) : 1300 - 1309
  • [49] Feature selection using principal component analysis and genetic algorithm
    Adhao, Rahul
    Pachghare, Vinod
    JOURNAL OF DISCRETE MATHEMATICAL SCIENCES & CRYPTOGRAPHY, 2020, 23 (02): : 595 - 602
  • [50] Feature Selection of Weather Data with Interval Principal Component Analysis
    He, Chong-Cheng
    Jeng, Jin-Tsong
    2016 INTERNATIONAL CONFERENCE ON SYSTEM SCIENCE AND ENGINEERING (ICSSE), 2016,