Robust and Sparse Principal Component Analysis With Adaptive Loss Minimization for Feature Selection

被引:12
|
作者
Bian, Jintang [1 ,2 ]
Zhao, Dandan [3 ]
Nie, Feiping [1 ,4 ]
Wang, Rong [4 ]
Li, Xuelong [1 ,4 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Ctr Opt Imagery Anal & Learning, Xian 710072, Peoples R China
[3] Chongqing Univ, Coll Automat, Chongqing 400044, Peoples R China
[4] Northwestern Polytech Univ, Sch Artificial Intelligence Opt & Elect iOPEN, Xian 710072, Peoples R China
基金
中国国家自然科学基金;
关键词
Adaptive loss minimization; robust principal component analysis (RPCA); structural sparsity constraint; unsupervised feature selection; UNSUPERVISED FEATURE-SELECTION; SUPERVISED FEATURE-SELECTION;
D O I
10.1109/TNNLS.2022.3194896
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Principal component analysis (PCA) is one of the most successful unsupervised subspace learning methods and has been used in many practical applications. To deal with the outliers in real-world data, robust principal analysis models based on various measure are proposed. However, conventional PCA models can only transform features to unknown subspace for dimensionality reduction and cannot perform features' selection task. In this article, we propose a novel robust PCA (RPCA) model to mitigate the impact of outliers and conduct feature selection, simultaneously. First, we adopt sigma-norm as reconstruction error (RE), which plays an important role in robust reconstruction. Second, to conduct feature selection task, we apply l(2,0)-norm constraint to subspace projection. Furthermore, an efficient iterative optimization algorithm is proposed to solve the objective function with nonconvex and nonsmooth constraint. Extensive experiments conducted on several real-world datasets demonstrate the effectiveness and superiority of the proposed feature selection model.
引用
下载
收藏
页码:3601 / 3614
页数:14
相关论文
共 50 条
  • [31] A plug-in approach to sparse and robust principal component analysis
    Luca Greco
    Alessio Farcomeni
    TEST, 2016, 25 : 449 - 481
  • [32] Feature selection based on improved principal component analysis
    Li, Zhangyu
    Qiu, Yihui
    2023 2ND ASIA CONFERENCE ON ALGORITHMS, COMPUTING AND MACHINE LEARNING, CACML 2023, 2023, : 188 - 192
  • [33] Robust sparse principal component analysis by DC programming algorithm
    Li, Jieya
    Yang, Liming
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2020, 39 (03) : 3183 - 3193
  • [34] Robust sparse principal component analysis: situation of full sparseness
    Alkan, B. Baris
    Unaldi, I
    JOURNAL OF APPLIED MATHEMATICS STATISTICS AND INFORMATICS, 2022, 18 (01) : 5 - 20
  • [35] Fuzzy Sparse Deviation Regularized Robust Principal Component Analysis
    Gao, Yunlong
    Lin, Tingting
    Pan, Jinyan
    Nie, Feiping
    Xie, Youwei
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 5645 - 5660
  • [36] A plug-in approach to sparse and robust principal component analysis
    Greco, Luca
    Farcomeni, Alessio
    TEST, 2016, 25 (03) : 449 - 481
  • [37] Robust adaptive algorithms for fast principal component analysis
    Bekhtaoui, Zineb
    Abed-Meraim, Karim
    Meche, Abdelkrim
    DIGITAL SIGNAL PROCESSING, 2022, 127
  • [38] Adaptive rendering based on robust principal component analysis
    Yuan, Hongliang
    Zheng, Changwen
    VISUAL COMPUTER, 2018, 34 (04): : 551 - 562
  • [39] Adaptive rendering based on robust principal component analysis
    Hongliang Yuan
    Changwen Zheng
    The Visual Computer, 2018, 34 : 551 - 562
  • [40] Adaptive Rank Estimate in Robust Principal Component Analysis
    Xu, Zhengqin
    He, Rui
    Xie, Shoulie
    Wu, Shiqian
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 6573 - 6582