Maximum Correntropy Criterion-Based Sparse Subspace Learning for Unsupervised Feature Selection

被引:34
|
作者
Zhou, Nan [1 ,2 ]
Xu, Yangyang [3 ]
Cheng, Hong [2 ]
Yuan, Zejian [4 ]
Chen, Badong [4 ]
机构
[1] Chengdu Univ Informat Technol, Coll Control Engn, Chengdu 610225, Sichuan, Peoples R China
[2] Univ Elect Sci & Technol China, Ctr Robot, Chengdu 611731, Sichuan, Peoples R China
[3] Rensselaer Polytech Inst, Dept Math Sci, Troy, NY 12180 USA
[4] Xi An Jiao Tong Univ, Inst Artificial Intelligence & Robot, Xian 710049, Peoples R China
关键词
Machine learning; feature selection; maximum correntropy criterion (MCC); sparse subspace learning; ALGORITHMS;
D O I
10.1109/TCSVT.2017.2783364
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
High-dimensional data contain not only redundancy but also noises produced by the sensors. These noises are usually non-Gaussian distributed. The metrics based on Euclidean distance are not suitable for these situations in general. In order to select the useful features and combat the adverse effects of the noises simultaneously, a robust sparse subspace learning method in unsupervised scenario is proposed in this paper based on the maximum correntropy criterion that shows strong robustness against outliers. Furthermore, an iterative strategy based on half quadratic and an accelerated block coordinate update is proposed. The convergence analysis of the proposed method is also carried out to ensure the convergence to a reliable solution. Extensive experiments are conducted on real-world data sets to show that the new method can filter out the outliers and outperform several state-of-the-art unsupervised feature selection methods.
引用
收藏
页码:404 / 417
页数:14
相关论文
共 50 条
  • [1] Robust Sparse Subspace Learning for Unsupervised Feature Selection
    Wang, Feng
    Rao, Qi
    Zhang, Yongquan
    Chen, Xu
    [J]. 2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 4205 - 4212
  • [2] Robust Unsupervised Feature Selection by Nonnegative Sparse Subspace Learning
    Zheng, Wei
    Yan, Hui
    Yang, Jian
    Yang, Jingyu
    [J]. 2016 23RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2016, : 3615 - 3620
  • [3] Robust unsupervised feature selection by nonnegative sparse subspace learning
    Zheng, Wei
    Yan, Hui
    Yang, Jian
    [J]. NEUROCOMPUTING, 2019, 334 : 156 - 171
  • [4] Discriminative sparse subspace learning and its application to unsupervised feature selection
    Zhou, Nan
    Cheng, Hong
    Pedrycz, Witold
    Zhang, Yong
    Liu, Huaping
    [J]. ISA TRANSACTIONS, 2016, 61 : 104 - 118
  • [5] Maximum Correntropy Criterion-Based Hierarchical One-Class Classification
    Cao, Jiuwen
    Dai, Haozhen
    Lei, Baiying
    Yin, Chun
    Zeng, Huanqiang
    Kummert, Anton
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (08) : 3748 - 3754
  • [6] ROBUST FEATURE LEARNING BY STACKED AUTOENCODER WITH MAXIMUM CORRENTROPY CRITERION
    Qi, Yu
    Wang, Yueming
    Zheng, Xiaoxiang
    Wu, Zhaohui
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [7] Maximum Correntropy Criterion-Based Robust Semisupervised Concept Factorization for Image Representation
    Zhou, Nan
    Chen, Badong
    Du, Yuanhua
    Jiang, Tao
    Liu, Jun
    Xu, Yangyang
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (10) : 3877 - 3891
  • [8] Local discriminative based sparse subspace learning for feature selection
    Shang, Ronghua
    Meng, Yang
    Wang, Wenbing
    Shang, Fanhua
    Jiao, Licheng
    [J]. PATTERN RECOGNITION, 2019, 92 : 219 - 230
  • [9] Feature selection active learning algorithm based on sparse subspace
    Gong, Liang
    Wang, Xu-Hong
    Yang, Yu-Pu
    [J]. Journal of Computers (Taiwan), 2021, 32 (02) : 23 - 32
  • [10] Outliers Robust Unsupervised Feature Selection for Structured Sparse Subspace
    Wang, Sisi
    Nie, Feiping
    Wang, Zheng
    Wang, Rong
    Li, Xuelong
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (03) : 1234 - 1248