Robust unsupervised feature selection by nonnegative sparse subspace learning

被引:21
|
作者
Zheng, Wei [1 ,2 ,4 ,5 ]
Yan, Hui [1 ,3 ]
Yang, Jian [1 ,4 ,5 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing, Jiangsu, Peoples R China
[2] Jinling Inst Technol, Sch Comp Engn, Nanjing, Jiangsu, Peoples R China
[3] Nanjing Xiaozhuang Univ, Key Lab Trusted Cloud Comp & Big Data Anal, Nanjing, Jiangsu, Peoples R China
[4] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Key Lab Intelligent Percept & Syst High Dimen, PCA Lab,Minist Educ, Nanjing, Jiangsu, Peoples R China
[5] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Jiangsu Key Lab Image & Video Understanding Socia, Nanjing, Jiangsu, Peoples R China
关键词
Subspace learning; Non-negative matrix factorization; Unsupervised feature selection;
D O I
10.1016/j.neucom.2019.01.015
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sparse subspace learning has been demonstrated to be effective in data mining and machine learning. In this paper, we cast the unsupervised feature selection scenario as a matrix factorization problem from the viewpoint of sparse subspace learning. By minimizing the reconstruction residual, the learned feature weight matrix with the l(2,1)-norm and the non-negative constraints not only removes the irrelevant features, but also captures the underlying low dimensional structure of the data points. Meanwhile in order to enhance the model's robustness, l(1) -norm error function is used to resistant to outliers and sparse noise. An efficient iterative algorithm is introduced to optimize this non-convex and non-smooth objective function and the proof of its convergence is given. Although, there is a subtraction item in our multiplicative update rule, we validate its non-negativity. The superiority of our model is demonstrated by comparative experiments on various original datasets with and without malicious pollution. (C) 2019 Published by Elsevier B.V.
引用
收藏
页码:156 / 171
页数:16
相关论文
共 50 条
  • [1] Robust Unsupervised Feature Selection by Nonnegative Sparse Subspace Learning
    Zheng, Wei
    Yan, Hui
    Yang, Jian
    Yang, Jingyu
    [J]. 2016 23RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2016, : 3615 - 3620
  • [2] Robust Sparse Subspace Learning for Unsupervised Feature Selection
    Wang, Feng
    Rao, Qi
    Zhang, Yongquan
    Chen, Xu
    [J]. 2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 4205 - 4212
  • [3] UNSUPERVISED FEATURE SELECTION BY NONNEGATIVE SPARSITY ADAPTIVE SUBSPACE LEARNING
    Zhou, Nan
    Cheng, Hong
    Zheng, Ya-Li
    He, Liang-Tian
    Pedrycz, Witold
    [J]. PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON WAVELET ANALYSIS AND PATTERN RECOGNITION (ICWAPR), 2016, : 18 - 24
  • [4] Outliers Robust Unsupervised Feature Selection for Structured Sparse Subspace
    Wang, Sisi
    Nie, Feiping
    Wang, Zheng
    Wang, Rong
    Li, Xuelong
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (03) : 1234 - 1248
  • [5] Nonnegative Laplacian embedding guided subspace learning for unsupervised feature selection
    Zhang, Yong
    Wang, Qing
    Gong, Dun-wei
    Song, Xian-fang
    [J]. PATTERN RECOGNITION, 2019, 93 : 337 - 352
  • [6] Discriminative sparse subspace learning and its application to unsupervised feature selection
    Zhou, Nan
    Cheng, Hong
    Pedrycz, Witold
    Zhang, Yong
    Liu, Huaping
    [J]. ISA TRANSACTIONS, 2016, 61 : 104 - 118
  • [7] Robust unsupervised feature selection via sparse and minimum-redundant subspace learning with dual regularization
    Zeng, Congying
    Chen, Hongmei
    Li, Tianrui
    Wan, Jihong
    [J]. NEUROCOMPUTING, 2022, 511 : 1 - 21
  • [8] Maximum Correntropy Criterion-Based Sparse Subspace Learning for Unsupervised Feature Selection
    Zhou, Nan
    Xu, Yangyang
    Cheng, Hong
    Yuan, Zejian
    Chen, Badong
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (02) : 404 - 417
  • [9] Accelerated sparse nonnegative matrix factorization for unsupervised feature learning
    Xie, Ting
    Zhang, Hua
    Liu, Ruihua
    Xiao, Hanguang
    [J]. PATTERN RECOGNITION LETTERS, 2022, 156 : 46 - 52
  • [10] Global and local structure preserving sparse subspace learning: An iterative approach to unsupervised feature selection
    Zhou, Nan
    Xu, Yangyang
    Cheng, Hong
    Fang, Jun
    Pedrycz, Witold
    [J]. PATTERN RECOGNITION, 2016, 53 : 87 - 101