Robust unsupervised feature selection by nonnegative sparse subspace learning

被引:21
|
作者
Zheng, Wei [1 ,2 ,4 ,5 ]
Yan, Hui [1 ,3 ]
Yang, Jian [1 ,4 ,5 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing, Jiangsu, Peoples R China
[2] Jinling Inst Technol, Sch Comp Engn, Nanjing, Jiangsu, Peoples R China
[3] Nanjing Xiaozhuang Univ, Key Lab Trusted Cloud Comp & Big Data Anal, Nanjing, Jiangsu, Peoples R China
[4] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Key Lab Intelligent Percept & Syst High Dimen, PCA Lab,Minist Educ, Nanjing, Jiangsu, Peoples R China
[5] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Jiangsu Key Lab Image & Video Understanding Socia, Nanjing, Jiangsu, Peoples R China
关键词
Subspace learning; Non-negative matrix factorization; Unsupervised feature selection;
D O I
10.1016/j.neucom.2019.01.015
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sparse subspace learning has been demonstrated to be effective in data mining and machine learning. In this paper, we cast the unsupervised feature selection scenario as a matrix factorization problem from the viewpoint of sparse subspace learning. By minimizing the reconstruction residual, the learned feature weight matrix with the l(2,1)-norm and the non-negative constraints not only removes the irrelevant features, but also captures the underlying low dimensional structure of the data points. Meanwhile in order to enhance the model's robustness, l(1) -norm error function is used to resistant to outliers and sparse noise. An efficient iterative algorithm is introduced to optimize this non-convex and non-smooth objective function and the proof of its convergence is given. Although, there is a subtraction item in our multiplicative update rule, we validate its non-negativity. The superiority of our model is demonstrated by comparative experiments on various original datasets with and without malicious pollution. (C) 2019 Published by Elsevier B.V.
引用
收藏
页码:156 / 171
页数:16
相关论文
共 50 条
  • [41] Collaborative and Discriminative Subspace Learning for unsupervised multi-view feature selection
    Wu, Jian-Sheng
    Li, Yanlan
    Gong, Jun-Xiao
    Min, Weidong
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 133
  • [42] Robust sparse coding for subspace learning
    School of Three Gorges Artificial Intelligence, Chongqing Three Gorges University, Wanzhou, Chongqing
    404100, China
    [J]. Ital. J. Pure Appl. Math., 2020, (986-994):
  • [43] Robust sparse coding for subspace learning
    Dai, Xiangguang
    Tao, Yingyin
    Xiong, Jiang
    Feng, Yuming
    [J]. ITALIAN JOURNAL OF PURE AND APPLIED MATHEMATICS, 2020, (44): : 986 - 994
  • [44] Joint sparse matrix regression and nonnegative spectral analysis for two-dimensional unsupervised feature selection
    Yuan, Haoliang
    Li, Junyu
    Lai, Loi Lei
    Tang, Yuan Yan
    [J]. PATTERN RECOGNITION, 2019, 89 : 119 - 133
  • [45] Unsupervised Robust Bayesian Feature Selection
    Sun, Jianyong
    Zhou, Aimin
    [J]. PROCEEDINGS OF THE 2014 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2014, : 558 - 564
  • [46] Sparse and low-redundant subspace learning-based dual-graph regularized robust feature selection
    Shang, Ronghua
    Xu, Kaiming
    Shangl, Fanhua
    Pao, Licheng
    [J]. KNOWLEDGE-BASED SYSTEMS, 2020, 187
  • [47] Sparse Graph Embedding Unsupervised Feature Selection
    Wang, Shiping
    Zhu, William
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2018, 48 (03): : 329 - 341
  • [48] UDSFS: Unsupervised deep sparse feature selection
    Cong, Yang
    Wang, Shuai
    Fan, Baojie
    Yang, Yunsheng
    Yu, Haibin
    [J]. NEUROCOMPUTING, 2016, 196 : 150 - 158
  • [49] Sparse and Flexible Projections for Unsupervised Feature Selection
    Wang, Rong
    Zhang, Canyu
    Bian, Jintang
    Wang, Zheng
    Nie, Feiping
    Li, Xuelong
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (06) : 6362 - 6375
  • [50] Sparse Representation Preserving for Unsupervised Feature Selection
    Yan, Hui
    Jin, Zhong
    Yang, Jian
    [J]. 2014 22ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2014, : 1574 - 1578