Unsupervised feature analysis with sparse adaptive learning

被引:10
|
作者
Wang, Xiao-dong [1 ,2 ]
Chen, Rung-Ching [2 ]
Hong, Chao-qun [1 ]
Zeng, Zhi-qiang [1 ]
机构
[1] Xiamen Univ Technol, Coll Comp & Informat Engn, Xiamen 361024, Peoples R China
[2] Chaoyang Univ Technol, Dept Informat Management, Taichung 41349, Taiwan
关键词
Unsupervised learning; Feature selection; Adaptive structure learning; l(2)-Norm; FEATURE-SELECTION;
D O I
10.1016/j.patrec.2017.12.022
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unsupervised feature learning has played an important role in machine learning due to its ability to save human labor cost. Since the absence of labels in such scenario, a commonly used approach is to select features according to the similarity matrix derived from the original feature space. However, their similarity matrices suffer from noises and redundant features, with which are frequently confronted in high-dimensional data. In this paper, we propose a novel unsupervised feature selection algorithm. Compared with the previous works, there are mainly two merits of the proposed algorithm: (1) The similarity matrix is adaptively adjusted with a comprehensive strategy to fully utilize the information in the projected data and the original data. (2) To guarantee the clarity of the dramatically learned manifold structure, a non-squared l(2)-norm based sparsity method is imposed into the objective function. The proposed objective function involves several non-smooth constraints, making it difficult to solve. We also design an efficient iterative algorithm to optimize it. Experimental results demonstrate the effectiveness of our algorithm compared with the state-of-the-art algorithms on several kinds of publicly available datasets. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:89 / 94
页数:6
相关论文
共 50 条
  • [1] Convex Sparse PCA for Unsupervised Feature Learning
    Chang, Xiaojun
    Nie, Feiping
    Yang, Yi
    Zhang, Chengqi
    Huang, Heng
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2016, 11 (01)
  • [2] An Empirical Analysis of Different Sparse Penalties for Autoencoder in Unsupervised Feature Learning
    Jiang, Nan
    Rong, Wenge
    Peng, Baolin
    Nie, Yifan
    Xiong, Zhang
    2015 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2015,
  • [3] Adaptive Weighted Sparse Principal Component Analysis for Robust Unsupervised Feature Selection
    Yi, Shuangyan
    He, Zhenyu
    Jing, Xiao-Yuan
    Li, Yi
    Cheung, Yiu-Ming
    Nie, Feiping
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (06) : 2153 - 2163
  • [4] Robust Sparse Subspace Learning for Unsupervised Feature Selection
    Wang, Feng
    Rao, Qi
    Zhang, Yongquan
    Chen, Xu
    2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 4205 - 4212
  • [5] Joint Adaptive Graph Learning and Discriminative Analysis for Unsupervised Feature Selection
    Haifeng Zhao
    Qi Li
    Zheng Wang
    Feiping Nie
    Cognitive Computation, 2022, 14 : 1211 - 1221
  • [6] Joint Adaptive Graph Learning and Discriminative Analysis for Unsupervised Feature Selection
    Zhao, Haifeng
    Li, Qi
    Wang, Zheng
    Nie, Feiping
    COGNITIVE COMPUTATION, 2022, 14 (03) : 1211 - 1221
  • [7] Adaptive Graph Learning for Unsupervised Feature Selection
    Zhang, Zhihong
    Bai, Lu
    Liang, Yuanheng
    Hancock, Edwin R.
    COMPUTER ANALYSIS OF IMAGES AND PATTERNS, CAIP 2015, PT I, 2015, 9256 : 790 - 800
  • [8] Adaptive Hypergraph Learning for Unsupervised Feature Selection
    Zhu, Xiaofeng
    Zhu, Yonghua
    Zhang, Shichao
    Hu, Rongyao
    He, Wei
    PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 3581 - 3587
  • [9] Unsupervised Feature Selection with Adaptive Structure Learning
    Du, Liang
    Shen, Yi-Dong
    KDD'15: PROCEEDINGS OF THE 21ST ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2015, : 209 - 218
  • [10] Unsupervised feature selection via local structure learning and sparse learning
    Cong Lei
    Xiaofeng Zhu
    Multimedia Tools and Applications, 2018, 77 : 29605 - 29622