Unsupervised feature analysis with sparse adaptive learning

被引:10
|
作者
Wang, Xiao-dong [1 ,2 ]
Chen, Rung-Ching [2 ]
Hong, Chao-qun [1 ]
Zeng, Zhi-qiang [1 ]
机构
[1] Xiamen Univ Technol, Coll Comp & Informat Engn, Xiamen 361024, Peoples R China
[2] Chaoyang Univ Technol, Dept Informat Management, Taichung 41349, Taiwan
关键词
Unsupervised learning; Feature selection; Adaptive structure learning; l(2)-Norm; FEATURE-SELECTION;
D O I
10.1016/j.patrec.2017.12.022
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unsupervised feature learning has played an important role in machine learning due to its ability to save human labor cost. Since the absence of labels in such scenario, a commonly used approach is to select features according to the similarity matrix derived from the original feature space. However, their similarity matrices suffer from noises and redundant features, with which are frequently confronted in high-dimensional data. In this paper, we propose a novel unsupervised feature selection algorithm. Compared with the previous works, there are mainly two merits of the proposed algorithm: (1) The similarity matrix is adaptively adjusted with a comprehensive strategy to fully utilize the information in the projected data and the original data. (2) To guarantee the clarity of the dramatically learned manifold structure, a non-squared l(2)-norm based sparsity method is imposed into the objective function. The proposed objective function involves several non-smooth constraints, making it difficult to solve. We also design an efficient iterative algorithm to optimize it. Experimental results demonstrate the effectiveness of our algorithm compared with the state-of-the-art algorithms on several kinds of publicly available datasets. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:89 / 94
页数:6
相关论文
共 50 条
  • [21] Unsupervised Feature Selection via Controllable Adaptive Graph Learning and Discriminative Feature Learning
    Huang, Pei
    Xie, Mengying
    Yang, Xiaowei
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 35 (11) : 1 - 15
  • [22] Sparse robust adaptive unsupervised subspace learning for dimensionality reduction
    Xiong, Weizhi
    Yu, Guolin
    Ma, Jun
    Liu, Sheng
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 129
  • [23] Clustering-Guided Sparse Structural Learning for Unsupervised Feature Selection
    Li, Zechao
    Liu, Jing
    Yang, Yi
    Zhou, Xiaofang
    Lu, Hanqing
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2014, 26 (09) : 2138 - 2150
  • [24] Dictionary learning for unsupervised feature selection via dual sparse regression
    Wu, Jian-Sheng
    Liu, Jing-Xin
    Wu, Jun-Yun
    Huang, Wei
    APPLIED INTELLIGENCE, 2023, 53 (15) : 18840 - 18856
  • [25] Intelligent fault diagnosis using an unsupervised sparse feature learning method
    Cheng, Chun
    Wang, Weiping
    Liu, Haining
    Pecht, Michael
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2020, 31 (09)
  • [26] Discriminative sparse subspace learning and its application to unsupervised feature selection
    Zhou, Nan
    Cheng, Hong
    Pedrycz, Witold
    Zhang, Yong
    Liu, Huaping
    ISA TRANSACTIONS, 2016, 61 : 104 - 118
  • [27] Unsupervised feature selection algorithm based on redundancy learning and sparse regression
    Kong, Guoping
    Ma, Yingcang
    Xing, Zhiwei
    Xin, Xiaolong
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2023, 625
  • [28] Joint Embedding Learning and Sparse Regression: A Framework for Unsupervised Feature Selection
    Hou, Chenping
    Nie, Feiping
    Li, Xuelong
    Yi, Dongyun
    Wu, Yi
    IEEE TRANSACTIONS ON CYBERNETICS, 2014, 44 (06) : 793 - 804
  • [29] Dictionary learning for unsupervised feature selection via dual sparse regression
    Jian-Sheng Wu
    Jing-Xin Liu
    Jun-Yun Wu
    Wei Huang
    Applied Intelligence, 2023, 53 : 18840 - 18856
  • [30] Unsupervised Feature Selection via Adaptive Graph Learning and Constraint
    Zhang, Rui
    Zhang, Yunxing
    Li, Xuelong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (03) : 1355 - 1362