Global and local structure preserving sparse subspace learning: An iterative approach to unsupervised feature selection

被引:71
|
作者
Zhou, Nan [1 ,2 ]
Xu, Yangyang [3 ]
Cheng, Hong [1 ]
Fang, Jun [1 ]
Pedrycz, Witold [2 ,4 ,5 ]
机构
[1] Univ Elect Sci & Technol China, Ctr Robot, Sch Automat Engn, Chengdu 611731, Sichuan, Peoples R China
[2] Univ Alberta, Dept Elect & Comp Engn, Edmonton, AB T6G 2R3, Canada
[3] Univ Waterloo, Dept Combinator & Optimizat, Waterloo, ON N2L 3G1, Canada
[4] King Abdulaziz Univ, Fac Engn, Dept Elect & Comp Engn, Jeddah 21589, Saudi Arabia
[5] Polish Acad Sci, Syst Res Inst, PL-01447 Warsaw, Poland
基金
加拿大自然科学与工程研究理事会;
关键词
Machine learning; Feature selection; Subspace learning; Unsupervised learning; DIMENSIONALITY REDUCTION; DISCRIMINANT; RECOVERY;
D O I
10.1016/j.patcog.2015.12.008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As we aim at alleviating the curse of high-dimensionality, subspace learning is becoming more popular. Existing approaches use either information about global or local structure of the data, and few studies simultaneously focus on global and local structures as the both of them contain important information. In this paper, we propose a global and local structure preserving sparse subspace learning (GLOSS) model for unsupervised feature selection. The model can simultaneously realize feature selection and subspace learning. In addition, we develop a greedy algorithm to establish a generic combinatorial model, and an iterative strategy based on an accelerated block coordinate descent is used to solve the GLoSS problem. We also provide whole iterate sequence convergence analysis of the proposed iterative algorithm. Extensive experiments are conducted on real-world datasets to show the superiority of the proposed approach over several state-of-the-art unsupervised feature selection approaches. (C) 2015 Elsevier Ltd. All rights reserved.
引用
收藏
页码:87 / 101
页数:15
相关论文
共 50 条
  • [1] Robust Sparse Subspace Learning for Unsupervised Feature Selection
    Wang, Feng
    Rao, Qi
    Zhang, Yongquan
    Chen, Xu
    [J]. 2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 4205 - 4212
  • [2] Unsupervised feature selection via local structure learning and sparse learning
    Cong Lei
    Xiaofeng Zhu
    [J]. Multimedia Tools and Applications, 2018, 77 : 29605 - 29622
  • [3] Unsupervised feature selection via local structure learning and sparse learning
    Lei, Cong
    Zhu, Xiaofeng
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (22) : 29605 - 29622
  • [4] Robust Unsupervised Feature Selection by Nonnegative Sparse Subspace Learning
    Zheng, Wei
    Yan, Hui
    Yang, Jian
    Yang, Jingyu
    [J]. 2016 23RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2016, : 3615 - 3620
  • [5] Robust unsupervised feature selection by nonnegative sparse subspace learning
    Zheng, Wei
    Yan, Hui
    Yang, Jian
    [J]. NEUROCOMPUTING, 2019, 334 : 156 - 171
  • [6] Similarity Preserving Unsupervised Feature Selection based on Sparse Learning
    Zare, Hadi
    Parsa, Mohsen Ghasemi
    Ghatee, Mehdi
    Alizadeh, Sasan H.
    [J]. 2020 10TH INTERNATIONAL SYMPOSIUM ON TELECOMMUNICATIONS (IST), 2020, : 50 - 55
  • [7] Discriminative sparse subspace learning and its application to unsupervised feature selection
    Zhou, Nan
    Cheng, Hong
    Pedrycz, Witold
    Zhang, Yong
    Liu, Huaping
    [J]. ISA TRANSACTIONS, 2016, 61 : 104 - 118
  • [8] Local discriminative based sparse subspace learning for feature selection
    Shang, Ronghua
    Meng, Yang
    Wang, Wenbing
    Shang, Fanhua
    Jiao, Licheng
    [J]. PATTERN RECOGNITION, 2019, 92 : 219 - 230
  • [9] Sparse Representation Preserving for Unsupervised Feature Selection
    Yan, Hui
    Jin, Zhong
    Yang, Jian
    [J]. 2014 22ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2014, : 1574 - 1578
  • [10] UNSUPERVISED FEATURE SELECTION WITH LOCAL STRUCTURE LEARNING
    Yang, Sheng
    Nie, Feiping
    Li, Xuelong
    [J]. 2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 3398 - 3402