Unsupervised feature selection via discrete spectral clustering and feature weights

被引:11
|
作者
Shang, Ronghua [1 ]
Kong, Jiarui [1 ]
Wang, Lujuan [1 ]
Zhang, Weitong [1 ]
Wang, Chao [2 ]
Li, Yangyang [1 ]
Jiao, Licheng [1 ]
机构
[1] Xidian Univ, Sch Artificial Intelligence, Key Lab Intelligent Percept & Image Understanding, Minist Educ, Xian 710071, Shanxi, Peoples R China
[2] Zhejiang Lab, Res Ctr Big Data Intelligence, Hangzhou 311121, Zhejiang, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Unsupervised feature selection; Discrete spectral clustering; Feature weights; Orthogonal regression; SPARSE REGRESSION; FEATURE SUBSET; FACTORIZATION; FRAMEWORK;
D O I
10.1016/j.neucom.2022.10.053
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most of the existing unsupervised feature selection methods learn the cluster structure through spectral clustering, and then use various regression models to introduce the data matrix into the indicator matrix to obtain feature selection matrix. In these methods, the clustering indicator matrix is usually continuous value, which is not the best choice for the matrix in terms of its supervising role in feature selection. Based on this, unsupervised feature selection via discrete spectral clustering and feature weights (FSDSC) is proposed in this paper. First, FSDSC integrates regression model and spectral clustering in a unified framework for feature selection, and introduces a feature weight matrix, which intuitively expresses the importance of each feature with its diagonal elements. Compared with the common feature selection matrix that requires constraints such as sparse regular items, the appearance of the feature weight matrix reduces the complexity of the model and simplifies the calculation process of feature eval-uation. Secondly, for the value of the indicators matrix, the spectral clustering is improved to obtain a discrete clustering indicator matrix, which provides clearer guidance information for feature selection. Finally, in order to avoid trivial solutions, the transformation matrix is constrained by orthogonal con-straint. The combination of the orthogonal regression model and spectral clustering enables the algo-rithm to perform feature selection and manifold information learning at the same time, thereby preserving the local geometric structure of data. Compared with other excellent unsupervised feature selection algorithms, the experimental results prove the effectiveness of the proposed algorithm.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:106 / 117
页数:12
相关论文
共 50 条
  • [1] Unsupervised Feature Selection with Feature Clustering
    Cheung, Yiu-ming
    Jia, Hong
    [J]. 2012 IEEE/WIC/ACM INTERNATIONAL CONFERENCE ON WEB INTELLIGENCE AND INTELLIGENT AGENT TECHNOLOGY (WI-IAT 2012), VOL 1, 2012, : 9 - 15
  • [2] Spectral Clustering Based Unsupervised Feature Selection Algorithms
    Xie, Juan-Ying
    Ding, Li-Juan
    Wang, Ming-Zhao
    [J]. Ruan Jian Xue Bao/Journal of Software, 2020, 31 (04): : 1009 - 1024
  • [3] Subspace Clustering via Joint Unsupervised Feature Selection
    Dong, Wenhua
    Wu, Xiao-Jun
    Li, Hui
    Feng, Zhen-Hua
    Kittler, Josef
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 3892 - 3898
  • [4] Unsupervised feature selection for balanced clustering
    Zhou, Peng
    Chen, Jiangyong
    Fan, Mingyu
    Du, Liang
    Shen, Yi-Dong
    Li, Xuejun
    [J]. KNOWLEDGE-BASED SYSTEMS, 2020, 193
  • [5] Unsupervised feature selection by learning exponential weights
    Wang, Chenchen
    Wang, Jun
    Gu, Zhichen
    Wei, Jin-Mao
    Liu, Jian
    [J]. PATTERN RECOGNITION, 2024, 148
  • [6] An efficient unsupervised feature selection procedure through feature clustering
    Yan, Xuyang
    Nazmi, Shabnam
    Erol, Berat A.
    Homaifar, Abdollah
    Gebru, Biniam
    Tunstel, Edward
    [J]. PATTERN RECOGNITION LETTERS, 2020, 131 : 277 - 284
  • [7] An Unsupervised Attribute Clustering Algorithm for Unsupervised Feature Selection
    Zhou, Pei-Yuan
    Chan, Keith C. C.
    [J]. PROCEEDINGS OF THE 2015 IEEE INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ADVANCED ANALYTICS (IEEE DSAA 2015), 2015, : 710 - 716
  • [8] Unsupervised Feature Selection for Proportional Data Clustering via Expectation Propagation
    Fan, Wentao
    Bouguila, Nizar
    [J]. 2013 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2013,
  • [9] Unsupervised Feature Selection with Joint Clustering Analysis
    An, Shuai
    Wang, Jun
    Wei, Jinmao
    Yang, Zhenglu
    [J]. CIKM'17: PROCEEDINGS OF THE 2017 ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2017, : 1639 - 1648
  • [10] A unifying criterion for unsupervised clustering and feature selection
    Breaban, Mihaela
    Luchian, Henri
    [J]. PATTERN RECOGNITION, 2011, 44 (04) : 854 - 865