Adaptive graph regularization and self-expression for noise-aware feature selection

被引:4
|
作者
Shang, Ronghua [1 ]
Chi, Haijing [1 ]
Li, Yangyang [1 ]
Jiao, Licheng [1 ]
机构
[1] Xidian Univ, Int Res Ctr Intelligent Percept & Computat, Sch Artificial Intelligence, Key Lab Intelligent Percept & Image Understanding,, Xian 710071, Shaanxi, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Non -negative matrix factorization; Orthogonal basis clustering; Adaptive graph regularization; Unsupervised feature selection; UNSUPERVISED FEATURE-SELECTION; SPECTRAL-ANALYSIS; SPARSE; SYSTEM;
D O I
10.1016/j.neucom.2023.03.036
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Many traditional unsupervised feature selection algorithms utilize manifold information to mine the local structure of the data. However, the noise existing in the raw data reduces the accuracy of the man-ifold information of data, which affects the learning effect of the entire algorithm. In order to solve the above problems and more fully find the internal structure inside the data, this paper proposes an adaptive graph regularization and self-expression for noise-aware feature selection (ASNFS). Firstly, the algorithm adopts non-negative matrix factorization to decompose the raw data matrix, and utilizes the low-dimensional matrix generated after decomposition to replace the raw high-dimensional data matrix. This allows the algorithm to reveal some internal structural information of the raw data while reducing the dimensionality of the data. ASNFS also introduces the orthogonal basis clustering with excellent clus-tering effect, and the interpretability of the algorithm is enhanced. Secondly, in addition to preserving the manifold information in the low-dimensional projection subspace, the algorithm also preserves the man-ifold information in the non-negative matrix factorization subspace. Meanwhile, the adaptive graph reg-ularization term added to the objective function enables the algorithm to continuously update the similarity matrix. It can effectively remove the noise inside the raw data, and prevent the occurrence of over-fitting phenomenon of the experimental results caused by the fixed similarity matrix. Finally, the similarity matrix retains the local structure information of the data with each iteration, and the results of the feature selection are reused for the construction of the similarity matrix. ASNFS adopts an alternate iterative method to optimize the objective function, which is simple and effective. Then, the algorithm complexity and convergence are analyzed. ASNFS is compared with seven feature selection algorithms on nine datasets, and the experimental results reflect the effectiveness of ASNFS in feature selection.(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页码:107 / 122
页数:16
相关论文
共 50 条
  • [1] Noise-aware clustering based on maximum correntropy criterion and adaptive graph regularization
    Li, Xinyu
    Fan, Hui
    Liu, Jinglei
    [J]. INFORMATION SCIENCES, 2023, 626 : 42 - 59
  • [2] A noise-aware feature selection approach for classification
    Sabzekar, Mostafa
    Aydin, Zafer
    [J]. SOFT COMPUTING, 2021, 25 (08) : 6391 - 6400
  • [3] A noise-aware feature selection approach for classification
    Mostafa Sabzekar
    Zafer Aydin
    [J]. Soft Computing, 2021, 25 : 6391 - 6400
  • [4] Unsupervised Feature Selection via Neural Networks and Self-Expression with Adaptive Graph Constraint
    You, Mengbo
    Yuan, Aihong
    He, Dongjian
    Li, Xuelong
    [J]. PATTERN RECOGNITION, 2023, 135
  • [5] Unsupervised Feature Selection with Adaptive Graph Embedding and Non- Convex Regular Feature Self-Expression
    Li, Mengqing
    Sun, Lin
    Xu, Jiucheng
    [J]. Computer Engineering and Applications, 2024, 60 (16) : 177 - 185
  • [6] Unsupervised feature selection with joint self-expression and spectral analysis via adaptive graph constraints
    Mengbo You
    Lujie Ban
    Yuhan Wang
    Juan Kang
    Guorui Wang
    Aihong Yuan
    [J]. Multimedia Tools and Applications, 2023, 82 : 5879 - 5898
  • [7] Unsupervised feature selection with joint self-expression and spectral analysis via adaptive graph constraints
    You, Mengbo
    Ban, Lujie
    Wang, Yuhan
    Kang, Juan
    Wang, Guorui
    Yuan, Aihong
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (04) : 5879 - 5898
  • [8] A noise-aware fuzzy rough set approach for feature selection
    Yang, Xiaoling
    Chen, Hongmei
    Li, Tianrui
    Luo, Chuan
    [J]. KNOWLEDGE-BASED SYSTEMS, 2022, 250
  • [9] Adaptive unsupervised feature selection with robust graph regularization
    Cao, Zhiwen
    Xie, Xijiong
    Sun, Feixiang
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (02) : 341 - 354
  • [10] Adaptive unsupervised feature selection with robust graph regularization
    Zhiwen Cao
    Xijiong Xie
    Feixiang Sun
    [J]. International Journal of Machine Learning and Cybernetics, 2024, 15 : 341 - 354