Unsupervised Feature Selection With Constrained l2,0-Norm and Optimized Graph

被引:32
|
作者
Nie, Feiping [1 ,2 ]
Dong, Xia [1 ,2 ]
Tian, Lai [1 ,2 ]
Wang, Rong [2 ,3 ]
Li, Xuelong [1 ,2 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Ctr Opt IMagery Anal & Learning OPTIMAL, Xian 710072, Peoples R China
[3] Northwestern Polytech Univ, Sch Cybersecur, Xian 710072, Peoples R China
基金
中国国家自然科学基金;
关键词
l(2,0)-norm; group feature selection; optimized graph; unsupervised learning; SCHEME;
D O I
10.1109/TNNLS.2020.3043362
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this article, we propose a novel feature selection approach, named unsupervised feature selection with constrained l(2,0)-norm (row-sparsity constrained) and optimized graph (RSOCFS), which unifies feature selection and similarity matrix construction into a general framework instead of independently performing the two-stage process; thus, the similarity matrix preserving the local manifold structure of data can be determined adaptively. Unlike those sparse learning-based feature selection methods that can only solve the relaxation or approximation problems by introducing sparsity regularization term into the objective function, the proposed method directly tackles the original l(2,0)-norm constrained problem to achieve group feature selection. Two optimization strategies are provided to solve the original sparse constrained problem. The convergence and approximation guarantees for the new algorithms are rigorously proved, and the computational complexity and parameter determination are theoretically analyzed. Experimental results on real-world data sets show that the proposed method for solving a nonconvex problem is superior to the state of the arts for solving the relaxed or approximate convex problems.
引用
收藏
页码:1702 / 1713
页数:12
相关论文
共 50 条
  • [1] Fast Unsupervised Feature Selection With Bipartite Graph and l2,0-Norm Constraint
    Chen, Hong
    Nie, Feiping
    Wang, Rong
    Li, Xuelong
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (05) : 4781 - 4793
  • [2] Unsupervised feature selection through combining graph learning and l2,0-norm constraint
    Zhu, Peican
    Hou, Xin
    Tang, Keke
    Liu, Yang
    Zhao, Yin-Ping
    Wang, Zhen
    [J]. INFORMATION SCIENCES, 2023, 622 : 68 - 82
  • [3] Efficient Feature Selection via l2,0-norm Constrained Sparse Regression
    Pang, Tianji
    Nie, Feiping
    Han, Junwei
    Li, Xuelong
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2019, 31 (05) : 880 - 893
  • [4] Unsupervised Group Feature Selection Method for Graph Optimization Based on l2,0-norm Sparsity and Fuzzy Similarity
    Meng, Tiantian
    Zhou, Shuisheng
    Tian, Xinrun
    [J]. Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2023, 36 (01): : 34 - 48
  • [5] Subspace learning via Hessian regularized latent representation learning with l2,0-norm constraint: unsupervised feature selection
    Moslemi, Amir
    Shaygani, Afshin
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024,
  • [6] Exploiting Combination Effect for Unsupervised Feature Selection by l2,0 Norm
    Du, Xingzhong
    Nie, Feiping
    Wang, Weiqing
    Yang, Yi
    Zhou, Xiaofang
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (01) : 201 - 214
  • [7] Robust multi-class feature selection via l2,0-norm regularization minimization
    Sun, Zhenzhen
    Yu, Yuanlong
    [J]. INTELLIGENT DATA ANALYSIS, 2022, 26 (01) : 57 - 73
  • [8] L2,0-NORM REGULARIZATION BASED FEATURE SELECTION FOR VERY HIGH RESOLUTION REMOTE SENSING IMAGES
    Chen, Xi
    Gu, Yanfeng
    Zhang, Ye
    Yan, Yiming
    [J]. 2015 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2015, : 493 - 496
  • [9] l2,0-norm based selection and estimation for multivariate generalized linear models
    Chen, Yang
    Luo, Ziyan
    Kong, Lingchen
    [J]. JOURNAL OF MULTIVARIATE ANALYSIS, 2021, 185
  • [10] A Hidden Feature Selection Method based on l2,0-Norm Regularization for Training Single-hidden-layer Neural Networks
    Liu, Zhiwei
    Yu, Yuanlong
    Sun, Zhenzhen
    [J]. 2019 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2019), 2019, : 1810 - 1817