Two-Dimensional Unsupervised Feature Selection via Sparse Feature Filter

被引:9
|
作者
Li, Junyu [1 ]
Chen, Jiazhou [1 ]
Qi, Fei [1 ]
Dan, Tingting [1 ]
Weng, Wanlin [1 ]
Zhang, Bin [1 ]
Yuan, Haoliang [2 ]
Cai, Hongmin [1 ]
Zhong, Cheng [3 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Guangdong, Peoples R China
[2] Guangdong Univ Technol, Sch Automat, Guangzhou, Peoples R China
[3] Guangxi Univ, Sch Comp Elect & Informat, Nanning, Guangxi, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Feature extraction; Sparse matrices; Optimization; Task analysis; Training; Mutual information; Limiting; 2-D data; feature filter; learnable weighting; sparse regularization; unsupervised feature selection; MULTIVIEW FEATURE-SELECTION; FACE RECOGNITION; REGRESSION;
D O I
10.1109/TCYB.2022.3162908
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Unsupervised feature selection is a vital yet challenging topic for effective data learning. Recently, 2-D feature selection methods show good performance on image analysis by utilizing the structure information of image. Current 2-D methods usually adopt a sparse regularization to spotlight the key features. However, such scheme introduces additional hyperparameter needed for pruning, limiting the applicability of unsupervised algorithms. To overcome these challenges, we design a feature filter to estimate the weight of image features for unsupervised feature selection. Theoretical analysis shows that a sparse regularization can be derived from the feature filter by transformation, indicating that the filter plays the same role as the popular sparse regularization does. We deploy two distinct strategies in terms of feature selection, called multiple feature filters and single common feature filter. The former divides the optimization problem into multiple independent subproblems and selects features that meet the respective interests of each subproblem. The latter selects features that are in the interest of the overall optimization problem. Extensive experiments on seven benchmark datasets show that our unsupervised 2-D weight-based feature selection methods achieve superior performance over the state-of-the-art methods.
引用
收藏
页码:5605 / 5617
页数:13
相关论文
共 50 条
  • [41] Unsupervised feature selection using feature similarity
    Mitra, P
    Murthy, CA
    Pal, SK
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (03) : 301 - 312
  • [42] Compactness score: a fast filter method for unsupervised feature selection
    Zhu, Peican
    Hou, Xin
    Tang, Keke
    Wang, Zhen
    Nie, Feiping
    ANNALS OF OPERATIONS RESEARCH, 2023,
  • [43] Unsupervised Feature Selection via Collaborative Embedding Learning
    Li, Junyu
    Qi, Fei
    Sun, Xin
    Zhang, Bin
    Xu, Xiangmin
    Cai, Hongmin
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (03): : 2529 - 2540
  • [44] Unsupervised Feature Selection via Adaptive Multimeasure Fusion
    Zhang, Rui
    Nie, Feiping
    Wang, Yunhai
    Li, Xuelong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (09) : 2886 - 2892
  • [45] Subspace Clustering via Joint Unsupervised Feature Selection
    Dong, Wenhua
    Wu, Xiao-Jun
    Li, Hui
    Feng, Zhen-Hua
    Kittler, Josef
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 3892 - 3898
  • [46] Robust unsupervised feature selection via matrix factorization
    Du, Shiqiang
    Ma, Yide
    Li, Shouliang
    Ma, Yurun
    NEUROCOMPUTING, 2017, 241 : 115 - 127
  • [47] Dynamic Graph Regularization and Label Relaxation-Based Sparse Matrix Regression for Two-Dimensional Feature Selection
    Chen, Xiuhong
    Lu, Yun
    IEEE ACCESS, 2020, 8 (08) : 62855 - 62870
  • [48] Clustering-Guided Sparse Structural Learning for Unsupervised Feature Selection
    Li, Zechao
    Liu, Jing
    Yang, Yi
    Zhou, Xiaofang
    Lu, Hanqing
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2014, 26 (09) : 2138 - 2150
  • [49] Fast Sparse Discriminative K-Means for Unsupervised Feature Selection
    Nie, Feiping
    Ma, Zhenyu
    Wang, Jingyu
    Li, Xuelong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (07) : 9943 - 9957
  • [50] Unsupervised feature selection algorithm based on redundancy learning and sparse regression
    Kong, Guoping
    Ma, Yingcang
    Xing, Zhiwei
    Xin, Xiaolong
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2023, 625