Group-feature (Sensor) selection with controlled redundancy using neural networks

被引:0
|
作者
Saha, Aytijhya [1 ]
Pal, Nikhil R. [1 ]
机构
[1] Indian Stat Inst, Kolkata, India
关键词
Dimensionality reduction; Feature selection; Group-feature selection; Sensor selection; Redundancy control; Group lasso; Neural network; GROUP LASSO; REGULARIZATION;
D O I
10.1016/j.neucom.2024.128596
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work, we present a novel embedded feature selection method based on a Multi-layer Perceptron (MLP) network and generalize it for group-feature or sensor selection problems, which can control the level of redundancy among the selected features or groups and it is computationally more efficient than the existing ones in the literature. Additionally, we have generalized the group lasso penalty for feature selection to encompass a mechanism for selecting valuable groups of features while simultaneously maintaining control over redundancy. We establish the monotonicity and convergence of the proposed algorithm, with a smoothed version of the penalty terms, under suitable assumptions. The effectiveness of the proposed method for both feature selection and group feature selection is validated through experimental results on various benchmark datasets. The performance of the proposed methods is compared with some state-of-the-art methods.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Deep-gKnock: Nonlinear group-feature selection with deep neural networks
    Zhu, Guangyu
    Zhao, Tingting
    NEURAL NETWORKS, 2021, 135 : 139 - 147
  • [2] Feature Selection Using a Neural Network With Group Lasso Regularization and Controlled Redundancy
    Wang, Jian
    Zhang, Huaqing
    Wang, Junze
    Pu, Yifei
    Pal, Nikhil R.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (03) : 1110 - 1123
  • [3] SENSOR (GROUP FEATURE) SELECTION WITH CONTROLLED REDUNDANCY IN A CONNECTIONIST FRAMEWORK
    Chakraborty, Rudrasis
    Lin, Chin-Teng
    Pal, Nikhil R.
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2014, 24 (06)
  • [4] Redundancy-Controlled Feature Selection for Fuzzy Neural Networks
    Gao, Tao
    Bai, Xiao
    Zhang, Liang
    Wang, Chen
    Wang, Jian
    2021 INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE BIG DATA AND INTELLIGENT SYSTEMS (HPBD&IS), 2021, : 172 - 176
  • [5] Feature Selection Using a Neural Framework With Controlled Redundancy
    Chakraborty, Rudrasis
    Pal, Nikhil R.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2015, 26 (01) : 35 - 50
  • [6] Group Lasso based redundancy-controlled feature selection for fuzzy neural network
    Yang, Jun
    Xu, Yongyong
    Wang, Bin
    Li, Bo
    Huang, Ming
    Gao, Tao
    OPTOELECTRONICS LETTERS, 2023, 19 (05) : 284 - 289
  • [7] Group Lasso based redundancy-controlled feature selection for fuzzy neural network
    YANG Jun
    XU Yongyong
    WANG Bin
    LI Bo
    HUANG Ming
    GAO Tao
    Optoelectronics Letters, 2023, 19 (05) : 284 - 289
  • [8] Group Lasso based redundancy-controlled feature selection for fuzzy neural network
    Jun Yang
    Yongyong Xu
    Bin Wang
    Bo Li
    Ming Huang
    Tao Gao
    Optoelectronics Letters, 2023, 19 : 284 - 289
  • [9] Feature Selection for Neural Networks Using Group Lasso Regularization
    Zhang, Huaqing
    Wang, Jian
    Sun, Zhanquan
    Zurada, Jacek M.
    Pal, Nikhil R.
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2020, 32 (04) : 659 - 673
  • [10] Feature Selection for Fuzzy Neural Networks using Group Lasso Regularization
    Gao, Tao
    Bai, Xiao
    Zhang, Liang
    Wang, Jian
    2021 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2021), 2021,