New approach for feature selection by using information entropy

被引：0
|
作者：
Sun, Lin [1 ]
Xu, Jiucheng [1 ]
Li, Shuangqun [1 ]
Cao, Xizheng [1 ]
Gao, Yunpeng [1 ]
机构：
[1] College of Computer and Information Technology, Henan Normal University, Henan 453007, China
来源：
Journal of Information and Computational Science | 2011年 / 8卷 / 12期
关键词：
Feature Selection - Information use - Data mining - Information systems;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
Feature selection plays an important role in data mining and pattern recognition, and feature evaluation is the key issue for constructing a feature selection algorithm. In this work, we introduce information entropy to propose incomplete information entropy in incomplete information systems, and that in incomplete decision systems. Some important propositions and theorems for reducts are presented. Thus, we construct a forward greedy algorithm for feature selection. Theoretical analysis indicates that the new approach is suitable for not only both complete and incomplete information systems, but also both complete and incomplete decision systems, especially large ones. Furthermore, experimental results demonstrate that the proposed technique is effective and efficient. 1548-7741/Copyright © 2011 Binary Information Press.
引用
收藏
页码：2259 / 2268
相关论文
共 50 条
  • [1] An incremental feature selection approach based on information entropy for incomplete data
    Luo, Chuan
    Li, Tianrui
    Yi, Zhang
    IEEE 17TH INT CONF ON DEPENDABLE, AUTONOM AND SECURE COMP / IEEE 17TH INT CONF ON PERVAS INTELLIGENCE AND COMP / IEEE 5TH INT CONF ON CLOUD AND BIG DATA COMP / IEEE 4TH CYBER SCIENCE AND TECHNOLOGY CONGRESS (DASC/PICOM/CBDCOM/CYBERSCITECH), 2019, : 483 - 488
  • [2] A New Approach in Feature Subset Selection Based on Fuzzy Entropy Concept
    Ghaffarian, Hossein
    Parvin, Hamid
    Minaei, Behrouz
    2009 14TH INTERNATIONAL COMPUTER CONFERENCE, 2009, : 60 - 64
  • [3] Analysis of the GRNs Inference by Using Tsallis Entropy and a Feature Selection Approach
    Lopes, Fabricio M.
    de Oliveira, Evaldo A.
    Cesar-, Roberto M., Jr.
    PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS, COMPUTER VISION, AND APPLICATIONS, PROCEEDINGS, 2009, 5856 : 473 - 480
  • [4] Feature selection based on rough set and information entropy
    Han, JC
    2005 IEEE INTERNATIONAL CONFERENCE ON GRANULAR COMPUTING, VOLS 1 AND 2, 2005, : 153 - 158
  • [5] Feature selection based on the measurement of correlation information entropy
    Dong H.
    Teng X.
    Yang X.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2016, 53 (08): : 1684 - 1695
  • [6] An Unsupervised Feature Selection Method Based on Information Entropy
    Wang, Xiaohong
    He, Yidi
    Wang, Lizhi
    Wang, Zhongxing
    2018 3RD INTERNATIONAL CONFERENCE ON SYSTEM RELIABILITY AND SAFETY (ICSRS), 2018, : 35 - 39
  • [7] An information theoretic approach for feature selection
    Kumar, Gulshan
    Kumar, Krishan
    SECURITY AND COMMUNICATION NETWORKS, 2012, 5 (02) : 178 - 185
  • [8] Subject recognition using a new approach for feature selection
    Lapedriza, Agata
    Masip, David
    Vitria, Jordi
    VISAPP 2008: PROCEEDINGS OF THE THIRD INTERNATIONAL CONFERENCE ON COMPUTER VISION THEORY AND APPLICATIONS, VOL 2, 2008, : 61 - +
  • [9] A new algorithm for EEG feature selection using mutual information
    Deriche, M
    Al-Ani, A
    2001 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS I-VI, PROCEEDINGS: VOL I: SPEECH PROCESSING 1; VOL II: SPEECH PROCESSING 2 IND TECHNOL TRACK DESIGN & IMPLEMENTATION OF SIGNAL PROCESSING SYSTEMS NEURALNETWORKS FOR SIGNAL PROCESSING; VOL III: IMAGE & MULTIDIMENSIONAL SIGNAL PROCESSING MULTIMEDIA SIGNAL PROCESSING, 2001, : 1057 - 1060
  • [10] An improved document classification approach with maximum entropy and entropy feature selection
    Pang, Xiu-Li
    Feng, Yu-Qiang
    Jiang, Wei
    PROCEEDINGS OF 2007 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2007, : 3911 - +
12345