Feature selection using a mutual information based measure

被引:0
|
作者
Al-Ani, A [1 ]
Deriche, M [1 ]
机构
[1] Queensland Univ Technol, Signal Proc Res Ctr, Brisbane, Qld 4001, Australia
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we discuss the problem of feature selection for the purpose of classification and propose a solution based on the concept of mutual information. In addition, we propose a new evaluation function to measure the ability of feature subsets in distinguishing between class labels. The proposed function is based on the information gain and takes into consideration how features work together Finally, we discuss the performance of this function compared to that of other measures which evaluate features individually.
引用
收藏
页码:82 / 85
页数:4
相关论文
共 50 条
  • [41] Quadratic Mutual Information Feature Selection
    Sluga, Davor
    Lotric, Uros
    [J]. ENTROPY, 2017, 19 (04)
  • [42] Normalized Mutual Information Feature Selection
    Estevez, Pablo. A.
    Tesmer, Michel
    Perez, Claudio A.
    Zurada, Jacek A.
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2009, 20 (02): : 189 - 201
  • [43] Mutual Information Criteria for Feature Selection
    Zhang, Zhihong
    Hancock, Edwin R.
    [J]. SIMILARITY-BASED PATTERN RECOGNITION, 2011, 7005 : 235 - 249
  • [44] On Estimating Mutual Information for Feature Selection
    Schaffernicht, Erik
    Kaltenhaeuser, Robert
    Verma, Saurabh Shekhar
    Gross, Horst-Michael
    [J]. ARTIFICIAL NEURAL NETWORKS-ICANN 2010, PT I, 2010, 6352 : 362 - +
  • [45] Feature selection with dynamic mutual information
    Liu, Huawen
    Sun, Jigui
    Liu, Lei
    Zhang, Huijie
    [J]. PATTERN RECOGNITION, 2009, 42 (07) : 1330 - 1339
  • [46] Mutual Information Using Sample Variance for Text Feature Selection
    Agnihotri, Deepak
    Verma, Kesari
    Tripathi, Priyanka
    [J]. PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON COMMUNICATION AND INFORMATION PROCESSING (ICCIP 2017), 2017, : 39 - 44
  • [47] 2DPCA Feature Selection Using Mutual Information
    Sanguansat, Parinya
    [J]. ICCEE 2008: PROCEEDINGS OF THE 2008 INTERNATIONAL CONFERENCE ON COMPUTER AND ELECTRICAL ENGINEERING, 2008, : 578 - 581
  • [48] Feature Selection in Regression Tasks Using Conditional Mutual Information
    Latorre Carmona, Pedro
    Sotoca, Jose M.
    Pla, Filiberto
    Phoa, Frederick K. H.
    Dias, Jose Bioucas
    [J]. PATTERN RECOGNITION AND IMAGE ANALYSIS: 5TH IBERIAN CONFERENCE, IBPRIA 2011, 2011, 6669 : 224 - 231
  • [49] A new algorithm for EEG feature selection using mutual information
    Deriche, M
    Al-Ani, A
    [J]. 2001 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS I-VI, PROCEEDINGS: VOL I: SPEECH PROCESSING 1; VOL II: SPEECH PROCESSING 2 IND TECHNOL TRACK DESIGN & IMPLEMENTATION OF SIGNAL PROCESSING SYSTEMS NEURALNETWORKS FOR SIGNAL PROCESSING; VOL III: IMAGE & MULTIDIMENSIONAL SIGNAL PROCESSING MULTIMEDIA SIGNAL PROCESSING, 2001, : 1057 - 1060
  • [50] Using clustering and dynamic mutual information for topic feature selection
    Xu, Jian-min
    Wu, Shu Fang
    Zhu, Jie
    [J]. JOURNAL OF THE SOCIETY FOR INFORMATION DISPLAY, 2014, 22 (11) : 572 - 580