Information discriminant feature extraction based on mutual information gradient optimal computation

被引:0
|
作者
Xie, Wen-Biao [1 ,2 ]
Fan, Shao-Sheng [1 ]
Fei, Hong-Xiao [2 ]
Fan, Xiao-Ping [2 ]
机构
[1] School of Electrical and Information Engineering, Changsha University of Science and Technology, Changsha 410004, China
[2] School of Information Science and Engineering, Central South University, Changsha 410083, China
关键词
Matrix algebra - Discriminant analysis - Feature extraction - Extraction;
D O I
暂无
中图分类号
学科分类号
摘要
A linear feature extraction method is present with information discriminant analysis, it is based on a feasible computationally feature extraction matrix used mutual information gradient. Firstly, this paper analyzes the limitation for current linear discriminant, and constructs a information discriminant analysis model which facilitates the maximization of the mutual information under the parametric class-conditional PDF. Then, it is proved that the mutual information is linear transformation invariance and optimal in the sense of Bayes, and the algorithm is present for computing feature extraction matrix with mutual information gradient. Finally, the good performance of the method is proved on real-world data set.
引用
收藏
页码:2975 / 2979
相关论文
共 50 条
  • [1] Discriminant Mutual Information for Text Feature Selection
    Wang, Jiaqi
    Zhang, Li
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2021), PT II, 2021, 12682 : 136 - 151
  • [2] On the relation between discriminant analysis and mutual information for supervised linear feature extraction
    Petridis, S
    Perantonis, SJ
    PATTERN RECOGNITION, 2004, 37 (05) : 857 - 874
  • [3] Feature extraction based on direct calculation of mutual information
    Kwak, Nojun
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2007, 21 (07) : 1213 - 1231
  • [4] Mutual Information-Based Fisher Discriminant Analysis for Feature Extraction and Recognition with Applications to Medical Diagnosis
    Shadvar, Ali
    Erfanian, Abbas
    2010 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2010, : 5811 - 5814
  • [5] On feature extraction by mutual information maximization
    Torkkola, K
    2002 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS I-IV, PROCEEDINGS, 2002, : 821 - 824
  • [6] Face feature extraction based on principle discriminant information analysis
    Yin, Jianqin
    Li, Yuelong
    Li, Jinping
    2007 IEEE INTERNATIONAL CONFERENCE ON AUTOMATION AND LOGISTICS, VOLS 1-6, 2007, : 1580 - 1584
  • [7] Face Feature Extraction Based on Maximum Discriminant Information Projection
    Lin, Kezheng
    Lin, Sheng
    Wang, Huixin
    PROGRESS IN INTELLIGENCE COMPUTATION AND APPLICATIONS, 2008, : 136 - 140
  • [8] Optimal feature selection based on mutual information for face recognition
    Tang, Xu-Sheng
    Ou, Zong-Ying
    Su, Tie-Ming
    Hu, Qing-Ni
    Hua, Shun-Gang
    Dalian Ligong Daxue Xuebao/Journal of Dalian University of Technology, 2008, 48 (01): : 84 - 89
  • [9] Information discriminant analysis: Feature extraction with an information-theoretic objective
    Nenadic, Zoran
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2007, 29 (08) : 1394 - 1407
  • [10] A Gaussian mixture based maximization of mutual information for supervised feature extraction
    Leiva-Murillo, JM
    Artés-Rodríguez, A
    INDEPENDENT COMPONENT ANALYSIS AND BLIND SIGNAL SEPARATION, 2004, 3195 : 271 - 278