Regularization in discriminant analysis: An overview

被引:20
|
作者
Mkhadri, A [1 ]
Celeux, G [1 ]
Nasroallah, A [1 ]
机构
[1] CADI AYYAD UNIV,MARRAKECH,MOROCCO
关键词
regularized discriminant analysis; predictive discrimination; spectral decomposition; dependence tree; ridge logistic model;
D O I
10.1016/S0167-9473(96)00043-6
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper presents an overview of regularized techniques in discriminant analysis. The case of continuous variables is treated first, and then the case of discrete variables. Three types of approaches are distinguished: combining standard methods, constraining models and Bayesian modelling. We include numerical experiments to assess the efficiency of regularized versions of predictive discrimination and to illustrate the superiority of regularization on variable subset selection in a small sample setting.
引用
收藏
页码:403 / 423
页数:21
相关论文
共 50 条
  • [31] How to Estimate the Regularization Parameter for Spectral Regression Discriminant Analysis and its Kernel Version?
    Gui, Jie
    Sun, Zhenan
    Cheng, Jun
    Ji, Shuiwang
    Wu, Xindong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2014, 24 (02) : 211 - 223
  • [32] Using Double Regularization to Improve the Effectiveness and Robustness of Fisher Discriminant Analysis as A Projection Technique
    Jiang, Yuechi
    Leung, Frank H. F.
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [33] Clustering Using Local and Global Exponential Discriminant Regularization
    Ahmed, Nasir
    Jalil, Abdul
    Khan, Asifullah
    JOURNAL OF INFORMATION SCIENCE AND ENGINEERING, 2015, 31 (03) : 1149 - 1164
  • [34] Alternative discriminant vectors in LP models and a regularization method
    Xiao, B
    Feng, Y
    ANNALS OF OPERATIONS RESEARCH, 1997, 74 (0) : 113 - 127
  • [35] Alternative discriminant vectors in LP models and a regularization method
    B. Xiao
    Y. Feng
    Annals of Operations Research, 1997, 74 : 113 - 127
  • [36] Clustering using local and global exponential discriminant regularization
    Department of Computer and Information Sciences, Pakistan Institute of Engineering and Applied Sciences, Islamabad
    45650, Pakistan
    J. Inf. Sci. Eng., 3 (1149-1164):
  • [37] Learning shared subspace regularization with linear discriminant analysis for multi-label action recognition
    Jianxin Li
    Minjie Liu
    Dongliang Ma
    Jinyu Huang
    Min Ke
    Tao Zhang
    The Journal of Supercomputing, 2020, 76 : 2139 - 2157
  • [38] Learning shared subspace regularization with linear discriminant analysis for multi-label action recognition
    Li, Jianxin
    Liu, Minjie
    Ma, Dongliang
    Huang, Jinyu
    Ke, Min
    Zhang, Tao
    JOURNAL OF SUPERCOMPUTING, 2020, 76 (03): : 2139 - 2157
  • [39] Regularization studies of linear discriminant analysis in small sample size scenarios with application to face recognition
    Lu, JW
    Plataniotis, KN
    Venetsanopoulos, AN
    PATTERN RECOGNITION LETTERS, 2005, 26 (02) : 181 - 191
  • [40] Discriminant component pruning: Regularization and interpretation of multilayered backpropagation networks
    Koene, RA
    Takane, Y
    NEURAL COMPUTATION, 1999, 11 (03) : 783 - 802