Regularization in discriminant analysis: An overview

被引:20
|
作者
Mkhadri, A [1 ]
Celeux, G [1 ]
Nasroallah, A [1 ]
机构
[1] CADI AYYAD UNIV,MARRAKECH,MOROCCO
关键词
regularized discriminant analysis; predictive discrimination; spectral decomposition; dependence tree; ridge logistic model;
D O I
10.1016/S0167-9473(96)00043-6
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper presents an overview of regularized techniques in discriminant analysis. The case of continuous variables is treated first, and then the case of discrete variables. Three types of approaches are distinguished: combining standard methods, constraining models and Bayesian modelling. We include numerical experiments to assess the efficiency of regularized versions of predictive discrimination and to illustrate the superiority of regularization on variable subset selection in a small sample setting.
引用
收藏
页码:403 / 423
页数:21
相关论文
共 50 条
  • [1] A simple regularization procedure for discriminant analysis
    Nocairi, H.
    Qannari, E. M.
    Hanafi, M.
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2006, 35 (04) : 957 - 967
  • [2] Linear discriminant analysis with spectral regularization
    Xin Shu
    Hongtao Lu
    Applied Intelligence, 2014, 40 : 724 - 731
  • [3] Linear Discriminant Analysis with Adherent Regularization
    Hino, Hideitsu
    LATENT VARIABLE ANALYSIS AND SIGNAL SEPARATION, LVA/ICA 2015, 2015, 9237 : 368 - 375
  • [4] Linear discriminant analysis with spectral regularization
    Shu, Xin
    Lu, Hongtao
    APPLIED INTELLIGENCE, 2014, 40 (04) : 724 - 731
  • [5] Sparse regularization discriminant analysis for face recognition
    Yin, Fei
    Jiao, L. C.
    Shang, Fanhua
    Xiong, Lin
    Wang, Xiaodong
    NEUROCOMPUTING, 2014, 128 : 341 - 362
  • [6] Discriminant Analysis via Smoothly Varying Regularization
    Yoshida, Hisao
    Kawano, Shuichi
    Ninomiya, Yoshiyuki
    INTELLIGENT DECISION TECHNOLOGIES, KES-IDT 2021, 2021, 238 : 441 - 455
  • [7] Optimal Regularization Parameter Estimation for Regularized Discriminant Analysis
    Zhu, Lin
    ADVANCED INTELLIGENT COMPUTING, 2011, 6838 : 77 - 82
  • [8] Uncorrelated multilinear discriminant analysis with regularization for gait recognition
    Lu, Haiping
    Plataniotis, K. N.
    Venetsanopoulos, A. N.
    2007 BIOMETRICS SYMPOSIUM, 2007, : 66 - 71
  • [9] DISCRIMINANT ANALYSIS REGULARIZATION IN LIGHTWEIGHT DEEP CNN MODELS
    Tzelepi, Maria
    Tefas, Anastasios
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 3841 - 3845
  • [10] Optimal Regularization Parameter Estimation for Spectral Regression Discriminant Analysis
    Chen, Wei
    Shan, Caifeng
    de Haan, Gerard
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2009, 19 (12) : 1921 - 1926