Regularization in discriminant analysis: An overview

被引:20
|
作者
Mkhadri, A [1 ]
Celeux, G [1 ]
Nasroallah, A [1 ]
机构
[1] CADI AYYAD UNIV,MARRAKECH,MOROCCO
关键词
regularized discriminant analysis; predictive discrimination; spectral decomposition; dependence tree; ridge logistic model;
D O I
10.1016/S0167-9473(96)00043-6
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper presents an overview of regularized techniques in discriminant analysis. The case of continuous variables is treated first, and then the case of discrete variables. Three types of approaches are distinguished: combining standard methods, constraining models and Bayesian modelling. We include numerical experiments to assess the efficiency of regularized versions of predictive discrimination and to illustrate the superiority of regularization on variable subset selection in a small sample setting.
引用
收藏
页码:403 / 423
页数:21
相关论文
共 50 条
  • [41] Nonnegative matrix factorization with manifold regularization and maximum discriminant information
    Hu, Wenjun
    Choi, Kup-Sze
    Tao, Jianwen
    Jiang, Yunliang
    Wang, Shitong
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2015, 6 (05) : 837 - 846
  • [42] Exponential Discriminant Regularization Using Nonnegative Constraint and Image Descriptor
    Ahmed, Nasir
    2013 IEEE 9TH INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES (ICET 2013), 2013, : 227 - 232
  • [43] Support Vector Machine Model with Discriminant Graph Regularization Term
    Chen, Xiaoyun
    Li, Hui
    Zhang, Haiwu
    2015 SEVENTH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE (ICACI), 2015, : 361 - 365
  • [44] Nonnegative matrix factorization with manifold regularization and maximum discriminant information
    Wenjun Hu
    Kup-Sze Choi
    Jianwen Tao
    Yunliang Jiang
    Shitong Wang
    International Journal of Machine Learning and Cybernetics, 2015, 6 : 837 - 846
  • [45] Multi-modal graph regularization based class center discriminant analysis for cross modal retrieval
    Zhang, Meijia
    Zhang, Huaxiang
    Lie, Junzheng
    Fang, Yixian
    Wang, Li
    Shang, Fei
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (19) : 28285 - 28307
  • [46] Multi-modal graph regularization based class center discriminant analysis for cross modal retrieval
    Meijia Zhang
    Huaxiang Zhang
    Junzheng Li
    Yixian Fang
    Li Wang
    Fei Shang
    Multimedia Tools and Applications, 2019, 78 : 28285 - 28307
  • [47] Comparison of regularized discriminant analysis, linear discriminant analysis and quadratic discriminant analysis, applied to NIR data
    Wu, W
    Mallet, Y
    Walczak, B
    Penninckx, W
    Massart, DL
    Heuerding, S
    Erni, F
    ANALYTICA CHIMICA ACTA, 1996, 329 (03) : 257 - 265
  • [48] DISCRIMINANT ANALYSIS
    BAUER, RK
    BIOMETRICS, 1954, 10 (02) : 312 - 312
  • [49] DISCRIMINANT ANALYSIS
    EKLUND, G
    SCANDINAVIAN JOURNAL OF CLINICAL & LABORATORY INVESTIGATION, 1970, 26 (04): : 305 - &
  • [50] AN OVERVIEW OF INVERSE PROBLEM REGULARIZATION USING SPARSITY
    Starck, J. -L.
    Fadili, M. J.
    2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, : 1453 - +