Robust generalised quadratic discriminant analysis

被引:15
|
作者
Ghosh, Abhik [1 ,2 ]
SahaRay, Rita [1 ]
Chakrabarty, Sayan [3 ]
Bhadra, Sayan [1 ]
机构
[1] Indian Stat Inst, Interdisciplinary Stat Res Unit, Kolkata 700108, India
[2] Indian Stat Inst, Ctr Artificial Intelligence & Machine Learning, Kolkata, India
[3] Univ Illinois, Dept Stat, Champaign, IL 61820 USA
关键词
Linear discriminant analysis; Quadratic discriminant analysis; Generalized quadratic discriminant analysis; Robust estimators; MULTIVARIATE LOCATION; GROUP CLASSIFICATION; M-ESTIMATORS; SAMPLE-SIZE; PERFORMANCE; REGRESSION; ALGORITHM; BEHAVIOR;
D O I
10.1016/j.patcog.2021.107981
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Quadratic discriminant analysis (QDA) is a widely used statistical tool to classify observations from different multivariate Normal populations. The generalized quadratic discriminant analysis (GQDA) classification rule/classifier, which generalizes the QDA and the minimum Mahalanobis distance (MMD) classifiers to discriminate between populations with underlying elliptically symmetric distributions competes quite favorably with the QDA classifier when it is optimal and performs much better when QDA fails under non-Normal underlying distributions with heavy tail, e.g. Cauchy distribution. However, the classification rule in GQDA is still based on the sample mean vector and the sample dispersion matrix of a training set, which are extremely non-robust under data contamination. In real world, however, it is quite common to face data which are highly vulnerable to outliers and so the lack of robustness of the classical estimators of the mean vector and the dispersion matrix reduces the efficiency of the GQDA classifier significantly, increasing the misclassification errors. The present paper investigates the performance of the GQDA classifier when the classical estimators of the mean vector and the dispersion matrix used therein are replaced by various robust counterparts. Applications to various real data sets as well as simulation studies reveal far better performance of the proposed robust versions of the GQDA classifier. A comparative study has been made to advocate the appropriate choice of the robust estimators to be used in a specific situation. (c) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Robust quadratic discriminant analysis using Sn covariance
    Sajana, O. K.
    Sajesh, T. A.
    [J]. COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2023, 52 (03) : 735 - 744
  • [2] New robust quadratic discriminant function
    Sakai, N
    Yoneda, M
    Hase, H
    [J]. FOURTEENTH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOLS 1 AND 2, 1998, : 99 - 102
  • [3] An Improved Binary Quadratic Discriminant Analysis Classifier by Using Robust Regularization
    Zaib, Alam
    Khattak, Shahid
    Mujtaba, Ghulam
    Khan, Shahid
    Al-Rasheed, Amal
    [J]. IEEE ACCESS, 2024, 12 : 114951 - 114960
  • [4] Empirical comparison of the classification performance of robust linear and quadratic discriminant analysis
    Joossens, K
    Croux, C
    [J]. THEORY AND APPLICATION OF RECENT ROBUST METHODS, 2004, : 131 - 140
  • [5] Multiple kernels for generalised discriminant analysis
    Liang, Z.
    Li, Y.
    [J]. IET COMPUTER VISION, 2010, 4 (02) : 117 - 128
  • [6] Quadratic discriminant analysis by projection
    Wu, Ruiyang
    Hao, Ning
    [J]. JOURNAL OF MULTIVARIATE ANALYSIS, 2022, 190
  • [7] Bayesian quadratic discriminant analysis
    Srivastava, Santosh
    Gupta, Maya R.
    Frigyik, Bela A.
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2007, 8 : 1277 - 1305
  • [8] Generalized quadratic discriminant analysis
    Bose, Smarajit
    Pal, Amita
    SahaRay, Rita
    Nayak, Jitadeepa
    [J]. PATTERN RECOGNITION, 2015, 48 (08) : 2676 - 2684
  • [9] Robust discriminant analysis
    Hubert, Mia
    Raymaekers, Jakob
    Rousseeuw, Peter J.
    [J]. WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL STATISTICS, 2024, 16 (05):
  • [10] Graphical tools for quadratic discriminant analysis
    Pardoe, Iain
    Yin, Xiangrong
    Cook, R. Dennis
    [J]. TECHNOMETRICS, 2007, 49 (02) : 172 - 183