The Effect of High Leverage Points on the Maximum Estimated Likelihood for Separation in Logistic Regression

被引:1
|
作者
Ariffin, Syaiba Balqish [1 ]
Midi, Habshah [1 ,2 ]
Arasan, Jayanthi [1 ,2 ]
Rana, Md Sohel [1 ,2 ]
机构
[1] Univ Putra Malaysia, Fac Sci, Dept Math, Upm Serdang 43400, Selangor, Malaysia
[2] Univ Putra Malaysia, Inst Math Res, Upm Serdang 43400, Selangor, Malaysia
关键词
Maximum Likelihood; Maximum Estimated Likelihood; Separation; High Leverage Points;
D O I
10.1063/1.4907472
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This article is concerned with the performance of the maximum estimated likelihood estimator in the presence of separation in the space of the independent variables and high leverage points. The maximum likelihood estimator suffers from the problem of non overlap cases in the covariates where the regression coefficients are not identifiable and the maximum likelihood estimator does not exist. Consequently, iteration scheme fails to converge and gives faulty results. To remedy this problem, the maximum estimated likelihood estimator is put forward. It is evident that the maximum estimated likelihood estimator is resistant against separation and the estimates always exist. The effect of high leverage points are then investigated on the performance of maximum estimated likelihood estimator through real data sets and Monte Carlo simulation study. The findings signify that the maximum estimated likelihood estimator fails to provide better parameter estimates in the presence of both separation, and high leverage points.
引用
收藏
页码:402 / 408
页数:7
相关论文
共 50 条
  • [1] Identification of multiple high leverage points in logistic regression
    Imon, A. H. M. Rahmatullah
    Hadi, Ali S.
    [J]. JOURNAL OF APPLIED STATISTICS, 2013, 40 (12) : 2601 - 2616
  • [2] Identification of High Leverage Points in Binary Logistic Regression
    Fitrianto, Anwar
    Wendy, Tham
    [J]. 4TH INTERNATIONAL CONFERENCE ON QUANTITATIVE SCIENCES AND ITS APPLICATIONS (ICOQSIA 2016), 2016, 1782
  • [3] The Effect of High Leverage Points on the Logistic Ridge Regression Estimator Having Multicollinearity
    Ariffin, Syaiba Balqish
    Midi, Habshah
    [J]. PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON MATHEMATICAL SCIENCES, 2014, 1602 : 1105 - 1111
  • [4] Maximum Likelihood Logistic Regression Using Metaheuristics
    Peterson, Leif E.
    [J]. EIGHTH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, PROCEEDINGS, 2009, : 509 - 514
  • [5] A preliminary investigation of maximum likelihood logistic regression versus exact logistic regression
    King, EN
    Ryan, TP
    [J]. AMERICAN STATISTICIAN, 2002, 56 (03): : 163 - 170
  • [6] A modern maximum-likelihood theory for high-dimensional logistic regression
    Sur, Pragya
    Candes, Emmanuel J.
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2019, 116 (29) : 14516 - 14525
  • [7] On the existence of maximum likelihood estimates for weighted logistic regression
    Zeng, Guoping
    [J]. COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2017, 46 (22) : 11194 - 11203
  • [8] THE PHASE TRANSITION FOR THE EXISTENCE OF THE MAXIMUM LIKELIHOOD ESTIMATE IN HIGH-DIMENSIONAL LOGISTIC REGRESSION
    Candes, Emmanuel J.
    Sur, Pragya
    [J]. ANNALS OF STATISTICS, 2020, 48 (01): : 27 - 42
  • [9] Maximum Likelihood and Firth Logistic Regression of the Pedestrian Route Choice
    Gim, Tae-Hyoung Tommy
    Ko, Joonho
    [J]. INTERNATIONAL REGIONAL SCIENCE REVIEW, 2017, 40 (06) : 616 - 637
  • [10] Maximum likelihood estimation in the logistic regression model with a cure fraction
    Diop, Aba
    Diop, Aliou
    Dupuy, Jean-Francois
    [J]. ELECTRONIC JOURNAL OF STATISTICS, 2011, 5 : 460 - 483