Deeply Learned Generalized Linear Models with Missing Data

被引:0
|
作者
Lim, David K. [1 ]
Rashid, Naim U. [1 ]
Oliva, Junier B. [2 ]
Ibrahim, Joseph G. [1 ]
机构
[1] Univ North Carolina Chapel Hill, Dept Biostat, Chapel Hill, NC 27515 USA
[2] Univ North Carolina Chapel Hill, Dept Comp Sci, Chapel Hill, NC USA
关键词
Deeply learned glm; Missing data; MNAR; Supervised learning; IMPUTATION;
D O I
10.1080/10618600.2023.2276122
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Deep Learning (DL) methods have dramatically increased in popularity in recent years, with significant growth in their application to various supervised learning problems. However, the greater prevalence and complexity of missing data in such datasets present significant challenges for DL methods. Here, we provide a formal treatment of missing data in the context of deeply learned generalized linear models, a supervised DL architecture for regression and classification problems. We propose a new architecture, dlglm, that is one of the first to be able to flexibly account for both ignorable and non-ignorable patterns of missingness in input features and response at training time. We demonstrate through statistical simulation that our method outperforms existing approaches for supervised learning tasks in the presence of missing not at random (MNAR) missingness. We conclude with a case study of the Bank Marketing dataset from the UCI Machine Learning Repository, in which we predict whether clients subscribed to a product based on phone survey data. Supplementary materials for this article are available online.
引用
收藏
页码:638 / 650
页数:13
相关论文
共 50 条
  • [12] Approximate Conditional Likelihood for Generalized Linear Models with General Missing Data Mechanism
    ZHAO Jiwei
    SHAO Jun
    Journal of Systems Science & Complexity, 2017, 30 (01) : 139 - 153
  • [13] GENERALIZED LINEAR MODELS - THE MISSING LINK.
    Cox, Christopher
    Applied Statistics, 1984, 33 (01): : 18 - 24
  • [14] Diagnostic Measures for Generalized Linear Models with Missing Covariates
    Zhu, Hongtu
    Ibrahim, Joseph G.
    Shi, Xiaoyan
    SCANDINAVIAN JOURNAL OF STATISTICS, 2009, 36 (04) : 686 - 712
  • [15] Empirical likelihood for generalized linear models with missing responses
    Xue, Dong
    Xue, Liugen
    Cheng, Weihu
    JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2011, 141 (06) : 2007 - 2020
  • [16] Robust tests in generalized linear models with missing responses
    Bianco, Ana M.
    Boente, Graciela
    Rodrigues, Isabel M.
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2013, 65 : 80 - 97
  • [17] Local Influence for Generalized Linear Models with Missing Covariates
    Shi, Xiaoyan
    Zhu, Hongtu
    Ibrahim, Joseph G.
    BIOMETRICS, 2009, 65 (04) : 1164 - 1174
  • [18] Bayesian semiparametric models for nonignorable missing mechanisms in generalized linear models
    Kalaylioglu, Z. I.
    Ozturk, O.
    JOURNAL OF APPLIED STATISTICS, 2013, 40 (08) : 1746 - 1763
  • [19] ON THE PROBLEM OF MISSING DATA IN LINEAR-MODELS
    GOURIEROUX, C
    MONFORT, A
    REVIEW OF ECONOMIC STUDIES, 1981, 48 (04): : 579 - 586
  • [20] Missing covariate data in generalized linear mixed models with distribution-free random effects
    Liu, Li
    Xiang, Liming
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2019, 134 : 1 - 16