Fairness in Survival Analysis with Distributionally Robust Optimization

被引:0
|
作者
Hu, Shu [1 ]
Chen, George H. [2 ]
机构
[1] Purdue Univ, Dept Comp & Informat Technol, Indianapolis, IN 46202 USA
[2] Carnegie Mellon Univ, Heinz Coll Informat Syst & Publ Policy, Pittsburgh, PA 15213 USA
关键词
survival analysis; fairness; distributionally robust optimization; MODEL;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We propose a general approach for encouraging fairness in survival analysis models that is based on minimizing a worst-case error across all subpopulations that are "large enough" (occurring with at least a user-specified probability threshold). This approach can be used to convert a wide variety of existing survival analysis models into ones that simultaneously encourage fairness, without requiring the user to specify which attributes or features to treat as sensitive in the training loss function. From a technical standpoint, our approach applies recent methodological developments of distributionally robust optimization (DRO) to survival analysis. The complication is that existing DRO theory uses a training loss function that decomposes across contributions of individual data points, i.e., any term that shows up in the loss function depends only on a single training point. This decomposition does not hold for commonly used survival loss functions, including for the standard Cox proportional hazards model, its deep neural network variants, and many other recently developed survival analysis models that use loss functions involving ranking or similarity score calculations. We address this technical hurdle using a sample splitting strategy. We demonstrate our sample splitting DRO approach by using it to create fair versions of a diverse set of existing survival analysis models including the classical Cox model (and its deep neural network variant DeepSurv), the discrete-time model DeepHit, and the neural ODE model SODEN. We also establish a finite-sample theoretical guarantee to show what our sample splitting DRO loss converges to. Specifically for the Cox model, we further derive an exact DRO approach that does not use sample splitting. For all the survival models that we convert into DRO variants, we show that the DRO variants often score better on recently established fairness metrics (without incurring a significant drop in accuracy) compared to existing survival analysis fairness regularization techniques, including ones which directly use sensitive demographic information in their training loss functions.
引用
收藏
页码:1 / 85
页数:85
相关论文
共 50 条
  • [41] Exploiting partial correlations in distributionally robust optimization
    Padmanabhan, Divya
    Natarajan, Karthik
    Murthy, Karthyek
    MATHEMATICAL PROGRAMMING, 2021, 186 (1-2) : 209 - 255
  • [42] Wasserstein Distributionally Robust Inverse Multiobjective Optimization
    Dong, Chaosheng
    Zeng, Bo
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 5914 - 5921
  • [43] Robust Grouped Variable Selection Using Distributionally Robust Optimization
    Ruidi Chen
    Ioannis Ch. Paschalidis
    Journal of Optimization Theory and Applications, 2022, 194 : 1042 - 1071
  • [44] Discrete Approximation and Quantification in Distributionally Robust Optimization
    Liu, Yongchao
    Pichler, Alois
    Xu, Huifu
    MATHEMATICS OF OPERATIONS RESEARCH, 2019, 44 (01) : 19 - 37
  • [45] Distributionally Robust Optimization and Its Tractable Approximations
    Goh, Joel
    Sim, Melvyn
    OPERATIONS RESEARCH, 2010, 58 (04) : 902 - 917
  • [46] MATHEMATICAL FOUNDATIONS OF DISTRIBUTIONALLY ROBUST MULTISTAGE OPTIMIZATION
    Pichler, Alois
    Shapiro, Alexander
    SIAM JOURNAL ON OPTIMIZATION, 2021, 31 (04) : 3044 - 3067
  • [47] DISTRIBUTIONALLY ROBUST OPTIMIZATION: A REVIEW ON THEORY AND APPLICATIONS
    Lin, Fengming
    Fang, Xiaolei
    Gao, Zheming
    NUMERICAL ALGEBRA CONTROL AND OPTIMIZATION, 2022, 12 (01): : 159 - 212
  • [48] Distributionally Robust Stochastic Optimization with Wasserstein Distance
    Gao, Rui
    Kleywegt, Anton
    MATHEMATICS OF OPERATIONS RESEARCH, 2023, 48 (02) : 603 - 655
  • [49] Distributionally Robust Linear and Discrete Optimization with Marginals
    Chen, Louis
    Ma, Will
    Natarajan, Karthik
    Simchi-Levi, David
    Yan, Zhenzhen
    OPERATIONS RESEARCH, 2022, : 1 - 13
  • [50] Coresets for Wasserstein Distributionally Robust Optimization Problems
    Huang, Ruomin
    Huang, Jiawei
    Liu, Wenjie
    Ding, Hu
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,