Fairness in Survival Analysis with Distributionally Robust Optimization

被引:0
|
作者
Hu, Shu [1 ]
Chen, George H. [2 ]
机构
[1] Purdue Univ, Dept Comp & Informat Technol, Indianapolis, IN 46202 USA
[2] Carnegie Mellon Univ, Heinz Coll Informat Syst & Publ Policy, Pittsburgh, PA 15213 USA
关键词
survival analysis; fairness; distributionally robust optimization; MODEL;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We propose a general approach for encouraging fairness in survival analysis models that is based on minimizing a worst-case error across all subpopulations that are "large enough" (occurring with at least a user-specified probability threshold). This approach can be used to convert a wide variety of existing survival analysis models into ones that simultaneously encourage fairness, without requiring the user to specify which attributes or features to treat as sensitive in the training loss function. From a technical standpoint, our approach applies recent methodological developments of distributionally robust optimization (DRO) to survival analysis. The complication is that existing DRO theory uses a training loss function that decomposes across contributions of individual data points, i.e., any term that shows up in the loss function depends only on a single training point. This decomposition does not hold for commonly used survival loss functions, including for the standard Cox proportional hazards model, its deep neural network variants, and many other recently developed survival analysis models that use loss functions involving ranking or similarity score calculations. We address this technical hurdle using a sample splitting strategy. We demonstrate our sample splitting DRO approach by using it to create fair versions of a diverse set of existing survival analysis models including the classical Cox model (and its deep neural network variant DeepSurv), the discrete-time model DeepHit, and the neural ODE model SODEN. We also establish a finite-sample theoretical guarantee to show what our sample splitting DRO loss converges to. Specifically for the Cox model, we further derive an exact DRO approach that does not use sample splitting. For all the survival models that we convert into DRO variants, we show that the DRO variants often score better on recently established fairness metrics (without incurring a significant drop in accuracy) compared to existing survival analysis fairness regularization techniques, including ones which directly use sensitive demographic information in their training loss functions.
引用
收藏
页码:1 / 85
页数:85
相关论文
共 50 条
  • [31] Flow-Based Distributionally Robust Optimization
    Xu C.
    Lee J.
    Cheng X.
    Xie Y.
    IEEE Journal on Selected Areas in Information Theory, 2024, 5 : 62 - 77
  • [32] Distributionally Robust Optimization with Moment Ambiguity Sets
    Nie, Jiawang
    Yang, Liu
    Zhong, Suhan
    Zhou, Guangming
    JOURNAL OF SCIENTIFIC COMPUTING, 2023, 94 (01)
  • [33] Wasserstein Distributionally Robust Optimization and Variation Regularization
    Gao, Rui
    Chen, Xi
    Kleywegtc, Anton J.
    OPERATIONS RESEARCH, 2024, 72 (03) : 1177 - 1191
  • [34] Calibration of Distributionally Robust Empirical Optimization Models
    Gotoh, Jun-ya
    Kim, Michael Jong
    Lim, Andrew E. B.
    OPERATIONS RESEARCH, 2021, 69 (05) : 1630 - 1650
  • [35] Discrete Approximation Scheme in Distributionally Robust Optimization
    Liu, Yongchao
    Yuan, Xiaoming
    Zhang, Jin
    NUMERICAL MATHEMATICS-THEORY METHODS AND APPLICATIONS, 2021, 14 (02): : 285 - 320
  • [36] A Distributionally Robust Optimization Approach for Outlier Detection
    Chen, Ruidi
    Paschalidis, Ioannis Ch.
    2018 IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2018, : 352 - 357
  • [37] Online data assimilation in distributionally robust optimization
    Li, D.
    Martinez, S.
    2018 IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2018, : 1961 - 1966
  • [38] Distributionally Robust Chance Constrained Geometric Optimization
    Liu, Jia
    Lisser, Abdel
    Chen, Zhiping
    MATHEMATICS OF OPERATIONS RESEARCH, 2022, 47 (04) : 2950 - 2988
  • [39] Robust Grouped Variable Selection Using Distributionally Robust Optimization
    Chen, Ruidi
    Paschalidis, Ioannis Ch
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2022, 194 (03) : 1042 - 1071
  • [40] Globalized distributionally robust optimization based on samples
    Li, Yueyao
    Xing, Wenxun
    JOURNAL OF GLOBAL OPTIMIZATION, 2024, 88 (04) : 871 - 900