Fairness in Survival Analysis with Distributionally Robust Optimization

被引:0
|
作者
Hu, Shu [1 ]
Chen, George H. [2 ]
机构
[1] Purdue Univ, Dept Comp & Informat Technol, Indianapolis, IN 46202 USA
[2] Carnegie Mellon Univ, Heinz Coll Informat Syst & Publ Policy, Pittsburgh, PA 15213 USA
关键词
survival analysis; fairness; distributionally robust optimization; MODEL;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We propose a general approach for encouraging fairness in survival analysis models that is based on minimizing a worst-case error across all subpopulations that are "large enough" (occurring with at least a user-specified probability threshold). This approach can be used to convert a wide variety of existing survival analysis models into ones that simultaneously encourage fairness, without requiring the user to specify which attributes or features to treat as sensitive in the training loss function. From a technical standpoint, our approach applies recent methodological developments of distributionally robust optimization (DRO) to survival analysis. The complication is that existing DRO theory uses a training loss function that decomposes across contributions of individual data points, i.e., any term that shows up in the loss function depends only on a single training point. This decomposition does not hold for commonly used survival loss functions, including for the standard Cox proportional hazards model, its deep neural network variants, and many other recently developed survival analysis models that use loss functions involving ranking or similarity score calculations. We address this technical hurdle using a sample splitting strategy. We demonstrate our sample splitting DRO approach by using it to create fair versions of a diverse set of existing survival analysis models including the classical Cox model (and its deep neural network variant DeepSurv), the discrete-time model DeepHit, and the neural ODE model SODEN. We also establish a finite-sample theoretical guarantee to show what our sample splitting DRO loss converges to. Specifically for the Cox model, we further derive an exact DRO approach that does not use sample splitting. For all the survival models that we convert into DRO variants, we show that the DRO variants often score better on recently established fairness metrics (without incurring a significant drop in accuracy) compared to existing survival analysis fairness regularization techniques, including ones which directly use sensitive demographic information in their training loss functions.
引用
收藏
页码:1 / 85
页数:85
相关论文
共 50 条
  • [1] Distributionally Robust Survival Analysis: A Novel Fairness Loss Without Demographics
    Hu, Shu
    Chen, George H.
    MACHINE LEARNING FOR HEALTH, VOL 193, 2022, 193 : 62 - 87
  • [2] DISTRIBUTIONALLY ROBUST OPTIMIZATION WITH PRINCIPAL COMPONENT ANALYSIS
    Cheng, Jianqiang
    Chen, Richard Li-Yang
    Najm, Habib N.
    Pinar, Ali
    Safta, Cosmin
    Watson, Jean-Paul
    SIAM JOURNAL ON OPTIMIZATION, 2018, 28 (02) : 1817 - 1841
  • [3] Sensitivity analysis of Wasserstein distributionally robust optimization problems
    Bartl, Daniel
    Drapeau, Samuel
    Obloj, Jan
    Wiesel, Johannes
    PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2021, 477 (2256):
  • [4] Convergence Analysis for Distributionally Robust Optimization and Equilibrium Problems
    Sun, Hailin
    Xu, Huifu
    MATHEMATICS OF OPERATIONS RESEARCH, 2016, 41 (02) : 377 - 401
  • [5] Nonlinear distributionally robust optimization
    Sheriff, Mohammed Rayyan
    Esfahani, Peyman Mohajerin
    MATHEMATICAL PROGRAMMING, 2024,
  • [6] Adaptive Distributionally Robust Optimization
    Bertsimas, Dimitris
    Sim, Melvyn
    Zhang, Meilin
    MANAGEMENT SCIENCE, 2019, 65 (02) : 604 - 618
  • [7] BAYESIAN DISTRIBUTIONALLY ROBUST OPTIMIZATION
    Shapiro, Alexander
    Zhou, Enlu
    Lin, Yifan
    SIAM JOURNAL ON OPTIMIZATION, 2023, 33 (02) : 1279 - 1304
  • [8] Distributionally Robust Portfolio Optimization
    Bardakci, I. E.
    Lagoa, C. M.
    2019 IEEE 58TH CONFERENCE ON DECISION AND CONTROL (CDC), 2019, : 1526 - 1531
  • [9] Distributionally Robust Bayesian Optimization
    Kirschner, Johannes
    Bogunovic, Ilija
    Jegelka, Stefanie
    Krause, Andreas
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 108, 2020, 108 : 1921 - 1930
  • [10] Distributionally Robust Convex Optimization
    Wiesemann, Wolfram
    Kuhn, Daniel
    Sim, Melvyn
    OPERATIONS RESEARCH, 2014, 62 (06) : 1358 - 1376