Surrogate Ground Truth Generation to Enhance Binary Fairness Evaluation in Uplift Modeling

被引:4
|
作者
Michalsky, Filip [1 ]
Kadioglu, Serdar [1 ]
机构
[1] Fidel Investments, Boston, MA 02110 USA
关键词
binary fairness evaluation; uplift modeling; surrogate models; campaign design problem;
D O I
10.1109/ICMLA52953.2021.00264
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Uplift modeling is used extensively to identify treatment candidates that are more likely to benefit from an intervention. However, the fairness evaluation of such models remains a challenge due to the lack of ground truth on the outcome measure since a candidate cannot be in both treatment and control simultaneously. In this paper, we propose a framework that generates surrogate ground truth to serve as a proxy for counterfactual labels of uplift modeling campaigns. We then leverage the surrogate ground truth to conduct a more comprehensive binary fairness evaluation. We show how to apply the approach in a real-world marketing campaign for promotional offers and demonstrate its enhancement for fairness evaluation.
引用
收藏
页码:1654 / 1659
页数:6
相关论文
共 10 条
  • [1] Binary Classifier Evaluation Without Ground Truth
    Fedorchuk, Maksym
    Lamiroy, Bart
    2017 NINTH INTERNATIONAL CONFERENCE ON ADVANCES IN PATTERN RECOGNITION (ICAPR), 2017, : 145 - 150
  • [2] Statistic Metrics for Evaluation of Binary Classifiers without Ground-Truth
    Fedorchuk, Maksym
    Lamiroy, Bart
    2017 IEEE FIRST UKRAINE CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING (UKRCON), 2017, : 1066 - 1071
  • [3] GENERATION OF AN ACCURATE FACIAL GROUND TRUTH FOR STEREO ALGORITHM EVALUATION
    Woodward, Alexander
    Leclercq, Philippe
    Detunas, Patrice
    Gimer'farb, Georgy
    COMPUTER VISION AND GRAPHICS (ICCVG 2004), 2006, 32 : 534 - 539
  • [4] Ground Truth Generation for Quantitative Performance Evaluation of Localization Methods in Urban Areas
    Takeda, Yuichi
    Tsuchiya, Chikao
    Khiat, Abdelaziz
    2019 30TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV19), 2019, : 1152 - 1158
  • [5] Evaluation of two-view geometry methods with automatic ground-truth generation
    Lakemond, Ruan
    Fookes, Clinton
    Sridharan, Sridha
    IMAGE AND VISION COMPUTING, 2013, 31 (12) : 921 - 934
  • [6] Fast and Accurate Ground Truth Generation for Skew-Tolerance Evaluation of Page Segmentation Algorithms
    Oleg Okun
    Matti Pietikäinen
    EURASIP Journal on Advances in Signal Processing, 2006
  • [7] Fast and accurate ground truth generation for skew-tolerance evaluation of page segmentation algorithms
    Okun, Oleg
    Pietikainen, Matti
    EURASIP JOURNAL ON APPLIED SIGNAL PROCESSING, 2006, 2006 (1) : 1 - 10
  • [8] Automated Breast Ultrasound for Ductal Pattern Reconstruction: Ground Truth File Generation and CADe Evaluation
    Manousaki, D.
    Panagiotopoulou, A.
    Bizimi, V.
    Haynes, M. S.
    Love, S.
    Kallergi, M.
    INTERNATIONAL CONFERENCE ON BIO-MEDICAL INSTRUMENTATION AND RELATED ENGINEERING AND PHYSICAL SCIENCES (BIOMEP 2017), 2017, 931
  • [9] Generation of realistic ground truth images using Radial Basis Functions for the evaluation of DIC algorithms
    Cofaru, Corneliu
    Philips, Wilfried
    Van Paepegem, Wim
    Lava, Pascal
    Debruyne, Dimitri
    OPTICAL MEASUREMENT TECHNIQUES FOR STRUCTURES AND SYSTEMS, 2009, : 111 - +
  • [10] Automatic ground-truth generation for skew-tolerance evaluation of document layout analysis methods
    Okun, O
    Pietikäinen, M
    15TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 4, PROCEEDINGS: APPLICATIONS, ROBOTICS SYSTEMS AND ARCHITECTURES, 2000, : 376 - 379