Explainability and Fairness in Machine Learning: Improve Fair End-to-end Lending for Kiva

被引:0
|
作者
Stevens, Alexander [1 ]
Deruyck, Peter [1 ]
Van Veldhoven, Ziboud [1 ]
Vanthienen, Jan [1 ]
机构
[1] Katholieke Univ Leuven, Res Ctr Informat Syst Engn LIRIS, Leuven, Belgium
关键词
explainable artificial intelligence; XAI; machine learning; fairness;
D O I
10.1109/ssci47803.2020.9308371
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Artificial Intelligence is finding its way to ever more applications. Nonetheless, it is increasingly required that decision-making procedures must be explainable and fair. As many applications are based on black-box models, there is a strong need for more explainable AI algorithms. For this reason, our paper explores the practical implications and effectiveness of four bias mitigation algorithms (learning fair representations, reweighing, Equality of Odds, and Reject Option based Classification) based on a standard XGBoost classifier to build an explainable and fair prediction model on a real-world loan dataset. The models were evaluated based on their performance, fairness, and explainability. Potential biases, i.e. fairness, were detected with the use of NLP techniques and evaluated with the AIF360 metrics, whereas the explainability of the model was tested by post-hoc explanations (SHAP method). The best results were obtained by the reweighing algorithm that improved the fairness while maintaining a high model performance and explainability.
引用
收藏
页码:1241 / 1248
页数:8
相关论文
共 50 条
  • [1] Holistic Explainability Requirements for End-to-End Machine Learning in IoT Cloud Systems
    My-Linh Nguyen
    Thao Phung
    Duong-Hai Ly
    Hong-Linh Truong
    [J]. 29TH IEEE INTERNATIONAL REQUIREMENTS ENGINEERING CONFERENCE WORKSHOPS (REW 2021), 2021, : 188 - 194
  • [2] End-to-end fairness analysis of fair queuing networks
    Kaur, J
    Vin, HM
    [J]. 23RD IEEE REAL-TIME SYSTEMS SYMPOSIUM, PROCEEDINGS, 2002, : 49 - 58
  • [3] End-to-End Learning for Fair Ranking Systems
    Kotary, James
    Fioretto, Ferdinando
    Van Hentenryck, Pascal
    Zhu, Ziwei
    [J]. PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, : 3520 - 3530
  • [4] Novel Contract-based Runtime Explainability Framework for End-to-End Ensemble Machine Learning Serving
    Minh-Tri Nguyen
    Hong-Linh Truong
    Tram Truong-Huu
    [J]. PROCEEDINGS 2024 IEEE/ACM 3RD INTERNATIONAL CONFERENCE ON AI ENGINEERING-SOFTWARE ENGINEERING FOR AI, CAIN 2024, 2024, : 234 - 244
  • [5] Intrinsic Explainability for End-to-End Object Detection
    Fernandes, Luis
    Fernandes, Joao N. D.
    Calado, Mariana
    Pinto, Joao Ribeiro
    Cerqueira, Ricardo
    Cardoso, Jaime S.
    [J]. IEEE ACCESS, 2024, 12 : 2623 - 2634
  • [6] End-to-end Machine Learning using Kubeflow
    George, Johnu
    Saha, Amit
    [J]. PROCEEDINGS OF THE 5TH JOINT INTERNATIONAL CONFERENCE ON DATA SCIENCE & MANAGEMENT OF DATA, CODS COMAD 2022, 2022, : 336 - 338
  • [7] End-to-End Machine Learning with Apache AsterixDB
    Alkowaileet, Wail
    Alsubaiee, Sattam
    Carey, Michael J.
    Li, Chen
    Ramampiaro, Heri
    Sinthong, Phanwadee
    Wang, Xikui
    [J]. PROCEEDINGS OF THE SECOND WORKSHOP ON DATA MANAGEMENT FOR END-TO-END MACHINE LEARNING, 2018,
  • [8] Machine Learning for End-to-End Congestion Control
    Zhang, Ticao
    Mao, Shiwen
    [J]. IEEE COMMUNICATIONS MAGAZINE, 2020, 58 (06) : 52 - 57
  • [9] End-to-end Optimization of Machine Learning Prediction Queries
    Park, Kwanghyun
    Saur, Karla
    Banda, Dalitso
    Interlandi, Rathijit Sen Matteo
    Karanasos, Konstantinos
    [J]. PROCEEDINGS OF THE 2022 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA (SIGMOD '22), 2022, : 587 - 601
  • [10] Provenance Tracking for End-to-End Machine Learning Pipelines
    Grafberger, Stefan
    Groth, Paul
    Schelter, Sebastian
    [J]. COMPANION OF THE WORLD WIDE WEB CONFERENCE, WWW 2023, 2023, : 1512 - 1512