<sc>FairCaipi</sc>: A Combination of Explanatory Interactive and Fair Machine Learning for Human and Machine Bias Reduction

被引:3
|
作者
Heidrich, Louisa [1 ]
Slany, Emanuel [1 ,2 ]
Scheele, Stephan [1 ,2 ]
Schmid, Ute [1 ,2 ]
Cabitza, Federico
Chen, Fang
Zhou, Jianlong
Holzinger, Andreas
机构
[1] Univ Bamberg, Cognit Syst, Weberei 5, D-96047 Bamberg, Germany
[2] Fraunhofer Inst Integrated Circuits IIS, Sensory Percept & Analyt, Comprehensible AI, Wolfsmantel 33, D-91058 Erlangen, Germany
来源
关键词
fair machine learning; explanatory and interactive machine learning;
D O I
10.3390/make5040076
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The rise of machine-learning applications in domains with critical end-user impact has led to a growing concern about the fairness of learned models, with the goal of avoiding biases that negatively impact specific demographic groups. Most existing bias-mitigation strategies adapt the importance of data instances during pre-processing. Since fairness is a contextual concept, we advocate for an interactive machine-learning approach that enables users to provide iterative feedback for model adaptation. Specifically, we propose to adapt the explanatory interactive machine-learning approach Caipi for fair machine learning. FairCaipi incorporates human feedback in the loop on predictions and explanations to improve the fairness of the model. Experimental results demonstrate that FairCaipi outperforms a state-of-the-art pre-processing bias mitigation strategy in terms of the fairness and the predictive performance of the resulting machine-learning model. We show that FairCaipi can both uncover and reduce bias in machine-learning models and allows us to detect human bias.
引用
收藏
页码:1519 / 1538
页数:20
相关论文
共 50 条
  • [21] Leveraging Human Inputs in Interactive Machine Learning for Human Robot Interaction
    Senft, Emmanuel
    Lemaignan, Severin
    Baxter, Paul E.
    Belpaeme, Tony
    COMPANION OF THE 2017 ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION (HRI'17), 2017, : 281 - 282
  • [22] Human face recognition with combination of DWT and machine learning
    Tabassum, Fahima
    Islam, Md. Imdadul
    Khan, Risala Tasin
    Amin, M. R.
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (03) : 546 - 556
  • [23] The Human in Interactive Machine Learning: Analysis and Perspectives for Ambient Intelligence
    Delcourt, Kévin
    Trouilhet, Sylvie
    Arcangeli, Jean-Paul
    Adreit, Françoise
    Journal of Artificial Intelligence Research, 2024, 81 : 263 - 305
  • [24] The Human in Interactive Machine Learning: Analysis and Perspectives for Ambient Intelligence
    Delcourt, Kevin
    Trouilhet, Sylvie
    Arcangeli, Jean-Paul
    Adreit, Francoise
    JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2024, 81 : 263 - 305
  • [25] Human Interactive Machine Learning for Trust in Teams of Autonomous Robots
    Gutzwiller, Robert S.
    Reeder, John
    2017 IEEE CONFERENCE ON COGNITIVE AND COMPUTATIONAL ASPECTS OF SITUATION MANAGEMENT (COGSIMA), 2017,
  • [26] Evolution and impact of bias in human and machine learning algorithm interaction
    Sun, Wenlong
    Nasraoui, Olfa
    Shafto, Patrick
    PLOS ONE, 2020, 15 (08):
  • [27] Interactive Machine Learning for Data Exfiltration Detection: Active Learning with Human Expertise
    Chung, Mu-Huan
    Chignell, Mark
    Wang, Lu
    Jovicic, Alexandra
    Raman, Abhay
    2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 280 - 287
  • [28] Automated Growth Rate Measurement of the Facet Surfaces of Single Crystals of the β-Form of <sc>l</sc>-Glutamic Acid Using Machine Learning Image Processing
    Jiang, Chen
    Ma, Cai Y.
    Hazlehurst, Thomas A.
    Ilett, Thomas P.
    Jackson, Alexander S. M.
    Hogg, David C.
    Roberts, Kevin J.
    CRYSTAL GROWTH & DESIGN, 2024, 24 (08) : 3277 - 3288
  • [29] Proposal of Interactive Projection Mapping using Human Detection by Machine Learning
    Shinoda, Takahiro
    Sakamoto, Makoto
    Ishizu, Takahiro
    Sakamoto, Kenji
    Takei, Amane
    Ito, Takao
    PROCEEDINGS OF THE 2020 INTERNATIONAL CONFERENCE ON ARTIFICIAL LIFE AND ROBOTICS (ICAROB2020), 2020, : 732 - 735
  • [30] Machine learning and human capital complementarities: Experimental evidence on bias mitigation
    Choudhury, Prithwiraj
    Starr, Evan
    Agarwal, Rajshree
    STRATEGIC MANAGEMENT JOURNAL, 2020, 41 (08) : 1381 - 1411