Demonstration of Generating Explanations for Black-Box Algorithms Using LEWIS

被引:3
|
作者
Wang, Paul Y. [1 ]
Galhotra, Sainyam [2 ]
Pradhan, Romila [1 ]
Salimi, Babak [1 ]
机构
[1] Univ Calif San Diego, La Jolla, CA 92093 USA
[2] Univ Chicago, Chicago, IL 60637 USA
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2021年 / 14卷 / 12期
关键词
D O I
10.14778/3476311.3476345
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Explainable artificial intelligence (XAI) aims to reduce the opacity of AI-based decision-making systems, allowing humans to scrutinize and trust them. Unlike prior work that attributes the responsibility for an algorithm's decisions to its inputs as a purely associational concept, we propose a principled causality-based approach for explaining black-box decision-making systems. We present the demonstration of Lewis, a system that generates explanations for black-box algorithms at the global, contextual, and local levels, and provides actionable recourse for individuals negatively affected by an algorithm's decision. Lewis makes no assumptions about the internals of the algorithm except for the availability of its inputoutput data. The explanations generated by Lewis are based on probabilistic contrastive counterfactuals, a concept that can be traced back to philosophical, cognitive, and social foundations of theories on how humans generate and select explanations. We describe the system layout of Lewis wherein an end-user specifies the underlying causal model and Lewis generates explanations for particular use-cases, compares them with explanations generated by state-of-the-art approaches in XAI, and provides actionable recourse when applicable. Lewis has been developed as open-source software; the code and the demonstration video are available at lewis-system.github.io.
引用
收藏
页码:2787 / 2790
页数:4
相关论文
共 50 条
  • [1] Generating Test Data for Black-Box Testing using Genetic Algorithms
    Fischer, Marten
    Toenjes, Ralf
    [J]. 2012 IEEE 17TH CONFERENCE ON EMERGING TECHNOLOGIES & FACTORY AUTOMATION (ETFA), 2012,
  • [2] A Generic Framework for Black-box Explanations
    Henin, Clement
    Le Metayer, Daniel
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, : 3667 - 3676
  • [3] Generative causal explanations of black-box classifiers
    O'Shaughnessy, Matthew
    Canal, Gregory
    Connor, Marissa
    Davenport, Mark
    Rozell, Christopher
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [4] Learning Groupwise Explanations for Black-Box Models
    Gao, Jingyue
    Wang, Xiting
    Wang, Yasha
    Yan, Yulan
    Xie, Xing
    [J]. PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 2396 - 2402
  • [5] Using Black-Box Compression Algorithms for Phase Retrieval
    Bakhshizadeh, Milad
    Maleki, Arian
    Jalali, Shirin
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2020, 66 (12) : 7978 - 8001
  • [6] Be Wary of Black-Box Trading Algorithms
    Smith, Gary
    [J]. JOURNAL OF INVESTING, 2019, 28 (05): : 7 - 15
  • [7] Feature Importance Explanations for Temporal Black-Box Models
    Sood, Akshay
    Craven, Mark
    [J]. THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 8351 - 8360
  • [8] Experimental Study on Generating Multi-modal Explanations of Black-box Classifiers in terms of Gray-box Classifiers
    Alonso, Jose M.
    Toja-Alamancos, J.
    Bugarin, A.
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS (FUZZ-IEEE), 2020,
  • [9] Explaining Black-Box Algorithms Using Probabilistic Contrastive Counterfactuals
    Galhotra, Sainyam
    Pradhan, Romila
    Salimi, Babak
    [J]. SIGMOD '21: PROCEEDINGS OF THE 2021 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2021, : 577 - 590
  • [10] Making Sense of Dependence: Efficient Black-box Explanations Using Dependence Measure
    Novello, Paul
    Fel, Thomas
    Vigouroux, David
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,