EXplainable Artificial Intelligence (XAI)-From Theory to Methods and Applications

被引:0
|
作者
Ortigossa, Evandro S. [1 ]
Goncalves, Thales [1 ]
Nonato, Luis Gustavo [1 ]
机构
[1] Univ Sao Paulo ICMC USP, Inst Math & Comp Sci, BR-13566590 Sao Carlos, Brazil
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Black-box models; explainability; explainable machine learning; interpretability; interpretable machine learning; BLACK-BOX; EXPLANATIONS; AI; PREDICTIONS; MODELS;
D O I
10.1109/ACCESS.2024.3409843
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Intelligent applications supported by Machine Learning have achieved remarkable performance rates for a wide range of tasks in many domains. However, understanding why a trained algorithm makes a particular decision remains problematic. Given the growing interest in the application of learning-based models, some concerns arise in the dealing with sensible environments, which may impact users' lives. The complex nature of those models' decision mechanisms makes them the so-called "black boxes," in which the understanding of the logic behind automated decision-making processes by humans is not trivial. Furthermore, the reasoning that leads a model to provide a specific prediction can be more important than performance metrics, which introduces a trade-off between interpretability and model accuracy. Explaining intelligent computer decisions can be regarded as a way to justify their reliability and establish trust. In this sense, explanations are critical tools that verify predictions to discover errors and biases previously hidden within the models' complex structures, opening up vast possibilities for more responsible applications. In this review, we provide theoretical foundations of Explainable Artificial Intelligence (XAI), clarifying diffuse definitions and identifying research objectives, challenges, and future research lines related to turning opaque machine learning outputs into more transparent decisions. We also present a careful overview of the state-of-the-art explainability approaches, with a particular analysis of methods based on feature importance, such as the well-known LIME and SHAP. As a result, we highlight practical applications of the successful use of XAI.
引用
收藏
页码:80799 / 80846
页数:48
相关论文
共 50 条
  • [1] Introduction to the special section on eXplainable Artificial Intelligence (XAI): Methods, Applications, and Challenges (VSI-xai)
    Singh, Ashutosh Kumar
    Kumar, Jitendra
    Saxena, Deepika
    V. Vasilakos, Athanasios
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2024, 120
  • [2] A New Perspective on hvaluation Methods for Explainable Artificial Intelligence (XAI)
    Speith, Timo
    Langer, Markus
    [J]. 2023 IEEE 31ST INTERNATIONAL REQUIREMENTS ENGINEERING CONFERENCE WORKSHOPS, REW, 2023, : 325 - 331
  • [3] XAI-Explainable artificial intelligence
    Gunning, David
    Stefik, Mark
    Choi, Jaesik
    Miller, Timothy
    Stumpf, Simone
    Yang, Guang-Zhong
    [J]. SCIENCE ROBOTICS, 2019, 4 (37)
  • [4] Explainable Artificial Intelligence (XAI) in auditing
    Zhang, Chanyuan
    Cho, Soohyun
    Vasarhelyi, Miklos
    [J]. INTERNATIONAL JOURNAL OF ACCOUNTING INFORMATION SYSTEMS, 2022, 46
  • [5] Explainable Artificial Intelligence (XAI) in Insurance
    Owens, Emer
    Sheehan, Barry
    Mullins, Martin
    Cunneen, Martin
    Ressel, Juliane
    Castignani, German
    [J]. RISKS, 2022, 10 (12)
  • [6] A Survey on Explainable Artificial Intelligence (XAI): Toward Medical XAI
    Tjoa, Erico
    Guan, Cuntai
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (11) : 4793 - 4813
  • [7] A Review of Trustworthy and Explainable Artificial Intelligence (XAI)
    Chamola, Vinay
    Hassija, Vikas
    Sulthana, A. Razia
    Ghosh, Debshishu
    Dhingra, Divyansh
    Sikdar, Biplab
    [J]. IEEE ACCESS, 2023, 11 : 78994 - 79015
  • [8] The Pragmatic Turn in Explainable Artificial Intelligence (XAI)
    Paez, Andres
    [J]. MINDS AND MACHINES, 2019, 29 (03) : 441 - 459
  • [10] The Pragmatic Turn in Explainable Artificial Intelligence (XAI)
    Andrés Páez
    [J]. Minds and Machines, 2019, 29 : 441 - 459