XAIR: A Systematic Metareview of Explainable AI (XAI) Aligned to the Software Development Process

被引:26
|
作者
Clement, Tobias [1 ]
Kemmerzell, Nils [1 ]
Abdelaal, Mohamed [2 ]
Amberg, Michael [1 ]
机构
[1] Friedrich Alexander Univ Erlangen Nuremberg, Sch Business & Econ, D-90403 Nurnberg, Germany
[2] Software AG, D-64297 Darmstadt, Germany
来源
关键词
explainable AI; software development process; systematic review; feature importance; ARTIFICIAL-INTELLIGENCE; PERFORMANCE PREDICTION; EXPLANATIONS; INTERPRETABILITY; CLASSIFICATION; NETWORKS; FUTURE;
D O I
10.3390/make5010006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Currently, explainability represents a major barrier that Artificial Intelligence (AI) is facing in regard to its practical implementation in various application domains. To combat the lack of understanding of AI-based systems, Explainable AI (XAI) aims to make black-box AI models more transparent and comprehensible for humans. Fortunately, plenty of XAI methods have been introduced to tackle the explainability problem from different perspectives. However, due to the vast search space, it is challenging for ML practitioners and data scientists to start with the development of XAI software and to optimally select the most suitable XAI methods. To tackle this challenge, we introduce XAIR, a novel systematic metareview of the most promising XAI methods and tools. XAIR differentiates itself from existing reviews by aligning its results to the five steps of the software development process, including requirement analysis, design, implementation, evaluation, and deployment. Through this mapping, we aim to create a better understanding of the individual steps of developing XAI software and to foster the creation of real-world AI applications that incorporate explainability. Finally, we conclude with highlighting new directions for future research.
引用
下载
收藏
页码:78 / 108
页数:31
相关论文
共 36 条
  • [1] Recent Applications of Explainable AI (XAI): A Systematic Literature Review
    Saarela, Mirka
    Podgorelec, Vili
    APPLIED SCIENCES-BASEL, 2024, 14 (19):
  • [2] XAI Unveiled: Revealing the Potential of Explainable AI in Medicine: A Systematic Review
    Scarpato, Noemi
    Ferroni, Patrizia
    Guadagni, Fiorella
    IEEE Access, 2024, 12 : 191498 - 191516
  • [3] Comparative Analysis of XAI(eXplainable AI) for Optimization of Wastewater Treatment Process
    Nahm, Eui-Seok
    Transactions of the Korean Institute of Electrical Engineers, 2024, 73 (10): : 1711 - 1717
  • [4] Merging Explainable AI into Automotive Software Development
    Brajovic, Danilo
    Huber, Marco F.
    ERCIM NEWS, 2023, (134):
  • [5] Explainable AI (XAI): A systematic meta-survey of current challenges and future opportunities
    Saeed, Waddah
    Omlin, Christian
    KNOWLEDGE-BASED SYSTEMS, 2023, 263
  • [6] A Study on Modeling of Activated Sludge Process in Wastewater Treatment System Utilizing XAI(eXplainable AI)
    Nahm E.-S.
    Transactions of the Korean Institute of Electrical Engineers, 2023, 72 (02): : 263 - 269
  • [7] Explainable AI (XAI)-driven vibration sensing scheme for surface quality monitoring in a smart surface grinding process
    Hanchate, Abhishek
    Bukkapatnam, Satish T. S.
    Lee, Kye Hwan
    Srivastava, Anil
    Kumara, Soundar
    JOURNAL OF MANUFACTURING PROCESSES, 2023, 99 : 184 - 194
  • [8] Reprint of: Explainable AI (XAI)-driven vibration sensing scheme for surface quality monitoring in a smart surface grinding process
    Hanchate, Abhishek
    Bukkapatnam, Satish T. S.
    Lee, Kye Hwan
    Srivastava, Anil
    Kumara, Soundar
    JOURNAL OF MANUFACTURING PROCESSES, 2023, 100 : 64 - 74
  • [9] SYSTEMATIC DEVELOPMENT OF FORMAL SOFTWARE PROCESS MODELS
    DEITERS, W
    GRUHN, V
    SCHAFER, W
    LECTURE NOTES IN COMPUTER SCIENCE, 1989, 387 : 100 - 117
  • [10] Software Process Improvement in Agile Software Development: A Systematic Literature Review
    Santana, Celio
    Queiroz, Fabiola
    Vasconcelos, Alexandre
    Gusmao, Cristine
    PROCEEDINGS 41ST EUROMICRO CONFERENCE ON SOFTWARE ENGINEERING AND ADVANCED APPLICATIONS SEAA 2015, 2015, : 325 - 332