Evaluation Metrics Research for Explainable Artificial Intelligence Global Methods Using Synthetic Data

被引:5
|
作者
Oblizanov, Alexandr [1 ]
Shevskaya, Natalya [1 ]
Kazak, Anatoliy [2 ]
Rudenko, Marina [3 ]
Dorofeeva, Anna [2 ]
机构
[1] St Petersburg Electrotech Univ Leti, Fac Comp Sci & Technol, St Petersburg 197376, Russia
[2] VI Vernadsky Crimean Fed Univ, Humanitarian Pedag Acad, Simferopol 295007, Russia
[3] VI Vernadsky Crimean Fed Univ, Inst Phys & Technol, Simferopol 295007, Russia
关键词
explainable artificial intelligence; XAI; explanation metrics; synthetic data; SMOTE;
D O I
10.3390/asi6010026
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, artificial intelligence technologies have been developing more and more rapidly, and a lot of research is aimed at solving the problem of explainable artificial intelligence. Various XAI methods are being developed to allow the user to understand the logic of how machine learning models work, and in order to compare the methods, it is necessary to evaluate them. The paper analyzes various approaches to the evaluation of XAI methods, defines the requirements for the evaluation system and suggests metrics to determine the various technical characteristics of the methods. A study was conducted, using these metrics, which determined the degradation in the explanation quality of the SHAP and LIME methods with increasing correlation in the input data. Recommendations are also given for further research in the field of practical implementation of metrics, expanding the scope of their use.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Evaluation Metrics in Explainable Artificial Intelligence (XAI)
    Coroama, Loredana
    Groza, Adrian
    ADVANCED RESEARCH IN TECHNOLOGIES, INFORMATION, INNOVATION AND SUSTAINABILITY, ARTIIS 2022, PT I, 2022, 1675 : 401 - 413
  • [2] Explainable Artificial Intelligence for Deep Synthetic Data Generation Models
    Valina, Luis
    Teixeira, Brigida
    Reis, Amalie
    Vale, Zita
    Pinto, Tiago
    2024 IEEE CONFERENCE ON ARTIFICIAL INTELLIGENCE, CAI 2024, 2024, : 555 - 556
  • [3] Towards Evaluation of Explainable Artificial Intelligence in Streaming Data
    Mozolewski, Maciej
    Bobek, Szymon
    Ribeiro, Rita P.
    Nalepa, Grzegorz J.
    Gama, Joao
    EXPLAINABLE ARTIFICIAL INTELLIGENCE, XAI 2024, PT IV, 2024, 2156 : 145 - 168
  • [4] Transparency and privacy measures of biometric patterns for data processing with synthetic data using explainable artificial intelligence
    Shankar, Achyut
    Manoharan, Hariprasath
    Khadidos, Adil O.
    Khadidos, Alaa O.
    Selvarajan, Shitharth
    Goyal, S. B.
    IMAGE AND VISION COMPUTING, 2025, 154
  • [5] ACCELERATING BRAIN RESEARCH USING EXPLAINABLE ARTIFICIAL INTELLIGENCE
    Chou, Jing-Lun
    Huang, Ya-Lin
    Hsieh, Chia-Ying
    Huang, Jian-Xue
    Wei, Chun-Shu
    2022 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (IEEE ICMEW 2022), 2022,
  • [6] Local and Global Interpretability Using Mutual Information in Explainable Artificial Intelligence
    Islam, Mir Riyanul
    Ahmed, Mobyen Uddin
    Begum, Shahina
    2021 8TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING & MACHINE INTELLIGENCE (ISCMI 2021), 2021, : 191 - 195
  • [7] Developing guidelines for functionally-grounded evaluation of explainable artificial intelligence using tabular data
    Velmurugan, Mythreyi
    Ouyang, Chun
    Xu, Yue
    Sindhgatta, Renuka
    Wickramanayake, Bemali
    Moreira, Catarina
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 141
  • [8] Explainable Artificial Intelligence (XAI) for Methods Working on Point Cloud Data: A Survey
    Mulawade, Raju Ningappa
    Garth, Christoph
    Wiebel, Alexander
    IEEE ACCESS, 2024, 12 : 146830 - 146851
  • [9] Explainable Artificial Intelligence in Endocrinological Medical Research
    Webb-Robertson, Bobbie-Jo M.
    JOURNAL OF CLINICAL ENDOCRINOLOGY & METABOLISM, 2021, 106 (07): : E2809 - E2810
  • [10] Explainable artificial intelligence for spectroscopy data: a review
    Contreras, Jhonatan
    Bocklitz, Thomas
    PFLUGERS ARCHIV-EUROPEAN JOURNAL OF PHYSIOLOGY, 2024, : 603 - 615