Automated Image Reduction for Explaining Black-box Classifiers

被引:1
|
作者
Jiang, Mingyue [1 ]
Tang, Chengjian [1 ]
Zhang, Xiao-Yi [2 ]
Zhao, Yangyang [1 ]
Ding, Zuohua [1 ]
机构
[1] Zhejiang Sci Tech Univ, Hangzhou, Peoples R China
[2] Univ Sci & Technol Beijing, Beijing, Peoples R China
来源
2023 IEEE INTERNATIONAL CONFERENCE ON SOFTWARE ANALYSIS, EVOLUTION AND REENGINEERING, SANER | 2023年
关键词
Machine learning; Explainability; Software debugging;
D O I
10.1109/SANER56733.2023.00042
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Due to the prevalent application of machine learning (ML) techniques and the intrinsic black-box nature of ML models, the need for good explanations that are sufficient and necessary towards a model's prediction has been well recognized and emphasized. Existing explanation approaches, however, favor either the sufficiency or necessity. To fill this gap, we present DDImage, a technique and tool that automatically produces explanations preserving dual properties for ML-based image classifiers. The core idea behind DDlmage is to discover an appropriate explanation by debugging the given input image via a series of image reductions, with respect to the sufficiency and necessity properties. We conduct comprehensive experiments to compare our approach against two state-of-the-art approaches, BayLIME and SEDC, on widely-used models and datasets. The results show that our approach outperforms the other methods in producing minimal explanations preserving both sufficiency and necessity, and it matches or exceeds the other methods in terms of stability.
引用
收藏
页码:367 / 378
页数:12
相关论文
共 50 条
  • [1] DDImage: an image reduction based approach for automatically explaining black-box classifiers
    Jiang, Mingyue
    Tang, Chengjian
    Zhang, Xiao-Yi
    Zhao, Yangyang
    Ding, Zuohua
    EMPIRICAL SOFTWARE ENGINEERING, 2024, 29 (05)
  • [2] Explaining black-box classifiers: Properties and functions
    Amgoud, Leila
    INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 2023, 155 : 40 - 65
  • [3] Exploiting auto-encoders for explaining black-box classifiers
    Guidotti, Riccardo
    INTELLIGENZA ARTIFICIALE, 2022, 16 (01) : 115 - 129
  • [4] Explaining Black-Box Automated Electrocardiogram Classification to Cardiologists
    Oliveira, Derick M.
    Ribeiro, Antonio H.
    Pedrosa, Joao A. O.
    Paixdo, Gabriela M. M.
    Ribeiro, Antonio L.
    Meira Jr, Wagner
    2020 COMPUTING IN CARDIOLOGY, 2020,
  • [5] EXPLAN: Explaining Black-box Classifiers using Adaptive Neighborhood Generation
    Rasouli, Peyman
    Yu, Ingrid Chieh
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [6] Attacking Black-Box Image Classifiers With Particle Swarm Optimization
    Zhang, Quanxin
    Wang, Kunqing
    Zhang, Wenjiao
    Hu, Jingjing
    IEEE ACCESS, 2019, 7 : 158051 - 158063
  • [7] Active Bayesian Assessment of Black-Box Classifiers
    Ji, Disi
    Logan, Robert L.
    Smyth, Padhraic
    Steyvers, Mark
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 7935 - 7944
  • [8] Generative causal explanations of black-box classifiers
    O'Shaughnessy, Matthew
    Canal, Gregory
    Connor, Marissa
    Davenport, Mark
    Rozell, Christopher
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [9] RobustCheck: A Python']Python package for black-box robustness assessment of image classifiers
    Ilie, Andrei
    Stefanescu, Alin
    SOFTWAREX, 2024, 27
  • [10] A MODEL DISTILLATION APPROACH FOR EXPLAINING BLACK-BOX MODELS FOR HYPERSPECTRAL IMAGE CLASSIFICATION
    Taskin, Gulsen
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 3592 - 3595