Explaining Deep Neural Network using Layer-wise Relevance Propagation and Integrated Gradients

被引:0
|
作者
Cik, Ivan [1 ]
Rasamoelina, Andrindrasana David [1 ]
Mach, Marian [1 ]
Sincak, Peter [1 ]
机构
[1] Tech Univ Kosice, Dept Cybernet & Artificial Intelligence, Kosice, Slovakia
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Machine learning has become an integral part of technology in today's world. The field of artificial intelligence is the subject of research by a wide scientific community. In particular, through improved methodology, the availability of big data, and increased computing power, today's machine learning algorithms can achieve excellent performance that sometimes even exceeds the human level. However, due to their nested nonlinear structure, these models are generally considered to be "Black boxes" that do not provide any information about what exactly leads them to provide a specific output. This raised the need to interpret these algorithms and understand how they work as they are applied even in areas where they can cause critical damage. This article describes Integrated Gradients [1] and Layer-wise Relevance Propagation [2] methods and presents individual experiments with. In experiments we have used well-known datasets like MNIST[3], MNIST-Fashion dataset[4], Imagenette and Imagewoof which are subsets of ImageNet [5].
引用
收藏
页码:381 / 386
页数:6
相关论文
共 50 条
  • [1] Explaining Therapy Predictions with Layer-wise Relevance Propagation in Neural Networks
    Yang, Yinchong
    Tresp, Volker
    Wunderle, Marius
    Fasching, Peter A.
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON HEALTHCARE INFORMATICS (ICHI), 2018, : 152 - 162
  • [2] Explaining Convolutional Neural Networks using Softmax Gradient Layer-wise Relevance Propagation
    Iwana, Brian Kenji
    Kuroki, Ryohei
    Uchida, Seiichi
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 4176 - 4185
  • [3] Explaining Deep Learning Models for Tabular Data Using Layer-Wise Relevance Propagation
    Ullah, Ihsan
    Rios, Andre
    Gala, Vaibhav
    Mckeever, Susan
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (01):
  • [4] Explaining CNN and RNN Using Selective Layer-Wise Relevance Propagation
    Jung, Yeon-Jee
    Han, Seung-Ho
    Choi, Ho-Jin
    [J]. IEEE ACCESS, 2021, 9 : 18670 - 18681
  • [5] Layer-Wise Relevance Propagation for Explaining Deep Neural Network Decisions in MRI-Based Alzheimer's Disease Classification
    Boehle, Moritz
    Eitel, Fabian
    Weygandt, Martin
    Ritter, Kerstin
    [J]. FRONTIERS IN AGING NEUROSCIENCE, 2019, 11
  • [6] Hierarchical Neural Network with Layer-wise Relevance Propagation for Interpretable Multiclass Neural State Classification
    Ellis, Charles A.
    Sendi, Mohammad S. E.
    Willie, Jon T.
    Mahmoudi, Babak
    [J]. 2021 10TH INTERNATIONAL IEEE/EMBS CONFERENCE ON NEURAL ENGINEERING (NER), 2021, : 351 - 354
  • [7] Improving deep neural network generalization and robustness to background bias via layer-wise relevance propagation optimization
    Bassi, Pedro R. A. S.
    Dertkigil, Sergio S. J.
    Cavalli, Andrea
    [J]. NATURE COMMUNICATIONS, 2024, 15 (01)
  • [8] Improving deep neural network generalization and robustness to background bias via layer-wise relevance propagation optimization
    Pedro R. A. S. Bassi
    Sergio S. J. Dertkigil
    Andrea Cavalli
    [J]. Nature Communications, 15
  • [9] Interpreting Convolutional Neural Networks via Layer-Wise Relevance Propagation
    Jia, Wohuan
    Zhang, Shaoshuai
    Jiang, Yue
    Xu, Li
    [J]. ARTIFICIAL INTELLIGENCE AND SECURITY, ICAIS 2022, PT I, 2022, 13338 : 457 - 467
  • [10] Layer-Wise Relevance Propagation for Neural Networks with Local Renormalization Layers
    Binder, Alexander
    Montavon, Gregoire
    Lapuschkin, Sebastian
    Mueller, Klaus-Robert
    Samek, Wojciech
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2016, PT II, 2016, 9887 : 63 - 71