A Fresh Look at Sanity Checks for Saliency Maps

被引:0
|
作者
Hedstroem, Anna [1 ,2 ,3 ]
Weber, Leander [2 ]
Lapuschkin, Sebastian [2 ]
Hoehne, Marina [3 ,4 ,5 ]
机构
[1] TU Berlin, Dept Elect Engn & Comp Sci, Berlin, Germany
[2] Fraunhofer HHI, Dept Artificial Intelligence, Berlin, Germany
[3] Leibniz Inst Agr Engn & Bioecon eV ATB, UMI Lab, Potsdam, Germany
[4] BIFOLD Berlin Inst Fdn Learning & Data, Berlin, Germany
[5] Univ Potsdam, Dept Comp Sci, Potsdam, Germany
基金
欧盟地平线“2020”;
关键词
Explainability; Evaluation; Faithfulness; Quantification;
D O I
10.1007/978-3-031-63787-2_21
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
TheModel Parameter Randomisation Test (MPRT) is highly recognised in the eXplainable Artificial Intelligence (XAI) community due to its fundamental evaluative criterion: explanations should be sensitive to the parameters of the model they seek to explain. However, recent studies have raised several methodological concerns for the empirical interpretation ofMPRT. In response, we propose two modifications to the original test: Smooth MPRT and Efficient MPRT. The former reduces the impact of noise on evaluation outcomes via sampling, while the latter avoids the need for biased similarity measurements by re-interpreting the test through the increase in explanation complexity after full model randomisation. Our experiments show that these modifications enhance the metric reliability, facilitating a more trustworthy deployment of explanation methods.
引用
收藏
页码:403 / 420
页数:18
相关论文
共 50 条
  • [41] Can We Trust Your Explanations? Sanity Checks for Interpreters in Android Malware Analysis
    Fan, Ming
    Wei, Wenying
    Xie, Xiaofei
    Liu, Yang
    Guan, Xiaohong
    Liu, Ting
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2021, 16 : 838 - 853
  • [42] A FRESH LOOK AT PRODUCTIVITY
    BURCK, C
    FORTUNE, 1989, 119 (04) : 28 - 28
  • [43] A FRESH LOOK AT DYES
    GURR, E
    CHEMISTRY IN BRITAIN, 1967, 3 (07) : 301 - &
  • [44] A fresh look at packaging
    International Paper Board Industry, 2006, 49 (05): : 76 - 77
  • [45] Fresh look at BMD
    Taverna, Michael A.
    Nativi, Andy
    2003, McGraw-Hill Companies (158):
  • [46] A fresh look at perversion
    Richards, AK
    JOURNAL OF THE AMERICAN PSYCHOANALYTIC ASSOCIATION, 2003, 51 (04) : 1199 - 1218
  • [47] A fresh look at nuclear
    Hay, Susie
    Kelk, Michael
    Physics World, 2009, 22 (01) : 38 - 39
  • [48] FRESH LOOK AT EXOTICS
    FAIMAN, D
    GOLDHABER, G
    ZARMI, Y
    PHYSICS LETTERS B, 1973, B 43 (04) : 307 - 310
  • [49] A FRESH LOOK AT LEPROSY
    不详
    LANCET, 1967, 1 (7482): : 145 - +
  • [50] A FRESH LOOK AT HYPOMAGNESEMIA
    CARE, AD
    BRITISH VETERINARY JOURNAL, 1988, 144 (01): : 1 - 4