Building Human-Machine Trust via Interpretability

被引:0
|
作者
Bhatt, Umang [1 ]
Ravikumar, Pradeep [1 ]
Moura, Jose M. F. [1 ]
机构
[1] Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Developing human-machine trust is a prerequisite for adoption of machine learning systems in decision critical settings (e.g healthcare and governance). Users develop appropriate trust in these systems when they understand how the systems make their decisions. Interpretability not only helps users understand what a system learns but also helps users contest that system to align with their intuition. We propose an algorithm, AVA: Aggregate Valuation of Antecedents, that generates a consensus feature attribution, retrieving local explanations and capturing global patterns learned by a model. Our empirical results show that AVA rivals current benchmarks.
引用
收藏
页码:9919 / 9920
页数:2
相关论文
共 50 条
  • [41] Human-machine communication
    Farbrot, JE
    Nihlwing, C
    Svengren, H
    ATW-INTERNATIONAL JOURNAL FOR NUCLEAR POWER, 2005, 50 (02): : 96 - +
  • [42] ON HUMAN-MACHINE INTERFACE
    BUHR, P
    COMMUNICATIONS OF THE ACM, 1983, 26 (07) : 463 - 464
  • [43] On human-machine relations
    Degani, Asaf
    Goldman, Claudia V.
    Deutsch, Omer
    Tsimhoni, Omer
    COGNITION TECHNOLOGY & WORK, 2017, 19 (2-3) : 211 - 231
  • [44] Optimal design of fuzzy control via human-machine combination
    Moshi Shibie yu Rengong Zhineng, 1 (20-26):
  • [45] Unobtrusive Tremor Detection and Measurement via Human-Machine Interaction
    Guettler, J.
    Shah, R.
    Georgoulas, C.
    Bock, T.
    6TH INTERNATIONAL CONFERENCE ON EMERGING UBIQUITOUS SYSTEMS AND PERVASIVE NETWORKS (EUSPN 2015)/THE 5TH INTERNATIONAL CONFERENCE ON CURRENT AND FUTURE TRENDS OF INFORMATION AND COMMUNICATION TECHNOLOGIES IN HEALTHCARE (ICTH-2015), 2015, 63 : 467 - 474
  • [46] Vision based human-machine interface via hand gestures
    Berci, Norbert
    Szolgay, Peter
    2007 EUROPEAN CONFERENCE ON CIRCUIT THEORY AND DESIGN, VOLS 1-3, 2007, : 496 - 499
  • [47] Personal Context Recognition via Reliable Human-Machine Collaboration
    Giunchiglia, Fausto
    Zeni, Mattia
    Bignotti, Enrico
    2018 IEEE INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING AND COMMUNICATIONS WORKSHOPS (PERCOM WORKSHOPS), 2018,
  • [48] Human-machine symbiosis: A multivariate perspective for physically coupled human-machine systems
    Inga, Jairo
    Ruess, Miriam
    Robens, Jan Heinrich
    Nelius, Thomas
    Rothfuss, Simon
    Kille, Sean
    Dahlinger, Philipp
    Lindenmann, Andreas
    Thomaschke, Roland
    Neumann, Gerhard
    Matthiesen, Sven
    Hohmann, Soren
    Kiesel, Andrea
    INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 2023, 170
  • [49] Developing human-machine trust: Impacts of prior instruction and automation failure on driver trust in partially automated vehicles
    Lee, Jieun
    Abe, Genya
    Sato, Kenji
    Itoh, Makoto
    TRANSPORTATION RESEARCH PART F-TRAFFIC PSYCHOLOGY AND BEHAVIOUR, 2021, 81 : 384 - 395
  • [50] Trust within human-machine collectives depends on the perceived consensus about cooperative norms
    Kinga Makovi
    Anahit Sargsyan
    Wendi Li
    Jean-François Bonnefon
    Talal Rahwan
    Nature Communications, 14