Building Human-Machine Trust via Interpretability

被引:0
|
作者
Bhatt, Umang [1 ]
Ravikumar, Pradeep [1 ]
Moura, Jose M. F. [1 ]
机构
[1] Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Developing human-machine trust is a prerequisite for adoption of machine learning systems in decision critical settings (e.g healthcare and governance). Users develop appropriate trust in these systems when they understand how the systems make their decisions. Interpretability not only helps users understand what a system learns but also helps users contest that system to align with their intuition. We propose an algorithm, AVA: Aggregate Valuation of Antecedents, that generates a consensus feature attribution, retrieving local explanations and capturing global patterns learned by a model. Our empirical results show that AVA rivals current benchmarks.
引用
收藏
页码:9919 / 9920
页数:2
相关论文
共 50 条
  • [1] Building Trust in Human-Machine Partnerships
    Canal, Gerard
    Borgo, Rita
    Coles, Andrew
    Drake, Archie
    Dong Huynh
    Keller, Perry
    Krivic, Senka
    Luff, Paul
    Mahesar, Quratul-ain
    Moreau, Luc
    Parsons, Simon
    Patel, Menisha
    Sklar, Elizabeth I.
    COMPUTER LAW & SECURITY REVIEW, 2020, 39
  • [2] Building trust and responsibility into autonomous human-machine teams
    Gillespie, Tony
    FRONTIERS IN PHYSICS, 2022, 10
  • [3] Trust and communication in human-machine teaming
    Ibrahim, Memunat A. A.
    Assaad, Zena
    Williams, Elizabeth
    FRONTIERS IN PHYSICS, 2022, 10
  • [4] Building Trusted Human-Machine Partnerships
    Drubin, Cliff
    MICROWAVE JOURNAL, 2019, 62 (03) : 41 - 42
  • [5] Measuring Human Trust Behavior in Human-Machine Teams
    Bindewald, Jason M.
    Rusnock, Christina F.
    Miller, Michael E.
    ADVANCES IN HUMAN FACTORS IN SIMULATION AND MODELING (AHFE 2017), 2018, 591 : 47 - 58
  • [6] Improving the level of trust in human-machine conversation
    Sucameli, Irene
    ADVANCED ROBOTICS, 2021, 35 (09) : 553 - 560
  • [7] Dynamic Modeling of Trust in Human-Machine Interactions
    Akash, Kumar
    Hu, Wan-Lin
    Reid, Tahira
    Jain, Neera
    2017 AMERICAN CONTROL CONFERENCE (ACC), 2017, : 1542 - 1548
  • [8] Machine learning and human-machine trust in healthcare: A systematic survey
    Lin, Han
    Han, Jiatong
    Wu, Pingping
    Wang, Jiangyan
    Tu, Juan
    Tang, Hao
    Zhu, Liuning
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2024, 9 (02) : 286 - 302
  • [9] Human-Machine Cooperative Steering Control Considering Mitigating Human-Machine Conflict Based on Driver Trust
    Shi, Zhuqing
    Chen, Hong
    Qu, Ting
    Yu, Shuyou
    IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2022, 52 (05) : 1036 - 1048
  • [10] Trust Evaluation through Human-Machine Dialogue Modelling
    Crocquesel, Cyril
    Legras, Francois
    Coppin, Gilles
    ENGINEERING PSYCHOLOGY AND COGNITIVE ERGONOMICS, 2011, 6781 : 504 - 513