Building Trust Over Time in Human-Agent Relationships

被引:5
|
作者
Olson, Danielle Marie [1 ]
Xu, Yan [2 ]
机构
[1] MIT Comp Sci & Artificial Intelligence Lab, Cambridge, MA 02139 USA
[2] Facebook Real Labs Res, Redmond, WA USA
来源
PROCEEDINGS OF THE 9TH INTERNATIONAL USER MODELING, ADAPTATION AND PERSONALIZATION HUMAN-AGENT INTERACTION, HAI 2021 | 2021年
关键词
human-AI; human-agent interaction; trust; artificial intelligence; smart devices; diary study;
D O I
10.1145/3472307.3484178
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
This paper aims to understand how long-term trust and distrust develop between humans and agents (smart objects). We first conducted a qualitative study to explore key factors that lead to trust and distrust, how the human-agent trust journey develops, and what roles these trust-building factors play in the journey. This qualitative study involved an open-ended questionnaire completed by 621 participants and a five-day diary study with 60 participants that examined 499 human-object and human-agent relationships. Next, we conducted a mixed methods study with 146 participants to rate the importance of key factors identified through analysis of the data collected in the first study. We contribute to the HAI community by identifying eight factors accounting for participants' trust and distrust toward new objects, how these factors play different roles at different phases of the human-agent trust journey, and how important these factors are for both trust and distrust. We identified ebbs and flows in the human-agent trust journey over time, revealing time periods when trust is particularly vulnerable. We also found the most important factors for building trust and avoiding distrust did not entirely overlap. We discuss these findings and their implications for designing agents which need to foster trustful long-term relationships with humans.
引用
收藏
页码:193 / 201
页数:9
相关论文
共 50 条
  • [1] Trust Lengthens Decision Time on Unexpected Recommendations in Human-agent Interaction
    Tokushige, Hiroyuki
    Narumi, Takuji
    Ono, Sayaka
    Fuwamoto, Yoshitaka
    Tanikawa, Tomohiro
    Hirose, Michitaka
    PROCEEDINGS OF THE 5TH INTERNATIONAL CONFERENCE ON HUMAN AGENT INTERACTION (HAI'17), 2017, : 245 - 252
  • [2] IMPACT: A Trust Model for Human-Agent Teaming
    Hou, Ming
    PROCEEDINGS OF THE 2020 IEEE INTERNATIONAL CONFERENCE ON HUMAN-MACHINE SYSTEMS (ICHMS), 2020, : 280 - 283
  • [3] A Model of Team Trust in Human-Agent Teams
    Ulfert, Anna-Sophie
    Georganta, Eleni
    COMPANION PUBLICATON OF THE 2020 INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION (ICMI '20 COMPANION), 2020, : 171 - 175
  • [4] Human-Agent Trust Evaluation in a Digital Twin Context
    Doroftei, Daniela
    De Vleeschauwer, Tom
    Lo Bue, Salvatore
    Dewyn, Michael
    Vanderstraeten, Frik
    De Cubber, Geert
    2021 30TH IEEE INTERNATIONAL CONFERENCE ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION (RO-MAN), 2021, : 203 - 207
  • [5] Shared Planning for building Human-agent Therapeutic Alliance
    Abdulrahman, Amal
    Richards, Deborah
    Mascarenhas, Samuel
    18TH ACM INTERNATIONAL CONFERENCE ON INTELLIGENT VIRTUAL AGENTS (IVA'18), 2018, : 335 - 336
  • [6] The Dynamics of Human-Agent Trust with POMDP-Generated Explanations
    Wang, Ning
    Pynadath, David V.
    Hill, Susan G.
    Merchant, Chirag
    INTELLIGENT VIRTUAL AGENTS, IVA 2017, 2017, 10498 : 459 - 462
  • [7] The Effects of Past Experience on Trust in Repeated Human-Agent Teamwork
    Hafizoglu, Feyza Merve
    Sen, Sandip
    PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS (AAMAS' 18), 2018, : 514 - 522
  • [8] Understanding the Influences of Past Experience on Trust in Human-agent Teamwork
    Hafizoglu, Feyza Merve
    Sen, Sandip
    ACM TRANSACTIONS ON INTERNET TECHNOLOGY, 2019, 19 (04)
  • [9] Personal Influences on Dynamic Trust Formation in Human-Agent Interaction
    Huang, Hsiao-Ying
    Bashir, Masooda
    PROCEEDINGS OF THE 5TH INTERNATIONAL CONFERENCE ON HUMAN AGENT INTERACTION (HAI'17), 2017, : 233 - 243
  • [10] A Markovian Method for Predicting Trust Behavior in Human-Agent Interaction
    Pynadath, David, V
    Wang, Ning
    Kamireddy, Sreekar
    PROCEEDINGS OF THE 7TH INTERNATIONAL CONFERENCE ON HUMAN-AGENT INTERACTION (HAI'19), 2019, : 171 - 177