Test Methods and Metrics for Effective HRI in Real-World Human-Robot Teams

被引:2
|
作者
Marvel, Jeremy A. [1 ]
Bagchi, Shelly [1 ]
Zimmerman, Megan [1 ]
Aksu, Murat [1 ]
Antonishek, Brian [1 ]
Wang, Yue [2 ]
Mead, Ross [3 ]
Fong, Terry [4 ]
Ben Amor, Heni [5 ]
机构
[1] NIST, Gaithersburg, MD 20899 USA
[2] Clemson Univ, Clemson, SC USA
[3] Semio AI Inc, Los Angeles, CA USA
[4] NASA, Mountain View, CA USA
[5] Arizona State Univ, Tempe, AZ USA
关键词
performance metrics; test methods; metrology; repeatability; reproducibility; replicability;
D O I
10.1145/3371382.3374845
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
This second annual, full-day workshop aims to explore the metrology necessary for repeatably and independently assessing the performance of robotic systems in real-world human-robot interaction (HRI) scenarios. This workshop continues the motion toward bridging the gaps between the theory and applications of HRI, enabling reproducible studies in HRI, and accelerating the adoption of cutting edge technologies as the industry state-of-practice. The second annual workshop, 'Test Methods and Metrics for Effective HRI', seeks to identify test methods and metrics for the holistic assessment and assurance of HRI performance in practical applications. The focus is on identifying the key performance indicators of seemingly disparate sectors, and to foster the community based on the principles of transparency, repeatability and reproducibility, and establishing trust. The goal is to aid in the advancement of HRI technologies through the development of experimental design, test methods, and metrics for assessing HRI and interface designs.
引用
收藏
页码:652 / 653
页数:2
相关论文
共 50 条
  • [1] Test Methods and Metrics for Effective HRI in Collaborative Human-Robot Teams
    Marvel, Jeremy A.
    Bagchi, Shelly
    Zimmerman, Megan
    Aksu, Murat
    Antonishek, Brian
    Wang, Yue
    Mead, Ross
    Fong, Terry
    Ben Amor, Heni
    [J]. HRI '19: 2019 14TH ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION, 2019, : 696 - 697
  • [2] Towards Reaction and Response Time Metrics for Real-World Human-Robot Interaction
    Harriott, Caroline E.
    Adams, Julie A.
    [J]. 2017 26TH IEEE INTERNATIONAL SYMPOSIUM ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION (RO-MAN), 2017, : 799 - 804
  • [3] Enhancing Robot Perception with Real-World HRI
    Wozniak, Maciej
    [J]. COMPANION OF THE 2024 ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION, HRI 2024 COMPANION, 2024, : 160 - 162
  • [4] Novel and Emerging Test Methods and Metrics for Effective HRI
    Marvel, Jeremy A.
    Bagchi, Shelly
    Zimmerman, Megan
    Aksu, Murat
    Antonishek, Brian
    Li, Xiang
    Wang, Yue
    Mead, Ross
    Fong, Terry
    Ben Amor, Heni
    [J]. HRI '21: COMPANION OF THE 2021 ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION, 2021, : 730 - 732
  • [5] Embodied Affect for Real-World Human-Robot Interaction
    Canamero, Lola
    [J]. PROCEEDINGS OF THE 2020 ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION (HRI '20), 2020, : 459 - 459
  • [6] Real-World Human-Robot Collaborative Reinforcement Learning
    Shafti, Ali
    Tjomsland, Jonas
    Dudley, William
    Faisal, A. Aldo
    [J]. 2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 11161 - 11166
  • [7] Metrics for Human-Robot Team Design: A Teamwork Perspective on Evaluation of Human-Robot Teams
    Ma, Lanssie Mingyue
    Ijtsma, Martijn
    Feigh, Karen M.
    Pritchett, Amy R.
    [J]. ACM TRANSACTIONS ON HUMAN-ROBOT INTERACTION, 2022, 11 (03)
  • [8] Real-world oriented distributed human-robot interface system
    Iwakura, Y
    Shiraishi, Y
    Nakauchi, Y
    Anzai, Y
    [J]. RO-MAN '97 SENDAI: 6TH IEEE INTERNATIONAL WORKSHOP ON ROBOT AND HUMAN COMMUNICATION, PROCEEDINGS, 1997, : 188 - 193
  • [9] Exploring Human-Robot Trust During Teaming in a Real-World Testbed
    Robinette, Paul
    Novitzky, Michael
    Fitzgerald, Caileigh
    Benjamin, Michael R.
    Schmidt, Henrik
    [J]. HRI '19: 2019 14TH ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION, 2019, : 592 - 593
  • [10] Intrinsically motivated reinforcement learning for human-robot interaction in the real-world
    Qureshi, Ahmed Hussain
    Nakamura, Yutaka
    Yoshikawa, Yuichiro
    Ishiguro, Hiroshi
    [J]. NEURAL NETWORKS, 2018, 107 : 23 - 33