Handshake: Realistic Human-Robot Interaction in Haptic Enhanced Virtual Reality

被引:22
|
作者
Wang, Zheng [1 ,2 ]
Giannopoulos, Elias [3 ]
Slater, Mel [3 ,4 ]
Peer, Angelika [1 ]
Buss, Martin [1 ]
机构
[1] Tech Univ Munich, Inst Automat Control Engn, D-80290 Munich, Germany
[2] Nanyang Technol Univ, Sch Mech & Aerosp Engn, Singapore, Singapore
[3] Univ Barcelona, Fac Psicol, EVENT Lab, E-08007 Barcelona, Spain
[4] UCL, Dept Comp Sci, London WC1E 6BT, England
关键词
D O I
10.1162/PRES_a_00061
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
This paper focuses on the development and evaluation of a haptic enhanced virtual reality system which allows a human user to make physical handshakes with a virtual partner through a haptic interface. Multimodal feedback signals are designed to generate the illusion that a handshake with a robotic arm is a handshake with another human. Advanced controllers of the haptic interface are developed to respond to user behaviors online. Techniques to achieve online behavior generation are presented, such as a hidden-Markov-model approach to human interaction strategy estimation. Human-robot handshake experiments were carried out to evaluate the performance of the system. Two different approaches to haptic rendering were compared in experiments: a controller in basic mode with an embedded curve in the robot that disregards the human partner, and an interactive robot controller for online behavior generation. The two approaches were compared with the ground truth of another human driving the robot via teleoperation instead of the controller implementing a virtual partner. In the evaluation results, the human approach is rated to be most human-like, with the interactive controller following closely behind, followed by the controller in basic mode. This paper mainly concentrates on discussing the development of the haptic rendering algorithm for the handshaking system, its integration with visual and haptic cues, and reports about the results of subjective evaluation experiments that were carried out.
引用
收藏
页码:371 / 392
页数:22
相关论文
共 50 条
  • [1] An HMM approach to realistic haptic human-robot interaction
    Wang, Zheng
    Peer, Angelika
    Buss, Martin
    [J]. WORLD HAPTICS 2009: THIRD JOINT EUROHAPTICS CONFERENCE AND SYMPOSIUM ON HAPTIC INTERFACES FOR VIRTUAL ENVIRONMENT AND TELEOPERATOR SYSTEMS, PROCEEDINGS, 2009, : 374 - 400
  • [2] Understanding Human-Robot Interaction in Virtual Reality
    Liu, Oliver
    Rakita, Daniel
    Mutlu, Bilge
    Gleicher, Michael
    [J]. 2017 26TH IEEE INTERNATIONAL SYMPOSIUM ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION (RO-MAN), 2017, : 751 - 757
  • [3] A Simulator for Human-Robot Interaction in Virtual Reality
    Murnane, Mark
    Higgins, Padraig
    Saraf, Monali
    Ferraro, Francis
    Matuszek, Cynthia
    Engel, Don
    [J]. 2021 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS (VRW 2021), 2021, : 470 - 471
  • [4] Haptic Human-Robot Interaction
    Karniel, Amir
    Peer, Angelika
    Donchin, Opher
    Mussa-Ivaldi, Ferdinando A.
    Loeb, Gerald E.
    [J]. IEEE TRANSACTIONS ON HAPTICS, 2012, 5 (03) : 193 - 195
  • [5] Virtual, Augmented, and Mixed Reality for Human-Robot Interaction
    Williams, Tom
    Szafir, Daniel
    Chakraborti, Tathagata
    Amor, Heni Ben
    [J]. COMPANION OF THE 2018 ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION (HRI'18), 2018, : 403 - 404
  • [6] Virtual reality in human-robot interaction: Challenges and benefits
    Lei, Yu
    Su, Zhi
    Cheng, Chao
    [J]. ELECTRONIC RESEARCH ARCHIVE, 2023, 31 (05): : 2374 - 2408
  • [7] Haptic Dimensions of Human-Robot Interaction
    Okamura, Allison M.
    [J]. ACM TRANSACTIONS ON HUMAN-ROBOT INTERACTION, 2018, 7 (01)
  • [8] A Preliminary Study on Virtual Reality Tools in Human-Robot Interaction
    Kaszuba, Sara
    Leotta, Francesco
    Nardi, Daniele
    [J]. AUGMENTED REALITY, VIRTUAL REALITY, AND COMPUTER GRAPHICS, 2021, 12980 : 81 - 90
  • [9] Performing Human-Robot Interaction User Studies in Virtual Reality
    Wijnen, Luc
    Bremner, Paul
    Lemaignan, Severin
    Giuliani, Manuel
    [J]. 2020 29TH IEEE INTERNATIONAL CONFERENCE ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION (RO-MAN), 2020, : 794 - 799
  • [10] Modeling of Human Welders' Operations in Virtual Reality Human-Robot Interaction
    Wang, Qiyue
    Jiao, Wenhua
    Yu, Rui
    Johnson, Michael T.
    Zhang, YuMing
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2019, 4 (03) : 2958 - 2964