Teleoperation of industrial robot manipulators based on augmented reality

被引:31
|
作者
Solanes, J. Ernesto [1 ]
Munoz, Adolfo [1 ]
Gracia, Luis [1 ]
Marti, Ana [1 ]
Girbes-Juan, Vicent [2 ]
Tornero, Josep [1 ]
机构
[1] Univ Politecn Valencia, Inst IDF, Camino Vera S-N, Valencia 46022, Spain
[2] Univ Valencia, Dept Engn Elect, Avda Univ S-N, Burjassot 46100, Spain
关键词
Augmented reality interface; Industry; 4; 0; Industrial robot teleoperation; Mixed reality interface; Guiding industrial robots;
D O I
10.1007/s00170-020-05997-1
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This research develops a novel teleoperation for robot manipulators based on augmented reality. The proposed interface is equipped with full capabilities in order to replace the classical teach pendant of the robot for carrying out teleoperation tasks. The proposed interface is based on an augmented reality headset for projecting computer-generated graphics onto the real environment and a gamepad to interact with the computer-generated graphics and provide robot commands. In order to demonstrate the benefits of the proposed method, several usability tests were conducted using a 6R industrial robot manipulator in order to compare the proposed interface and the conventional teach pendant interface for teleoperation tasks. In particular, the results of these usability tests show that the proposed approach is more intuitive, ergonomic, and easy to use. Furthermore, the comparison results also show that the proposed method clearly improves the velocity of the teleoperation task, regardless of the user's previous experience in robotics and augmented reality technology.
引用
收藏
页码:1077 / 1097
页数:21
相关论文
共 50 条
  • [1] Teleoperation of industrial robot manipulators based on augmented reality
    J. Ernesto Solanes
    Adolfo Muñoz
    Luis Gracia
    Ana Martí
    Vicent Girbés-Juan
    Josep Tornero
    [J]. The International Journal of Advanced Manufacturing Technology, 2020, 111 : 1077 - 1097
  • [2] Teleoperation of the Industrial Robot: Augmented reality application
    Er , Chung Xue
    Qiao, Yuansong
    Kuts, Vladimir
    Henry, John
    McNevin, Ken
    Murray, Niall
    [J]. PROCEEDINGS OF THE 13TH ACM MULTIMEDIA SYSTEMS CONFERENCE, MMSYS 2022, 2022, : 299 - 303
  • [3] An Augmented Reality Application to Assist Teleoperation of Underwater Manipulators
    Cardenas, E. F.
    Dutra, M. S.
    [J]. IEEE LATIN AMERICA TRANSACTIONS, 2016, 14 (02) : 863 - 869
  • [4] Augmented Reality-Based Interface for Bimanual Robot Teleoperation
    Garcia, Alberto
    Solanes, J. Ernesto
    Munoz, Adolfo
    Gracia, Luis
    Tornero, Josep
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (09):
  • [5] Improving Collocated Robot Teleoperation with Augmented Reality
    Hedayati, Hooman
    Walker, Michael
    Szafir, Daniel
    [J]. HRI '18: PROCEEDINGS OF THE 2018 ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION, 2018, : 78 - 86
  • [6] Application of Augmented Reality in Mobile Robot Teleoperation
    Kot, Tomas
    Novak, Petr
    Babjak, Jan
    [J]. MODELLING AND SIMULATION FOR AUTONOMOUS SYSTEMS, 2018, 10756 : 223 - 236
  • [7] Robot Teleoperation with Augmented Reality Virtual Surrogates
    Walker, Michael E.
    Hedayati, Hooman
    Szafir, Daniel
    [J]. HRI '19: 2019 14TH ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION, 2019, : 202 - 210
  • [8] Augmented Reality Based Teaching Pendant for Industrial Robot
    Abbas, Syed Mohsin
    Hassan, Syed
    Yun, Jongwon
    [J]. 2012 12TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS), 2012, : 2210 - 2213
  • [9] Augmented Reality with Multi-view Merging for Robot Teleoperation
    Huang, Bidan
    Timmons, Nicholas Gerard
    Li, Qiang
    [J]. HRI'20: COMPANION OF THE 2020 ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION, 2020, : 260 - 262
  • [10] Hands-Free: a robot augmented reality teleoperation system
    Nuzzi, Cristina
    Ghidini, Stefano
    Pagani, Roberto
    Pasinetti, Simone
    Coffetti, Gabriele
    Sansoni, Giovanna
    [J]. 2020 17TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS (UR), 2020, : 617 - 624