Fusing Multiple Sensors Information into Mixed Reality-based User Interface for Robot Teleoperation

被引:1
|
作者
Zhu, Jie [1 ]
Wang, Xiangyu [1 ]
Rosenman, Michael [1 ]
机构
[1] Univ Sydney, Fac Architecture Design & Planning, Design Lab, Sydney, NSW 2006, Australia
关键词
Mixed Reality; telerobitcs; situation awareness;
D O I
10.1109/ICSMC.2009.5346781
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Mixed Reality commonly refers to the merging of real and virtual worlds to produce new visualization environments where physical and digital objects co-exist and interact in real time. Mixed Reality can also be used for fusing sensor data into the existing user interface to efficiently improve situation awareness, to facilitate the understanding of surrounding environment, and to predict the future status. The work presented in this paper fuses and then represents the real video and complementary information into one single Mixed Reality interface. A simulation platform to test the Mixed Reality interface for teleoperation is also discussed in this paper.
引用
收藏
页码:876 / 881
页数:6
相关论文
共 50 条
  • [1] Mixed Reality-Based User Interaction Feedback for a Hand-Controlled Interface Targeted to Robot Teleoperation
    Cancedda, Laura
    Cannavo, Alberto
    Garofalo, Giuseppe
    Lamberti, Fabrizio
    Montuschi, Paolo
    Paravati, Gianluca
    [J]. AUGMENTED REALITY, VIRTUAL REALITY, AND COMPUTER GRAPHICS, AVR 2017, PT II, 2017, 10325 : 447 - 463
  • [2] Augmented Reality-Based Interface for Bimanual Robot Teleoperation
    Garcia, Alberto
    Solanes, J. Ernesto
    Munoz, Adolfo
    Gracia, Luis
    Tornero, Josep
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (09):
  • [3] Virtual Reality-Based Interface for Advanced Assisted Mobile Robot Teleoperation
    Solanes, J. Ernesto
    Munoz, Adolfo
    Gracia, Luis
    Tornero, Josep
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (12):
  • [4] Design and Evaluation of a Mixed Reality-based Human-Robot Interface for Teleoperation of Omnidirectional Aerial Vehicles
    Allenspach, Mike
    Kotter, Till
    Bahnemann, Rik
    Tognon, Marco
    Siegwart, Roland
    [J]. 2023 INTERNATIONAL CONFERENCE ON UNMANNED AIRCRAFT SYSTEMS, ICUAS, 2023, : 1168 - 1174
  • [5] Immersive Robot Teleoperation Based on User Gestures in Mixed Reality Space
    Esaki, Hibiki
    Sekiyama, Kosuke
    [J]. SENSORS, 2024, 24 (15)
  • [6] Robot Teleoperation System Based on Mixed Reality
    Liang, Congyuan
    Liu, Chao
    Liu, Xiaofeng
    Cheng, Long
    Yang, Chenguang
    [J]. 2019 IEEE 4TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2019), 2019, : 384 - 389
  • [7] A virtual reality-based dual-mode robot teleoperation architecture
    Gallipoli, Marco
    Buonocore, Sara
    Selvaggio, Mario
    Fontanelli, Giuseppe Andrea
    Grazioso, Stanislao
    Di Gironimo, Giuseppe
    [J]. ROBOTICA, 2024, 42 (06) : 1935 - 1958
  • [8] Mixed reality-based user interface for quality control inspection of car body surfaces
    Munoz, Adolfo
    Mahiques, Xavier
    Ernesto Solanes, J.
    Marti, Ana
    Gracia, Luis
    Tornero, Josep
    [J]. JOURNAL OF MANUFACTURING SYSTEMS, 2019, 53 : 75 - 92
  • [9] A framework for virtual reality with tangible augmented reality-based user interface
    Hong, D
    Woo, W
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2006, E89D (01): : 45 - 52
  • [10] Virtual reality-based dynamic scene recreation and robot teleoperation for hazardous environments
    Bavelos, Angelos Christos
    Anastasiou, Efthymios
    Dimitropoulos, Nikos
    Michalos, George
    Makris, Sotiris
    [J]. COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2024,