Fusing Multiple Sensors Information into Mixed Reality-based User Interface for Robot Teleoperation

被引:1
|
作者
Zhu, Jie [1 ]
Wang, Xiangyu [1 ]
Rosenman, Michael [1 ]
机构
[1] Univ Sydney, Fac Architecture Design & Planning, Design Lab, Sydney, NSW 2006, Australia
关键词
Mixed Reality; telerobitcs; situation awareness;
D O I
10.1109/ICSMC.2009.5346781
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Mixed Reality commonly refers to the merging of real and virtual worlds to produce new visualization environments where physical and digital objects co-exist and interact in real time. Mixed Reality can also be used for fusing sensor data into the existing user interface to efficiently improve situation awareness, to facilitate the understanding of surrounding environment, and to predict the future status. The work presented in this paper fuses and then represents the real video and complementary information into one single Mixed Reality interface. A simulation platform to test the Mixed Reality interface for teleoperation is also discussed in this paper.
引用
收藏
页码:876 / 881
页数:6
相关论文
共 50 条
  • [21] A Comprehensive User Study on Augmented Reality-Based Data Collection Interfaces for Robot Learning
    Jiang, Xinkai
    Mattes, Paul
    Jia, Xiaogang
    Schreiber, Nicolas
    Neumann, Gerhard
    Lioutikov, Rudolf
    [J]. PROCEEDINGS OF THE 2024 ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION, HRI 2024, 2024, : 333 - 342
  • [22] Virtual Reality-based Teleoperation with Robustness Against Modeling Errors
    Jiang Zainan
    Liu Hong
    Wang Jie
    Huang Jianbin
    [J]. CHINESE JOURNAL OF AERONAUTICS, 2009, 22 (03) : 325 - 333
  • [23] Approaches to mixed reality user interfaces for teleoperation of mobile robots
    Sauer, Markus
    Driewer, Frauke
    Missoh, Koami Edem
    Goellnitz, Manuel
    Schilling, Klaus
    [J]. PROCEEDINGS OF THE 13TH IASTED INTERNATIONAL CONFERENCE ON ROBOTICS AND APPLICATIONS/PROCEEDINGS OF THE IASTED INTERNATIONAL CONFERENCE ON TELEMATICS, 2007, : 264 - 269
  • [24] An augmented reality-based training system with a natural user interface for manual milling operations
    Chih-Kai Yang
    Yu-Hsi Chen
    Tung-Jui Chuang
    Kalpana Shankhwar
    Shana Smith
    [J]. Virtual Reality, 2020, 24 : 527 - 539
  • [25] An augmented reality-based training system with a natural user interface for manual milling operations
    Yang, Chih-Kai
    Chen, Yu-Hsi
    Chuang, Tung-Jui
    Shankhwar, Kalpana
    Smith, Shana
    [J]. VIRTUAL REALITY, 2020, 24 (03) : 527 - 539
  • [26] DEVELOPMENT OF A MIXED REALITY BASED INTERFACE FOR HUMAN ROBOT INTERACIOTN
    Cousins, Matthew
    Yang, Chenguang
    Chen, Junshen
    He, Wei
    Ju, Zhaojie
    [J]. PROCEEDINGS OF 2017 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS (ICMLC), VOL 1, 2017, : 27 - 34
  • [27] Finite element analysis results visualization of manual metal arc welding using an interactive mixed reality-based user interface
    Shankhwar, Kalpana
    Smith, Shana
    [J]. JOURNAL OF MANUFACTURING PROCESSES, 2023, 93 : 153 - 161
  • [28] Augmented reality-based robot teleoperation system using RGB-D imaging and attitude teaching device
    Pan, Yong
    Chen, Chengjun
    Li, Dongnian
    Zhao, Zhengxu
    Hong, Jun
    [J]. ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2021, 71
  • [29] Advancing Interactive Robot Learning: A User Interface Leveraging Mixed Reality and Dual Quaternions
    Feith, Nikolaus
    Rueckert, Elmar
    [J]. 2024 21ST INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS, UR 2024, 2024, : 21 - 26
  • [30] Comparison between Two Mixed Reality Environments as a Teleoperation Interface
    Manuaba, Ida Bagus Kerthyayana
    Taylor, Ken
    Gedeon, Tom
    [J]. 2011 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2011, : 1335 - 1340