Fusing Multiple Sensors Information into Mixed Reality-based User Interface for Robot Teleoperation

被引:1
|
作者
Zhu, Jie [1 ]
Wang, Xiangyu [1 ]
Rosenman, Michael [1 ]
机构
[1] Univ Sydney, Fac Architecture Design & Planning, Design Lab, Sydney, NSW 2006, Australia
关键词
Mixed Reality; telerobitcs; situation awareness;
D O I
10.1109/ICSMC.2009.5346781
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Mixed Reality commonly refers to the merging of real and virtual worlds to produce new visualization environments where physical and digital objects co-exist and interact in real time. Mixed Reality can also be used for fusing sensor data into the existing user interface to efficiently improve situation awareness, to facilitate the understanding of surrounding environment, and to predict the future status. The work presented in this paper fuses and then represents the real video and complementary information into one single Mixed Reality interface. A simulation platform to test the Mixed Reality interface for teleoperation is also discussed in this paper.
引用
收藏
页码:876 / 881
页数:6
相关论文
共 50 条
  • [41] Mixed Reality-based chemical reactor visualization
    Gbadago, Dela Q.
    Moon, Jiyoung
    Hwang, Sungwon
    [J]. IFAC PAPERSONLINE, 2022, 55 (07): : 580 - 585
  • [42] Mixed-Reality-Guided Teleoperation of a Collaborative Robot for Surgical Procedures
    Rus, Gabriela
    Al Hajjar, Nadim
    Tucan, Paul
    Ciocan, Andra
    Vaida, Calin
    Radu, Corina
    Chablat, Damien
    Pisla, Doina
    [J]. ADVANCES IN SERVICE AND INDUSTRIAL ROBOTICS, RAAD 2024, 2024, 157 : 233 - 241
  • [43] A robot teleoperation system based on virtual reality and WLAN
    Cui, Feng
    Zhang, Minglu
    Cui, Gencun
    Wu, Xiaolong
    [J]. WCICA 2006: SIXTH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION, VOLS 1-12, CONFERENCE PROCEEDINGS, 2006, : 197 - 197
  • [44] Workspace Scaling in Virtual Reality based Robot Teleoperation
    Omarali, Bukeikhan
    Javaid, Shafiq
    Valle, Maurizio
    Farkhatdinov, Ildar
    [J]. PROCEEDINGS OF THE 4TH AUGMENTED HUMANS INTERNATIONAL CONFERENCE 2023, AHS2023, 2023, : 98 - 104
  • [45] Teleoperation of industrial robot manipulators based on augmented reality
    Solanes, J. Ernesto
    Munoz, Adolfo
    Gracia, Luis
    Marti, Ana
    Girbes-Juan, Vicent
    Tornero, Josep
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2020, 111 (3-4): : 1077 - 1097
  • [46] Teleoperation of industrial robot manipulators based on augmented reality
    J. Ernesto Solanes
    Adolfo Muñoz
    Luis Gracia
    Ana Martí
    Vicent Girbés-Juan
    Josep Tornero
    [J]. The International Journal of Advanced Manufacturing Technology, 2020, 111 : 1077 - 1097
  • [47] Custom Silicon and Sensors Developed for a 2nd Generation Mixed Reality User Interface
    O'Connor, Patrick
    Meekhof, Casey
    McBride, Chad
    Mei, Christopher
    Bamji, Cyrus
    Rohn, Dave
    Strande, Hakon
    Forrester, Justin
    Fenton, Mike
    Haraden, Ryan
    Ozguner, Tolga
    Perry, Travis
    [J]. 2019 SYMPOSIUM ON VLSI CIRCUITS, 2019, : C186 - C187
  • [48] Custom Silicon and Sensors Developed for a 2nd Generation Mixed Reality User Interface
    O'Connor, Patrick
    Meekhof, Casey
    McBride, Chad
    Mei, Christopher
    Bamji, Cyrus
    Rohn, Dave
    Strande, Hakon
    Forrester, Justin
    Fenton, Mike
    Haraden, Ryan
    Ozguner, Tolga
    Perry, Travis
    [J]. 2019 SYMPOSIUM ON VLSI TECHNOLOGY, 2019, : C186 - C187
  • [49] ROS-based Multiple Cameras Video Streaming for a Teleoperation Interface of a Crawler Robot
    Safin, Ramil
    Lavrenov, Roman
    Martinez-Garcia, Edgar A.
    Magid, Evgeni
    [J]. JOURNAL OF ROBOTICS NETWORKING AND ARTIFICIAL LIFE, 2018, 5 (03): : 184 - 189
  • [50] User-Interface for Teleoperation with Mixed-Signal Haptic Feedback
    Thiem, Daniel B.
    Neupert, Carsten
    Bilz, Johannes
    Matich, Sebastian
    Polzin, Julian
    Werthschuetzky, Roland
    Kupnik, Mario
    Schlaak, Helmut F.
    Kirschniak, Andreas
    Hessinger, Markus
    Hatzfeld, Christian
    [J]. 2017 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2017, : 892 - 898