Whole-Body Multi-Modal Semi-Autonomous Teleoperation of Mobile Manipulator Systems

被引:0
|
作者
Ha, ChangSu [1 ,2 ]
Park, Sangyul [1 ,2 ]
Her, Jongbeom [1 ,2 ]
Jang, Inyoung [1 ,2 ]
Lee, Yongseok [1 ,2 ]
Cho, Gun Rae [3 ]
Son, Hyoung Il [4 ]
Lee, Dongjun [1 ,2 ]
机构
[1] Seoul Natl Univ, Dept Mech & Aerosp Engn, Seoul, South Korea
[2] Seoul Natl Univ, IAMD, Seoul, South Korea
[3] Samsung Heavy Ind CO LTD, Mech Ctr, Daejeon 305380, South Korea
[4] Chonnam Natl Univ, Dept Rural & Biosyst Engn, Gwangju 500757, South Korea
关键词
BILATERAL TELEOPERATION; MOTION CONTROL;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We propose a novel whole-body multi-modal semi-autonomous teleoperation framework for mobile manipulator systems, which consists of: 1) Motion capture and whole-body motion mapping to allow the operator to intuitively teleoperate the mobile manipulator without being constrained by the master interface while also fully exploiting whole-body dexterity; 2) Slave robot autonomous control to allow the mobile manipulator to optimally track the operator's whole-body command, while taking into account the user-slave kinematic dissimilarity (slave robot's joint limit, joint velocity limit, and singularity); and 3) Visuo-haptic-vestibular feedback with HMD (Head Mounted Display) for 3D visual information, wearable cutaneous haptic device for manipulation force feedback, and actuated chair for vestibular feedback to reduce HMD-induced motion sickness. Performance of the proposed framework is validated with simulation of a ROV (remotely operated vehicle) manipulator system and some preliminary user studies.
引用
收藏
页码:164 / 170
页数:7
相关论文
共 50 条
  • [41] A Novel Online Whole-Body Motion Planning Algorithm for Supervisory Control of a Legged Mobile Manipulator
    Bhavanibhatla K.
    Suresh-Fazeela S.
    Pratihar D.K.
    [J]. Journal of The Institution of Engineers (India): Series C, 2021, 102 (03) : 563 - 575
  • [42] Wearable haptic-based multi-modal teleloperation of field mobile manipulator for explosive ordnance disposal
    Ryu, D
    Hwang, CS
    Kang, S
    Kim, M
    Song, JB
    [J]. 2005 IEEE INTERNATIONAL WORKSHOP ON SAFETY, SECURITY AND RESCUE ROBOTS, 2005, : 75 - 80
  • [43] Design of Multi-Modal Ship Mobile Ad Hoc Network under the Guidance of an Autonomous Ship
    Wang, Xiaohui
    Zhang, Yingjun
    Liu, Zhaoda
    Wang, Shaobo
    Zou, Yiyang
    [J]. JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (05)
  • [44] SEMI-AUTONOMOUS COLLABORATIVE CONTROL OF MULTI-ROBOTIC SYSTEMS FOR MULTI-TASK MULTI-TARGET PAIRING
    Cheung, Yushing
    Chung, Jae H.
    Patel, Ketula
    [J]. PROCEEDINGS OF THE ASME INTERNATIONAL MECHANICAL ENGINEERING CONGRESS AND EXPOSITION, 2011, VOL 7, PTS A AND B, 2012, : 259 - 268
  • [45] Momentum based Whole-Body Optimal Planning for a Single-Spherical-Wheeled Balancing Mobile Manipulator
    Shu, Roberto
    Hollis, Ralph
    [J]. 2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 3221 - 3226
  • [46] Software/Hardware Co-design for Multi-modal Multi-task Learning in Autonomous Systems
    Hao, Cong
    Chen, Deming
    [J]. 2021 IEEE 3RD INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS), 2021,
  • [47] Creation of radiated sound intensity maps using multi-modal measurements onboard an autonomous mobile platform
    Even, Jani
    Kallakuri, Nagasrikanth
    Morales, Yoichi
    Ishi, Carlos
    Hagita, Norihiro
    [J]. 2013 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2013, : 3433 - 3438
  • [48] WiP Abstract: System-Level Integration of Mobile Multi-Modal Multi-Sensor Systems
    Zhang, Jiaxing
    Qiu, Hanjiao
    Shamsabadi, Salar Shahini
    Birken, Ralf
    Schirner, Gunar
    [J]. 2014 ACM/IEEE INTERNATIONAL CONFERENCE ON CYBER-PHYSICAL SYSTEMS (ICCPS), 2014, : 227 - 227
  • [49] Weakly Supervised Multi-Modal 3D Human Body Pose Estimation for Autonomous Driving
    Bauer, Peter
    Bouazizi, Arij
    Kressel, Ulrich
    Flohr, Fabian B.
    [J]. 2023 IEEE INTELLIGENT VEHICLES SYMPOSIUM, IV, 2023,
  • [50] Whole-body Control of Non-holonomic Mobile Manipulator Based on Hierarchical Quadratic Programming and Continuous Task Transition
    Kim, Sanghyun
    Jang, Keunwoo
    Park, Suhan
    Lee, Yisoo
    Lee, Sang Yup
    Park, Jaeheung
    [J]. 2019 IEEE 4TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2019), 2019, : 414 - 419