Sim2Real Neural Controllers for Physics-Based Robotic Deployment of Deformable Linear Objects

被引:5
|
作者
Tong, Dezhong [1 ]
Choi, Andrew [2 ]
Qin, Longhui [1 ,3 ]
Huang, Weicheng [1 ,3 ]
Joo, Jungseock [4 ,5 ]
Jawed, Mohammad Khalid [1 ,6 ]
机构
[1] Univ Calif Los Angeles, Dept Mech & Aerosp Engn, Los Angeles, CA USA
[2] Univ Calif Los Angeles, Dept Comp Sci, Los Angeles, CA USA
[3] Southeast Univ, Sch Mech Engn, Nanjing, Peoples R China
[4] Univ Calif Los Angeles, Dept Commun, Los Angeles, CA USA
[5] NVIDIA Corp, Santa Clara, CA USA
[6] Univ Calif Los Angeles, Dept Mech & Aerosp Engn, 420 Westwood Plaza, Los Angeles, CA 90095 USA
来源
基金
美国国家科学基金会;
关键词
Deformable object manipulation; data-driven models; deep neural networks; rope deployment; knots; ELASTIC RODS; MANIPULATION; CABLE; MODEL;
D O I
10.1177/02783649231214553
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Deformable linear objects (DLOs), such as rods, cables, and ropes, play important roles in daily life. However, manipulation of DLOs is challenging as large geometrically nonlinear deformations may occur during the manipulation process. This problem is made even more difficult as the different deformation modes (e.g., stretching, bending, and twisting) may result in elastic instabilities during manipulation. In this paper, we formulate a physics-guided data-driven method to solve a challenging manipulation task-accurately deploying a DLO (an elastic rod) onto a rigid substrate along various prescribed patterns. Our framework combines machine learning, scaling analysis, and physical simulations to develop a physics-based neural controller for deployment. We explore the complex interplay between the gravitational and elastic energies of the manipulated DLO and obtain a control method for DLO deployment that is robust against friction and material properties. Out of the numerous geometrical and material properties of the rod and substrate, we show that only three non-dimensional parameters are needed to describe the deployment process with physical analysis. Therefore, the essence of the controlling law for the manipulation task can be constructed with a low-dimensional model, drastically increasing the computation speed. The effectiveness of our optimal control scheme is shown through a comprehensive robotic case study comparing against a heuristic control method for deploying rods for a wide variety of patterns. In addition to this, we also showcase the practicality of our control scheme by having a robot accomplish challenging high-level tasks such as mimicking human handwriting, cable placement, and tying knots.
引用
收藏
页码:791 / 810
页数:20
相关论文
共 50 条
  • [1] Learning Neural Force Manifolds for Sim2Real Robotic Symmetrical Paper Folding
    Choi, Andrew
    Tong, Dezhong
    Terzopoulos, Demetri
    Joo, Jungseock
    Jawed, Mohammad Khalid
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2025, 22 : 1483 - 1496
  • [2] Learning Neural Force Manifolds for Sim2Real Robotic Symmetrical Paper Folding
    Choi, Andrew
    Tong, Dezhong
    Terzopoulos, Demetri
    Joo, Jungseock
    Jawed, Mohammad Khalid
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2025, 22 : 1483 - 1496
  • [3] Neural Neural Textures Make Sim2Real Consistent
    Burgert, Ryan
    Shang, Jinghuan
    Li, Xiang
    Ryoo, Michael S.
    CONFERENCE ON ROBOT LEARNING, VOL 205, 2022, 205 : 2215 - 2225
  • [4] Sim2Real Manipulation on Unknown Objects with Tactile-based Reinforcement Learning
    Su, Entong
    Jia, Chengzhe
    Qin, Yuzhe
    Zhou, Wenxuan
    Macaluso, Annabella
    Huang, Binghao
    Wang, Xiaolong
    2024 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2024), 2024, : 9234 - 9241
  • [5] Sim2Real for Soft Robotic Fish via Differentiable Simulation
    Zhang, John Z.
    Zhang, Yu
    Ma, Pingchuan
    Nava, Elvis
    Du, Tao
    Arm, Philip
    Matusik, Wojciech
    Katzschmann, Robert K.
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 12598 - 12605
  • [6] Sim2Real Grasp Pose Estimation for Adaptive Robotic Applications
    Horvath, Daniel
    Bocsi, Kristof
    Erdos, Gabor
    Istenes, Zoltan
    IFAC PAPERSONLINE, 2023, 56 (02): : 5233 - 5239
  • [7] Sim2real Learning of Obstacle Avoidance for Robotic Manipulators in Uncertain Environments
    Zhang, Tan
    Zhang, Kefang
    Lin, Jiatao
    Louie, Wing-Yue Geoffrey
    Huang, Hui
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (01): : 65 - 72
  • [8] Object Detection Using Sim2Real Domain Randomization for Robotic Applications
    Horvath, Daniel
    Erdos, Gabor
    Istenes, Zoltan
    Horvath, Tomas
    Foldi, Sandor
    IEEE TRANSACTIONS ON ROBOTICS, 2023, 39 (02) : 1225 - 1243
  • [9] Sim-to-Real for Robotic Tactile Sensing via Physics-Based Simulation and Learned Latent Projections
    Narang, Yashraj
    Sundaralingam, Balakumar
    Macklin, Miles
    Mousavian, Arsalan
    Fox, Dieter
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 6444 - 6451
  • [10] Addressing the Sim2Real Gap in Robotic 3-D Object Classification
    Weibel, Jean-Baptiste
    Patten, Timothy
    Vincze, Markus
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (02): : 407 - 413