Sim2Real Neural Controllers for Physics-Based Robotic Deployment of Deformable Linear Objects

被引:5
|
作者
Tong, Dezhong [1 ]
Choi, Andrew [2 ]
Qin, Longhui [1 ,3 ]
Huang, Weicheng [1 ,3 ]
Joo, Jungseock [4 ,5 ]
Jawed, Mohammad Khalid [1 ,6 ]
机构
[1] Univ Calif Los Angeles, Dept Mech & Aerosp Engn, Los Angeles, CA USA
[2] Univ Calif Los Angeles, Dept Comp Sci, Los Angeles, CA USA
[3] Southeast Univ, Sch Mech Engn, Nanjing, Peoples R China
[4] Univ Calif Los Angeles, Dept Commun, Los Angeles, CA USA
[5] NVIDIA Corp, Santa Clara, CA USA
[6] Univ Calif Los Angeles, Dept Mech & Aerosp Engn, 420 Westwood Plaza, Los Angeles, CA 90095 USA
来源
基金
美国国家科学基金会;
关键词
Deformable object manipulation; data-driven models; deep neural networks; rope deployment; knots; ELASTIC RODS; MANIPULATION; CABLE; MODEL;
D O I
10.1177/02783649231214553
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Deformable linear objects (DLOs), such as rods, cables, and ropes, play important roles in daily life. However, manipulation of DLOs is challenging as large geometrically nonlinear deformations may occur during the manipulation process. This problem is made even more difficult as the different deformation modes (e.g., stretching, bending, and twisting) may result in elastic instabilities during manipulation. In this paper, we formulate a physics-guided data-driven method to solve a challenging manipulation task-accurately deploying a DLO (an elastic rod) onto a rigid substrate along various prescribed patterns. Our framework combines machine learning, scaling analysis, and physical simulations to develop a physics-based neural controller for deployment. We explore the complex interplay between the gravitational and elastic energies of the manipulated DLO and obtain a control method for DLO deployment that is robust against friction and material properties. Out of the numerous geometrical and material properties of the rod and substrate, we show that only three non-dimensional parameters are needed to describe the deployment process with physical analysis. Therefore, the essence of the controlling law for the manipulation task can be constructed with a low-dimensional model, drastically increasing the computation speed. The effectiveness of our optimal control scheme is shown through a comprehensive robotic case study comparing against a heuristic control method for deploying rods for a wide variety of patterns. In addition to this, we also showcase the practicality of our control scheme by having a robot accomplish challenging high-level tasks such as mimicking human handwriting, cable placement, and tying knots.
引用
收藏
页码:791 / 810
页数:20
相关论文
共 50 条
  • [31] A SIM2REAL METHOD BASED ON DDQN FOR TRAINING A SELF-DRIVING SCALE CAR
    Zhang, Qi
    Du, Tao
    Tian, Changzheng
    MATHEMATICAL FOUNDATIONS OF COMPUTING, 2019, 2 (04): : 315 - 331
  • [32] length Sim2real kinematics modeling of industrial robots based on FPGA-acceleration
    Liu, Wenzheng
    Zhao, Chun
    Liu, Yue
    Wang, Hongwei
    Zhao, Wei
    Zhang, Heming
    ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2022, 77
  • [33] Optimal model-based path planning for the robotic manipulation of deformable linear objects
    Monguzzi, Andrea
    Dotti, Tommaso
    Fattorelli, Lorenzo
    Zanchettin, Andrea Maria
    Rocco, Paolo
    ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2025, 92
  • [34] NeRF2Real: Sim2real Transfer of Vision-guided Bipedal Motion Skills using Neural Radiance Fields
    Byravan, Arunkumar
    Humplik, Jan
    Hasenclever, Leonard
    Brussee, Arthur
    Nori, Francesco
    Haarnoja, Tuomas
    Moran, Ben
    Bohez, Steven
    Sadeghi, Fereshteh
    Vujatovic, Bojan
    Heess, Nicolas
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2023), 2023, : 9362 - 9369
  • [35] Learning Nonprehensile Dynamic Manipulation: Sim2real Vision-Based Policy With a Surgical Robot
    Gondokaryono, Radian
    Haiderbhai, Mustafa
    Suryadevara, Sai Aneesh
    Kahrs, Lueder A.
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (10) : 6763 - 6770
  • [36] Sim2Real Rope Cutting With a Surgical Robot Using Vision-Based Reinforcement Learning
    Haiderbhai, Mustafa
    Gondokaryono, Radian
    Wu, Andrew
    Kahrs, Lueder A.
    IEEE Transactions on Automation Science and Engineering, 2024, : 1 - 12
  • [37] Evolving Snake Robot Controllers using Artificial Neural Networks as an Alternative to a Physics-Based Simulator
    Woodford, Grant W.
    du Plessis, Mathys C.
    Pretorius, Christiaan J.
    2015 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI), 2015, : 267 - 274
  • [38] Real-Time Acoustic Holography With Physics-Based Deep Learning for Robotic Manipulation
    Zhong, Chengxi
    Li, Jiaqi
    Sun, Zhenhuan
    Li, Teng
    Guo, Yao
    Jeong, David C.
    Su, Hu
    Liu, Song
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024, 21 (03) : 4155 - 4164
  • [39] Sim2Real Rope Cutting With a Surgical Robot Using Vision-Based Reinforcement Learning
    Haiderbhai, Mustafa
    Gondokaryono, Radian
    Wu, Andrew
    Kahrs, Lueder A.
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024, : 1 - 12
  • [40] Segmented Encoding for Sim2Real of RL-based End-to-End Autonomous Driving
    Chung, Seung-Hwan
    Kong, Seung-Hyun
    Cho, Sangjae
    Nahrendra, I. Made Aswin
    2022 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2022, : 1290 - 1296