Sim2Real Neural Controllers for Physics-Based Robotic Deployment of Deformable Linear Objects

被引:5
|
作者
Tong, Dezhong [1 ]
Choi, Andrew [2 ]
Qin, Longhui [1 ,3 ]
Huang, Weicheng [1 ,3 ]
Joo, Jungseock [4 ,5 ]
Jawed, Mohammad Khalid [1 ,6 ]
机构
[1] Univ Calif Los Angeles, Dept Mech & Aerosp Engn, Los Angeles, CA USA
[2] Univ Calif Los Angeles, Dept Comp Sci, Los Angeles, CA USA
[3] Southeast Univ, Sch Mech Engn, Nanjing, Peoples R China
[4] Univ Calif Los Angeles, Dept Commun, Los Angeles, CA USA
[5] NVIDIA Corp, Santa Clara, CA USA
[6] Univ Calif Los Angeles, Dept Mech & Aerosp Engn, 420 Westwood Plaza, Los Angeles, CA 90095 USA
来源
基金
美国国家科学基金会;
关键词
Deformable object manipulation; data-driven models; deep neural networks; rope deployment; knots; ELASTIC RODS; MANIPULATION; CABLE; MODEL;
D O I
10.1177/02783649231214553
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Deformable linear objects (DLOs), such as rods, cables, and ropes, play important roles in daily life. However, manipulation of DLOs is challenging as large geometrically nonlinear deformations may occur during the manipulation process. This problem is made even more difficult as the different deformation modes (e.g., stretching, bending, and twisting) may result in elastic instabilities during manipulation. In this paper, we formulate a physics-guided data-driven method to solve a challenging manipulation task-accurately deploying a DLO (an elastic rod) onto a rigid substrate along various prescribed patterns. Our framework combines machine learning, scaling analysis, and physical simulations to develop a physics-based neural controller for deployment. We explore the complex interplay between the gravitational and elastic energies of the manipulated DLO and obtain a control method for DLO deployment that is robust against friction and material properties. Out of the numerous geometrical and material properties of the rod and substrate, we show that only three non-dimensional parameters are needed to describe the deployment process with physical analysis. Therefore, the essence of the controlling law for the manipulation task can be constructed with a low-dimensional model, drastically increasing the computation speed. The effectiveness of our optimal control scheme is shown through a comprehensive robotic case study comparing against a heuristic control method for deploying rods for a wide variety of patterns. In addition to this, we also showcase the practicality of our control scheme by having a robot accomplish challenging high-level tasks such as mimicking human handwriting, cable placement, and tying knots.
引用
收藏
页码:791 / 810
页数:20
相关论文
共 50 条
  • [21] Multimodality Driven Impedance-Based Sim2Real Transfer Learning for Robotic Multiple Peg-in-Hole Assembly
    Chen, Wenkai
    Zeng, Chao
    Liang, Hongzhuo
    Sun, Fuchun
    Zhang, Jianwei
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (05) : 2784 - 2797
  • [22] Curriculum Design and Sim2Real Transfer for Reinforcement Learning in Robotic Dual-Arm Assembly
    Wrede, Konstantin
    Zarnack, Sebastian
    Lange, Robert
    Donath, Oliver
    Wohlfahrt, Tommy
    Feldmann, Ute
    MACHINES, 2024, 12 (10)
  • [23] Nonlinear Trajectory Control for Deformable Linear Objects based on Physics Simulation
    Hinze, Christoph
    zuern, Manuel
    Wnuk, Markus
    Lechler, Armin
    Verl, Alexander
    IECON 2020: THE 46TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, 2020, : 310 - 316
  • [24] Vision-based DRL Autonomous Driving Agent with Sim2Real Transfer
    Li, Dianzhao
    Okhrin, Ostap
    2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC, 2023, : 866 - 873
  • [25] A Motion Propagation Prediction based Sim2Real Strategy Migration for Clutter Removal
    Zhang, Jiaxin
    Zhang, Ping
    2022 18TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING, MSN, 2022, : 550 - 554
  • [26] Deep Domain Adaptation: A Sim2Real Neural Approach for Improving Eye-Tracking Systems
    Viet Dung Nguyen
    Bailey, Reynold
    Diaz, Gabriel J.
    Ma, Chengyi
    Fix, Alexander
    Ororbia, Alexander
    PROCEEDINGS OF THE ACM ON COMPUTER GRAPHICS AND INTERACTIVE TECHNIQUES, 2024, 7 (02)
  • [27] Sim2Surf: A Sim2Real Surface Classifier for Vision-Based Tactile Sensors With a Bilevel Adaptation Pipeline
    Caddeo, Gabriele M.
    Maracani, Andrea
    Alfano, Paolo D.
    Piga, Nicola A.
    Rosasco, Lorenzo
    Natale, Lorenzo
    IEEE SENSORS JOURNAL, 2025, 25 (05) : 8697 - 8709
  • [28] RL-Based Sim2Real Enhancements for Autonomous Beach-Cleaning Agents
    Quiroga, Francisco
    Hermosilla, Gabriel
    Varas, German
    Alonso, Francisco
    Schroder, Karla
    APPLIED SCIENCES-BASEL, 2024, 14 (11):
  • [29] A Dual Decision-Making Continuous Reinforcement Learning Method Based on Sim2Real
    Xiao, Wenwen
    Wang, Xinzhi
    Luo, Xiangfeng
    Xie, Shaorong
    INTERNATIONAL JOURNAL OF SOFTWARE ENGINEERING AND KNOWLEDGE ENGINEERING, 2024, 34 (03) : 467 - 488
  • [30] Robust Sim2Real Transfer with the da Vinci Research Kit: A Study On Camera, Lighting, and Physics Domain Randomization
    Haiderbhai, Mustafa
    Gondokaryono, Radian
    Looi, Thomas
    Drake, James M.
    Kahrs, Lueder A.
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 3429 - 3435