Sim2Real Neural Controllers for Physics-Based Robotic Deployment of Deformable Linear Objects

被引:5
|
作者
Tong, Dezhong [1 ]
Choi, Andrew [2 ]
Qin, Longhui [1 ,3 ]
Huang, Weicheng [1 ,3 ]
Joo, Jungseock [4 ,5 ]
Jawed, Mohammad Khalid [1 ,6 ]
机构
[1] Univ Calif Los Angeles, Dept Mech & Aerosp Engn, Los Angeles, CA USA
[2] Univ Calif Los Angeles, Dept Comp Sci, Los Angeles, CA USA
[3] Southeast Univ, Sch Mech Engn, Nanjing, Peoples R China
[4] Univ Calif Los Angeles, Dept Commun, Los Angeles, CA USA
[5] NVIDIA Corp, Santa Clara, CA USA
[6] Univ Calif Los Angeles, Dept Mech & Aerosp Engn, 420 Westwood Plaza, Los Angeles, CA 90095 USA
来源
基金
美国国家科学基金会;
关键词
Deformable object manipulation; data-driven models; deep neural networks; rope deployment; knots; ELASTIC RODS; MANIPULATION; CABLE; MODEL;
D O I
10.1177/02783649231214553
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Deformable linear objects (DLOs), such as rods, cables, and ropes, play important roles in daily life. However, manipulation of DLOs is challenging as large geometrically nonlinear deformations may occur during the manipulation process. This problem is made even more difficult as the different deformation modes (e.g., stretching, bending, and twisting) may result in elastic instabilities during manipulation. In this paper, we formulate a physics-guided data-driven method to solve a challenging manipulation task-accurately deploying a DLO (an elastic rod) onto a rigid substrate along various prescribed patterns. Our framework combines machine learning, scaling analysis, and physical simulations to develop a physics-based neural controller for deployment. We explore the complex interplay between the gravitational and elastic energies of the manipulated DLO and obtain a control method for DLO deployment that is robust against friction and material properties. Out of the numerous geometrical and material properties of the rod and substrate, we show that only three non-dimensional parameters are needed to describe the deployment process with physical analysis. Therefore, the essence of the controlling law for the manipulation task can be constructed with a low-dimensional model, drastically increasing the computation speed. The effectiveness of our optimal control scheme is shown through a comprehensive robotic case study comparing against a heuristic control method for deploying rods for a wide variety of patterns. In addition to this, we also showcase the practicality of our control scheme by having a robot accomplish challenging high-level tasks such as mimicking human handwriting, cable placement, and tying knots.
引用
收藏
页码:791 / 810
页数:20
相关论文
共 50 条
  • [41] Research on Force Control Based on Sim2Real Transfer for Stiffness of Thin-walled Parts
    Chen P.
    Li X.
    He X.
    Cai Y.
    Zhao H.
    Ding H.
    Jixie Gongcheng Xuebao/Journal of Mechanical Engineering, 2021, 57 (17): : 53 - 63
  • [42] Quantifying the Sim2Real Gap: Model-Based Verification and Validation in Autonomous Ground Systems
    Waheed, Ammar
    Areti, Madhu
    Gallantree, Luke
    Hasnain, Zohaib
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (04): : 3819 - 3826
  • [43] Real-time Acoustic Holography with Physics-based Deep Learning for Acoustic Robotic Manipulation
    Zhong, Chengxi
    Sun, Zhenhuan
    Lyu, Kunyong
    Guo, Yao
    Liu, Song
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 1083 - 1089
  • [44] NeuTac: Zero-Shot Sim2Real Measurement for Neuromorphic Vision-Based Tactile Sensors
    Salah, Mohammed
    Zaid, Islam Mohamed
    Halwani, Mohamad
    Sajwani, Hussain
    Solayman, Abdullah
    Ayyad, Abdulla
    Azzam, Rana
    Abusafieh, Abdelqader
    Zweiri, Yahya
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [45] High-throughput instance segmentation and shape restoration of overlapping vegetable seeds based on sim2real method
    Liang, Ning
    Sun, Sashuang
    Zhou, Lei
    Zhao, Nan
    Taha, Mohamed Farag
    He, Yong
    Qiu, Zhengjun
    MEASUREMENT, 2023, 207
  • [46] Engine Agnostic Graph Environments for Robotics (EAGERx): A Graph-Based Framework for Sim2real Robot Learning
    van der Heijden, Bas
    Luijkx, Jelle
    Ferranti, Laura
    Kober, Jens
    Babuska, Robert
    IEEE ROBOTICS & AUTOMATION MAGAZINE, 2024,
  • [47] Enhancing Colorectal Cancer Diagnosis Through Generative Models and Vision-Based Tactile Sensing: A Sim2Real Study
    Kapuria, Siddhartha
    Ikoma, Naruhiko
    Chinchali, Sandeep
    Alambeigi, Farshid
    IMAGING INFORMATICS FOR HEALTHCARE, RESEARCH, AND APPLICATIONS, MEDICAL IMAGING 2024, 2024, 12931
  • [48] TGF-Net: Sim2Real Transparent Object 6D Pose Estimation Based on Geometric Fusion
    Yu, Haixin
    Li, Shoujie
    Liu, Houde
    Xia, Chongkun
    Ding, Wenbo
    Liang, Bin
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (06): : 3867 - 3874
  • [49] Generating PET Attenuation Maps via Sim2Real Deep Learning-Based Tissue Composition Estimation Combined with MLACF
    Kobayashi, Tetsuya
    Shigeki, Yui
    Yamakawa, Yoshiyuki
    Tsutsumida, Yumi
    Mizuta, Tetsuro
    Hanaoka, Kohei
    Watanabe, Shota
    Morimoto-Ishikawa, Daisuke
    Yamada, Takahiro
    Kaida, Hayato
    Ishii, Kazunari
    JOURNAL OF IMAGING INFORMATICS IN MEDICINE, 2024, 37 (01): : 167 - 179
  • [50] General-Purpose Sim2Real Protocol for Learning Contact-Rich Manipulation With Marker-Based Visuotactile Sensors
    Chen, Weihang
    Xu, Jing
    Xiang, Fanbo
    Yuan, Xiaodi
    Su, Hao
    Chen, Rui
    IEEE TRANSACTIONS ON ROBOTICS, 2024, 40 : 1509 - 1526