Sim2Real for Soft Robotic Fish via Differentiable Simulation

被引:4
|
作者
Zhang, John Z. [1 ,2 ]
Zhang, Yu [1 ]
Ma, Pingchuan [3 ,4 ]
Nava, Elvis [1 ]
Du, Tao [3 ,4 ]
Arm, Philip [1 ]
Matusik, Wojciech [3 ,4 ]
Katzschmann, Robert K. [1 ,5 ]
机构
[1] Swiss Fed Inst Technol, Soft Robot Lab, Zurich, Switzerland
[2] MIT, Mech Engn, Cambridge, MA 02139 USA
[3] MIT, Comp Sci, Cambridge, MA 02139 USA
[4] MIT, AI Lab, Cambridge, MA 02139 USA
[5] Swiss Fed Inst Technol, ETH AI Ctr, Zurich, Switzerland
关键词
D O I
10.1109/IROS47612.2022.9981338
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Accurate simulation of soft mechanisms under dynamic actuation is critical for the design of soft robots. We address this gap with our differentiable simulation tool by learning the material parameters of our soft robotic fish. On the example of a soft robotic fish, we demonstrate an experimentally-verified, fast optimization pipeline for learning the material parameters from quasi-static data via differentiable simulation and apply it to the prediction of dynamic performance. Our method identifies physically plausible Young's moduli for various soft silicone elastomers and stiff acetal copolymers used in creation of our three different robotic fish tail designs. We show that our method is compatible with varying internal geometry of the actuators, such as the number of hollow cavities. Our framework allows high fidelity prediction of dynamic behavior for composite bi-morph bending structures in real hardware to millimeter-accuracy and within 3% error normalized to actuator length. We provide a differentiable and robust estimate of the thrust force using a neural network thrust predictor; this estimate allows for accurate modeling of our experimental setup measuring bollard pull. This work presents a prototypical hardware and simulation problem solved using our differentiable framework; the framework can be applied to higher dimensional parameter inference, learning control policies, and computational design due to its differentiable character.
引用
收藏
页码:12598 / 12605
页数:8
相关论文
共 50 条
  • [1] Rethinking Sim2Real: Lower Fidelity Simulation Leads to Higher Sim2Real Transfer in Navigation
    Truong, Joanne
    Rudolph, Max
    Yokoyama, Naoki
    Chernova, Sonia
    Batra, Dhruv
    Rai, Akshara
    CONFERENCE ON ROBOT LEARNING, VOL 205, 2022, 205 : 859 - 870
  • [2] Sim2Real Grasp Pose Estimation for Adaptive Robotic Applications
    Horvath, Daniel
    Bocsi, Kristof
    Erdos, Gabor
    Istenes, Zoltan
    IFAC PAPERSONLINE, 2023, 56 (02): : 5233 - 5239
  • [3] Sim2real Learning of Obstacle Avoidance for Robotic Manipulators in Uncertain Environments
    Zhang, Tan
    Zhang, Kefang
    Lin, Jiatao
    Louie, Wing-Yue Geoffrey
    Huang, Hui
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (01): : 65 - 72
  • [4] Object Detection Using Sim2Real Domain Randomization for Robotic Applications
    Horvath, Daniel
    Erdos, Gabor
    Istenes, Zoltan
    Horvath, Tomas
    Foldi, Sandor
    IEEE TRANSACTIONS ON ROBOTICS, 2023, 39 (02) : 1225 - 1243
  • [5] Learning Neural Force Manifolds for Sim2Real Robotic Symmetrical Paper Folding
    Choi, Andrew
    Tong, Dezhong
    Terzopoulos, Demetri
    Joo, Jungseock
    Jawed, Mohammad Khalid
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2025, 22 : 1483 - 1496
  • [6] Learning Neural Force Manifolds for Sim2Real Robotic Symmetrical Paper Folding
    Choi, Andrew
    Tong, Dezhong
    Terzopoulos, Demetri
    Joo, Jungseock
    Jawed, Mohammad Khalid
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2025, 22 : 1483 - 1496
  • [7] Addressing the Sim2Real Gap in Robotic 3-D Object Classification
    Weibel, Jean-Baptiste
    Patten, Timothy
    Vincze, Markus
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (02): : 407 - 413
  • [8] Learning Switching Criteria for Sim2Real Transfer of Robotic Fabric Manipulation Policies
    Sharma, Satvik
    Novoseller, Ellen
    Viswanath, Vainavi
    Javed, Zaynah
    Parikh, Rishi
    Hoque, Ryan
    Balakrishna, Ashwin
    Brown, Daniel S.
    Goldberg, Ken
    2022 IEEE 18TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE), 2022, : 1116 - 1123
  • [9] Sim2real: Issues in transferring autonomous driving model from simulation to real world
    Revell, Jacob
    Welch, Dominic
    Hereford, James
    SOUTHEASTCON 2022, 2022, : 296 - 301
  • [10] Sim2Real Predictivity: Does Evaluation in Simulation Predict Real-World Performance?
    Kadian, Abhishek.
    Truong, Joanne
    Gokaslan, Aaron
    Clegg, Alexander
    Wijmans, Erik
    Lee, Stefan
    Savva, Manolis
    Chernova, Sonia
    Batra, Dhruv
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (04): : 6670 - 6677