Sim2Real for Soft Robotic Fish via Differentiable Simulation

被引:4
|
作者
Zhang, John Z. [1 ,2 ]
Zhang, Yu [1 ]
Ma, Pingchuan [3 ,4 ]
Nava, Elvis [1 ]
Du, Tao [3 ,4 ]
Arm, Philip [1 ]
Matusik, Wojciech [3 ,4 ]
Katzschmann, Robert K. [1 ,5 ]
机构
[1] Swiss Fed Inst Technol, Soft Robot Lab, Zurich, Switzerland
[2] MIT, Mech Engn, Cambridge, MA 02139 USA
[3] MIT, Comp Sci, Cambridge, MA 02139 USA
[4] MIT, AI Lab, Cambridge, MA 02139 USA
[5] Swiss Fed Inst Technol, ETH AI Ctr, Zurich, Switzerland
关键词
D O I
10.1109/IROS47612.2022.9981338
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Accurate simulation of soft mechanisms under dynamic actuation is critical for the design of soft robots. We address this gap with our differentiable simulation tool by learning the material parameters of our soft robotic fish. On the example of a soft robotic fish, we demonstrate an experimentally-verified, fast optimization pipeline for learning the material parameters from quasi-static data via differentiable simulation and apply it to the prediction of dynamic performance. Our method identifies physically plausible Young's moduli for various soft silicone elastomers and stiff acetal copolymers used in creation of our three different robotic fish tail designs. We show that our method is compatible with varying internal geometry of the actuators, such as the number of hollow cavities. Our framework allows high fidelity prediction of dynamic behavior for composite bi-morph bending structures in real hardware to millimeter-accuracy and within 3% error normalized to actuator length. We provide a differentiable and robust estimate of the thrust force using a neural network thrust predictor; this estimate allows for accurate modeling of our experimental setup measuring bollard pull. This work presents a prototypical hardware and simulation problem solved using our differentiable framework; the framework can be applied to higher dimensional parameter inference, learning control policies, and computational design due to its differentiable character.
引用
收藏
页码:12598 / 12605
页数:8
相关论文
共 50 条
  • [31] Sim2Real Transfer for Reinforcement Learning without Dynamics Randomization
    Kaspar, Manuel
    Osorio, Juan D. Munoz
    Bock, Juergen
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 4383 - 4388
  • [32] Self-Supervised Tumor Segmentation With Sim2Real Adaptation
    Zhang, Xiaoman
    Xie, Weidi
    Huang, Chaoqin
    Zhang, Ya
    Chen, Xin
    Tian, Qi
    Wang, Yanfeng
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (09) : 4373 - 4384
  • [33] Sim2Real Viewpoint Invariant Visual Servoing by Recurrent Control
    Sadeghi, Fereshteh
    Toshev, Alexander
    Jang, Eric
    Levine, Sergey
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 4691 - 4699
  • [34] Sim2Real Transfer of Reinforcement Learning for Concentric Tube Robots
    Iyengar, Keshav
    Sadati, S. M. Hadi
    Bergeles, Christos
    Spurgeon, Sarah
    Stoyanov, Danail
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (10) : 6147 - 6154
  • [35] A novel sim2real reinforcement learning algorithm for process control
    Liang, Huiping
    Xie, Junyao
    Huang, Biao
    Li, Yonggang
    Sun, Bei
    Yang, Chunhua
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2025, 254
  • [36] Sim2Joint: Dynamic hybrid model for solder joint prediction across Sim2Real
    Cao, Nieqing
    Kim, Jaewoo
    Farrag, Abdelrahman
    Won, Daehan
    Yoon, Sang Won
    ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2025, 93
  • [37] Effects of Sim2Real Image Translation via DCLGAN on Lane Keeping Assist System in CARLA Simulator
    Pahk, Jinu
    Shim, Jungseok
    Baek, Minhyeok
    Lim, Yongseob
    Choi, Gyeungho
    IEEE ACCESS, 2023, 11 : 33915 - 33927
  • [38] Multimodality Driven Impedance-Based Sim2Real Transfer Learning for Robotic Multiple Peg-in-Hole Assembly
    Chen, Wenkai
    Zeng, Chao
    Liang, Hongzhuo
    Sun, Fuchun
    Zhang, Jianwei
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (05) : 2784 - 2797
  • [39] Feature semantic space-based sim2real decision model
    Wenwen Xiao
    Xiangfeng Luo
    Shaorong Xie
    Applied Intelligence, 2023, 53 : 4890 - 4906
  • [40] Sim2Real When Data Is Scarce: Image Transformation for Industrial Applications
    Weisenboehler, Moritz
    Augenstein, Philipp
    Hein, Bjoern
    Wurll, Christian
    Furmans, Kai
    INTELLIGENT AUTONOMOUS SYSTEMS 18, VOL 2, IAS18-2023, 2024, 794 : 65 - 76