Topology Prediction of Branched Deformable Linear Objects Using Deep Learning

被引:0
|
作者
Ouyang, Shengzhe [1 ]
Zuern, Manuel [1 ]
Zeh, Lukas [1 ]
Lechler, Armin [1 ]
Verl, Alexander [1 ]
机构
[1] Univ Stuttgart, Inst Control Engn & Mfg Units, D-70174 Stuttgart, Germany
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Wire; Splines (mathematics); Predictive models; Image segmentation; Topology; Robots; Deep learning; Computational modeling; Annotations; Data models; Machine vision; artificial intelligence; deep learning; synthetic dataset; transfer learning; branched deformable linear objects; WIRE HARNESSES;
D O I
10.1109/ACCESS.2024.3518634
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Automated wire harness handling can improve production efficiency, increase quality, and reduce assembly costs. However, due to deformation, there are an infinite number of possible wire harness configurations, making wire harness perception a challenge. Deep learning is a popular method for computer vision but lacks datasets, models, and experiments for wire harness perception. Therefore, this paper presents a novel deep learning model to predict the configuration of a wire harness using artificially generated datasets mixed with real annotated data. The model predicts keypoints which are interpolated as cubic splines to represent the wire harness configuration with reduced degrees of freedom. We benchmark our novel model against YOLOv8-Pose and experiment with different possibilities for predicting the wire harness. As a result, our proposed approach achieves mAP@50-95 of 89.8%, which could further be integrated into robotic systems to improve the automation and precision of robotic wire harness handling.
引用
收藏
页码:194399 / 194411
页数:13
相关论文
共 50 条
  • [1] Topology Matching of Branched Deformable Linear Objects
    Zurn, Manuel
    Wnuk, Markus
    Lechler, Armin
    Verl, Alexander
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2023), 2023, : 7097 - 7103
  • [2] Pose and Category Recognition of Highly Deformable Objects Using Deep Learning
    Mariolis, Ioannis
    Peleka, Georgia
    Kargakos, Andreas
    Malassiotis, Sotiris
    PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS (ICAR), 2015, : 655 - 662
  • [3] Learning Shape Control of Elastoplastic Deformable Linear Objects
    Laezza, Rita
    Karayiannidis, Yiannis
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 4438 - 4444
  • [4] Visual-Tactile Multimodality for Following Deformable Linear Objects Using Reinforcement Learning
    Pecyna, Leszek
    Dong, Siyuan
    Luo, Shan
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 3987 - 3994
  • [5] Invariant Classification of Holograms of Deformable Objects Based on Deep Learning
    Lam, H. S.
    Tsang, P. W. M.
    2019 IEEE 28TH INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS (ISIE), 2019, : 2392 - 2396
  • [6] Online Model Learning for Shape Control of Deformable Linear Objects
    Yang, Yuxuan
    Stork, Johannes A.
    Stoyanov, Todor
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 4056 - 4062
  • [7] Tracking linear deformable objects using slicing method
    Rastegarpanah, Alireza
    Howard, Rhys
    Stolkin, Rustam
    ROBOTICA, 2022, 40 (04) : 1188 - 1206
  • [8] Learning to Propagate Interaction Effects for Modeling Deformable Linear Objects Dynamics
    Yang, Yuxuan
    Stork, Johannes A.
    Stoyanov, Todor
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 1950 - 1957
  • [9] Robotic Assembly of Deformable Linear Objects via Curriculum Reinforcement Learning
    Wu, Kai
    Chen, Rongkang
    Chen, Qi
    Li, Weihua
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (05): : 4770 - 4777
  • [10] Learning differentiable dynamics models for shape control of deformable linear objects
    Yang, Yuxuan
    Stork, Johannes A.
    Stoyanov, Todor
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2022, 158