Topology Prediction of Branched Deformable Linear Objects Using Deep Learning

被引:0
|
作者
Ouyang, Shengzhe [1 ]
Zuern, Manuel [1 ]
Zeh, Lukas [1 ]
Lechler, Armin [1 ]
Verl, Alexander [1 ]
机构
[1] Univ Stuttgart, Inst Control Engn & Mfg Units, D-70174 Stuttgart, Germany
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Wire; Splines (mathematics); Predictive models; Image segmentation; Topology; Robots; Deep learning; Computational modeling; Annotations; Data models; Machine vision; artificial intelligence; deep learning; synthetic dataset; transfer learning; branched deformable linear objects; WIRE HARNESSES;
D O I
10.1109/ACCESS.2024.3518634
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Automated wire harness handling can improve production efficiency, increase quality, and reduce assembly costs. However, due to deformation, there are an infinite number of possible wire harness configurations, making wire harness perception a challenge. Deep learning is a popular method for computer vision but lacks datasets, models, and experiments for wire harness perception. Therefore, this paper presents a novel deep learning model to predict the configuration of a wire harness using artificially generated datasets mixed with real annotated data. The model predicts keypoints which are interpolated as cubic splines to represent the wire harness configuration with reduced degrees of freedom. We benchmark our novel model against YOLOv8-Pose and experiment with different possibilities for predicting the wire harness. As a result, our proposed approach achieves mAP@50-95 of 89.8%, which could further be integrated into robotic systems to improve the automation and precision of robotic wire harness handling.
引用
收藏
页码:194399 / 194411
页数:13
相关论文
共 50 条
  • [21] Self-Supervised Learning of State Estimation for Manipulating Deformable Linear Objects
    Yan, Mengyuan
    Zhu, Yilin
    Jin, Ning
    Bohg, Jeannette
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (02): : 2372 - 2379
  • [22] Learning Graph Dynamics With External Contact for Deformable Linear Objects Shape Control
    Huang, Yichen
    Xia, Chongkun
    Wang, Xueqian
    Liang, Bin
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (06) : 3891 - 3898
  • [23] Hologram classification of occluded and deformable objects with speckle noise contamination by deep learning
    Lam, H. H. S.
    Tsang, P. W. M.
    Poon, T-C
    JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2022, 39 (03) : 411 - 417
  • [24] Prediction of Optimal Solvers for Sparse Linear Systems Using Deep Learning
    Funk, Yannick
    Goetz, Markus
    Anzt, Hartwig
    PROCEEDINGS OF THE 2022 SIAM CONFERENCE ON PARALLEL PROCESSING FOR SCIENTIFIC COMPUTING, PP, 2022, : 14 - 24
  • [25] Manipulating deformable linear objects: Programming using different manipulation skills
    Schlechter, A.
    Henrich, D.
    2002, VDI Verlag GMBH
  • [26] Reconstruction of Mixed Boundary Objects and Classification Using Deep Learning and Linear Sampling Method
    Harisha, Shimoga Beerappa
    Mallikarjun, Erramshetty
    Amit, Magdum
    RADIOENGINEERING, 2024, 33 (02) : 299 - 311
  • [27] Knotting/unknotting manipulation of deformable linear objects
    Wakamatsu, H
    Arai, E
    Hirai, S
    INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2006, 25 (04): : 371 - 395
  • [28] Planar Shape Control of Deformable Linear Objects
    Almaghout, Karam
    Klimchik, Alexandr
    IFAC PAPERSONLINE, 2022, 55 (10): : 2469 - 2474
  • [29] Optimized linear FEM for modeling deformable objects
    Garcia, Marcos
    Mendoza, Cesar
    Pastor, Luis
    Rodriguez, Angel
    COMPUTER ANIMATION AND VIRTUAL WORLDS, 2006, 17 (3-4) : 393 - 402
  • [30] Robotic Manipulation of Deformable Linear Objects: A Survey
    Yu, Mingrui
    Li, Xiang
    Jiqiren/Robot, 2024, 46 (05): : 623 - 640