Flattening and folding towels with a single-arm robot based on reinforcement learning

被引:3
|
作者
Shehawy, Hassan [1 ]
Pareyson, Daniele [1 ]
Caruso, Virginia [1 ]
De Bernardi, Stefano [1 ]
Zanchettin, Andrea Maria [1 ]
Rocco, Paolo [1 ]
机构
[1] Politecn Milan, Dept Elect Informat & Bioengn DEIB, I-20133 Milan, Italy
关键词
Reinforcement learning; Robotics; Deformable objects;
D O I
10.1016/j.robot.2023.104506
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Robots can learn how to complete a variety of tasks without explicit instructions thanks to reinforce-ment learning. In this work, a piece of cloth is placed on a table and manipulated using a single-arm robot. We consider 2 forms of manipulation: flattening a crumpled towel and folding a flat one. To learn a policy that will allow the robot to select the optimum course of action based on observations of the environment, we construct a simulation environment using a gripper and a piece of cloth. After that, the policy is applied to a real robot and put to the test. Additionally, we present our method for identifying the corners of a garment using computer vision, which includes a comparison between a traditional computer vision approach with a deep learning one. We use an ABB robot and a 2D camera for the experiments and PyBullet software for the simulation.(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Dynamic Modeling and Control of Deformable Linear Objects for Single-Arm and Dual-Arm Robot Manipulations
    Lv, Naijing
    Liu, Jianhua
    Jia, Yunyi
    IEEE TRANSACTIONS ON ROBOTICS, 2022, 38 (04) : 2341 - 2353
  • [32] Viewpoint Selection for the Efficient Teleoperation of a Robot Arm Using Reinforcement Learning
    Liu, Haoxiang
    Komatsu, Ren
    Nakashima, Shinsuke
    Hamada, Hiroyuki
    Matsuhira, Nobuto
    Asama, Hajime
    Yamashita, Atsushi
    IEEE ACCESS, 2023, 11 : 119647 - 119658
  • [33] Single Leg Operational Space Control of Quadruped Robot based on Reinforcement Learning
    Rao, Jinhui
    An, Honglei
    Zhang, Taihui
    Chen, Yangzhen
    Ma, Hongxu
    2016 IEEE CHINESE GUIDANCE, NAVIGATION AND CONTROL CONFERENCE (CGNCC), 2016, : 597 - 602
  • [34] Robot Reinforcement Learning Based on Learning Classifier System
    Shao, Jie
    Yang, Jing-yu
    ADVANCED INTELLIGENT COMPUTING THEORIES AND APPLICATIONS, 2010, 93 : 200 - 207
  • [35] A Novel Single-Arm Stapling Robot for Oral and Maxillofacial Surgery-Design and Verification
    Zhang, Jingtao
    Wang, Wei
    Cai, Yueri
    Li, Jian
    Zeng, Yimeng
    Chen, Longrui
    Yuan, Fusong
    Ji, Zhenhua
    Wang, Yan
    Wyrwa, Justyna
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02) : 1348 - 1355
  • [36] Dual-Arm Robot Trajectory Planning Based on Deep Reinforcement Learning under Complex Environment
    Tang, Wanxing
    Cheng, Chuang
    Ai, Haiping
    Chen, Li
    MICROMACHINES, 2022, 13 (04)
  • [37] A Critical Period for Robust Curriculum-Based Deep Reinforcement Learning of Sequential Action in a Robot Arm
    de Kleijn, Roy
    Sen, Deniz
    Kachergis, George
    TOPICS IN COGNITIVE SCIENCE, 2022, 14 (02) : 311 - 326
  • [38] Reinforcement Learning based Control of a Quadruped Robot
    Ancy, A.
    Jisha, V. R.
    2022 IEEE 19TH INDIA COUNCIL INTERNATIONAL CONFERENCE, INDICON, 2022,
  • [39] Reinforcement learning for a vision based mobile robot
    Gaskett, C
    Fletcher, L
    Zelinsky, A
    2000 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2000), VOLS 1-3, PROCEEDINGS, 2000, : 403 - 409
  • [40] Humanoid robot control based on reinforcement learning
    Iida, S
    Kuwayama, K
    Kanoh, M
    Kato, S
    Kunitachi, T
    Itoh, H
    PROCEEDINGS OF THE 2004 INTERNATIONAL SYMPOSIUM ON MICRO-NANOMECHATRONICS AND HUMAN SCIENCE, 2004, : 353 - 358