Flattening and folding towels with a single-arm robot based on reinforcement learning

被引:3
|
作者
Shehawy, Hassan [1 ]
Pareyson, Daniele [1 ]
Caruso, Virginia [1 ]
De Bernardi, Stefano [1 ]
Zanchettin, Andrea Maria [1 ]
Rocco, Paolo [1 ]
机构
[1] Politecn Milan, Dept Elect Informat & Bioengn DEIB, I-20133 Milan, Italy
关键词
Reinforcement learning; Robotics; Deformable objects;
D O I
10.1016/j.robot.2023.104506
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Robots can learn how to complete a variety of tasks without explicit instructions thanks to reinforce-ment learning. In this work, a piece of cloth is placed on a table and manipulated using a single-arm robot. We consider 2 forms of manipulation: flattening a crumpled towel and folding a flat one. To learn a policy that will allow the robot to select the optimum course of action based on observations of the environment, we construct a simulation environment using a gripper and a piece of cloth. After that, the policy is applied to a real robot and put to the test. Additionally, we present our method for identifying the corners of a garment using computer vision, which includes a comparison between a traditional computer vision approach with a deep learning one. We use an ABB robot and a 2D camera for the experiments and PyBullet software for the simulation.(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Flattening Clothes with a Single-Arm Robot Based on Reinforcement Learning
    Shehawy, Hassan
    Pareyson, Daniele
    Caruso, Virginia
    Zanchettin, Andrea Maria
    Rocco, Paolo
    INTELLIGENT AUTONOMOUS SYSTEMS 17, IAS-17, 2023, 577 : 580 - 595
  • [2] Teaching a single-arm robot to fold towels
    Yashinski M.
    Science Robotics, 2023, 8 (84):
  • [3] Picking up One of the Folded and Stacked Towels by a Single Arm Robot
    Demura, Satonori
    Sano, Kazuki
    Nakajima, Wataru
    Nagahama, Kotaro
    Takeshita, Keisuke
    Yamazaki, Kimitoshi
    2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2018, : 1551 - 1556
  • [4] A Precise Method for Cloth Configuration Parsing Applied to Single-arm Flattening
    Sun, Li
    Camarasa, Gerardo Aragon
    Khan, Aamir
    Rogers, Simon
    Siebert, Paul
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2016, 13
  • [5] Autonomous Loading of a Washing Machine with a Single-arm Robot
    Shehawy, Hassan
    Zanchettin, Andrea Maria
    Rocco, Paolo
    PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON INFORMATICS IN CONTROL, AUTOMATION AND ROBOTICS (ICINCO), 2022, : 443 - 450
  • [6] Reinforcement Learning Control for Robot Arm Grasping Based on Improved DDPG
    Qi, Guangjun
    Li, Yuan
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 4132 - 4137
  • [7] A Single-arm Mode for Operating Steering Wheel in Robot Driving
    Zhu, Xin
    Chen, Xuechao
    Chen, Kehong
    Dong, Yue
    Cai, Zhaoyang
    Chen, Zhuo
    2024 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION, ICMA 2024, 2024, : 1037 - 1043
  • [8] Coordinated Transportation of Dual-arm Robot Based on Deep Reinforcement Learning
    Hao, Zixuan
    Chen, Gang
    Huang, Zeyuan
    Jia, Qingxuan
    Liu, Yu
    Yao, Zhipeng
    2024 IEEE 19TH CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS, ICIEA 2024, 2024,
  • [9] Motion simulation of robot arm using reinforcement learning
    Oshiro, Takahito
    Watanabe, Kajiro
    PROCEEDINGS OF SICE ANNUAL CONFERENCE, VOLS 1-8, 2007, : 1073 - 1076
  • [10] Biological robot arm motion through reinforcement learning
    Izawa, J
    Kondo, T
    Ito, K
    SICE 2002: PROCEEDINGS OF THE 41ST SICE ANNUAL CONFERENCE, VOLS 1-5, 2002, : 413 - 418