A Deep Learning-Based Autonomous Robot Manipulator for Sorting Application

被引:3
|
作者
Bui, Hoang-Dung [1 ]
Nguyen, Hai [1 ]
La, Hung Manh [1 ]
Li, Shuai [2 ]
机构
[1] Univ Nevada, Dept Comp Sci & Engn, Adv Robot & Automat ARA Lab, Reno, NV 89557 USA
[2] Swansea Univ, Coll Engn, Fabian Way, Swansea SA1 8EN, W Glam, Wales
基金
美国国家科学基金会; 美国国家航空航天局;
关键词
robot manipulation; grasping; deep learning; object sorting; ALGORITHMS; TRACKING; AGENTS;
D O I
10.1109/IRC.2020.00055
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Robot manipulation and grasping mechanisms have received considerable attention in the recent past, leading to development of wide-range of industrial applications. This paper proposes the development of an autonomous robotic grasping system for object sorting application. RGB-D data is used by the robot for performing object detection, pose estimation, trajectory generation and object sorting tasks. The proposed approach can also handle grasping on certain objects chosen by users. Trained convolutional neural networks are used to perform object detection and determine the corresponding point cloud cluster of the object to be grasped. From the selected point cloud data, a grasp generator algorithm outputs potential grasps. A grasp filter then scores these potential grasps, and the highest-scored grasp will be chosen to execute on a real robot. A motion planner will generate collision-free trajectories to execute the chosen grasp. The experiments on AUBO robotic manipulator show the potentials of the proposed approach in the context of autonomous object sorting with robust and fast sorting performance.
引用
收藏
页码:298 / 305
页数:8
相关论文
共 50 条
  • [1] Application of Deep Learning-Based Image Registration Techniques in Autonomous Robot Navigation
    Chen, Xuhan
    Wang, Tianze
    Un, Chye En
    Qin, Hongwu
    [J]. TRAITEMENT DU SIGNAL, 2024, 41 (04) : 2115 - 2122
  • [2] Deep learning-based autonomous harvesting robot design for kumquat fruit
    Gündüz, Taner
    Dersuneli, Mehmet
    Kutlu, Yakup
    [J]. Journal of the Faculty of Engineering and Architecture of Gazi University, 2024, 39 (03): : 1879 - 1892
  • [3] Integration of deep learning-based object recognition and robot manipulator for grasping objects
    Shin, Hyunsoo
    Hwang, Hyunho
    Yoon, Hyunseok
    Lee, Sungon
    [J]. 2019 16TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS (UR), 2019, : 174 - 178
  • [4] Sorting operation method of manipulator based on deep reinforcement learning
    An, Qing
    Chen, Yanhua
    Zeng, Hui
    Wang, Junhua
    [J]. INTERNATIONAL JOURNAL OF MODELING SIMULATION AND SCIENTIFIC COMPUTING, 2023, 14 (01)
  • [5] Deep Learning-Based Approach for Autonomous Vehicle Localization: Application and Experimental Analysis
    Marko, Norbert
    Horvath, Erno
    Szalay, Istvan
    Enisz, Krisztian
    [J]. MACHINES, 2023, 11 (12)
  • [6] Deep Learning-Based Intelligent Robot in Sentencing
    Chen, Xuan
    [J]. FRONTIERS IN PSYCHOLOGY, 2022, 13
  • [7] Deep Learning-Based Ensemble Approach for Autonomous Object Manipulation with an Anthropomorphic Soft Robot Hand
    Anazco, Edwin Valarezo
    Guerrero, Sara
    Lopez, Patricio Rivera
    Oh, Ji-Heon
    Ryu, Ga-Hyeon
    Kim, Tae-Seong
    [J]. ELECTRONICS, 2024, 13 (02)
  • [8] Deep Learning-based Pose Estimation for Mobile Manipulator Tasks
    Kim, Hae-Chang
    Yoon, In-Hwan
    Song, Jae-Bok
    [J]. TRANSACTIONS OF THE KOREAN SOCIETY OF MECHANICAL ENGINEERS A, 2021, 45 (12) : 1161 - 1166
  • [9] Deep Learning-based Pose Estimation for Mobile Manipulator Tasks
    Kim, Hae-Chang
    Yoon, In-Hwan
    Song, Jae-Bok
    [J]. Transactions of the Korean Society of Mechanical Engineers, A, 2022, 66 (03) : 1161 - 1166
  • [10] Deep learning-based image recognition for autonomous driving
    Fujiyoshi, Hironobu
    Hirakawa, Tsubasa
    Yamashita, Takayoshi
    [J]. IATSS RESEARCH, 2019, 43 (04) : 244 - 252