Robotic grasping method with 6D pose estimation and point cloud fusion

被引:0
|
作者
Ma, Haofei [1 ]
Wang, Gongcheng [1 ]
Bai, Hua [1 ]
Xia, Zhiyu [1 ]
Wang, Weidong [1 ]
Du, Zhijiang [1 ]
机构
[1] Harbin Inst Technol, Sch Mechatron Engn, State Key Lab Robot & Syst, Harbin 150001, Peoples R China
基金
中国国家自然科学基金;
关键词
Robotic grasping; Object pose estimation; Point cloud fusion;
D O I
10.1007/s00170-024-14372-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the advancement of robotics technology, industrial automation has become a trend in many scenarios. In fields such as warehousing logistics and service robotics, a reliable method for estimating the grasp pose of objects has become a necessary task. At present, many robotic grasping systems have achieved good results. However, due to the irregularity of the object surface and variation of illumination, the point cloud obtained by a single view has large holes and errors at the edge of the object. These errors easily lead to wrong estimations of grasp poses. To address these issues, this paper proposes a practical robot grasping method. The method is based on the idea of 6D pose estimation and point cloud fusion and complements the input point cloud with the model through 6D pose estimation. Then, the fused object point cloud is used to estimate the grasp pose through the Angle-View Net and fast search strategy. In order to ensure the accuracy of point cloud fusion, we use iterative closest point to correct the 6D pose. Finally, we conduct experiments in simulated and real environments, and the performance evaluation shows the feasibility of the method.
引用
收藏
页码:5603 / 5613
页数:11
相关论文
共 50 条
  • [1] Point Pair Feature based 6D pose estimation for robotic grasping
    Fu, Hejie
    Mei, XueSong
    Zhang, Zhaohui
    Zhao, Wanqiu
    Yang, Jun
    [J]. PROCEEDINGS OF 2020 IEEE 4TH INFORMATION TECHNOLOGY, NETWORKING, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (ITNEC 2020), 2020, : 1803 - 1808
  • [2] Weakly Supervised 6D Pose Estimation for Robotic Grasping
    Li, Yaoxin
    Sun, Jinghua
    Li, Xiaoqian
    Zhang, Zhanpeng
    Cheng, Hui
    Wang, Xiaogang
    [J]. PROCEEDINGS OF THE 16TH ACM SIGGRAPH INTERNATIONAL CONFERENCE ON VIRTUAL-REALITY CONTINUUM AND ITS APPLICATIONS IN INDUSTRY (VRCAI 2018), 2018,
  • [3] 6D Hybrid Pose Estimation in Cluttered Industrial Scenes for Robotic Grasping
    Peng, Yueyan
    Yang, Xuyun
    Wei, Sheng
    Gao, Xiang
    Li, Wei
    Wen, James Zhiging
    [J]. 2022 INTERNATIONAL CONFERENCE ON INDUSTRIAL AUTOMATION, ROBOTICS AND CONTROL ENGINEERING, IARCE, 2022, : 19 - 23
  • [4] 6IMPOSE: bridging the reality gap in 6D pose estimation for robotic grasping
    Cao, Hongpeng
    Dirnberger, Lukas
    Bernardini, Daniele
    Piazza, Cristina
    Caccamo, Marco
    [J]. FRONTIERS IN ROBOTICS AND AI, 2023, 10
  • [5] 6D Pose Estimation Network in Complex Point Cloud Scenes
    Chen, Haiyong
    Li, Longteng
    Chen, Peng
    Meng, Rui
    [J]. Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2022, 44 (05): : 1591 - 1601
  • [6] 6D Pose Estimation Network in Complex Point Cloud Scenes
    Chen Haiyong
    Li Longteng
    Chen Peng
    Meng Rui
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2022, 44 (05) : 1591 - 1601
  • [7] 6D Pose Estimation from Point Cloud Using an Improved Point Pair Features Method
    Wang, Haoyu
    Wang, Hesheng
    Zhuang, Chungang
    [J]. 2021 7TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS (ICCAR), 2021, : 280 - 284
  • [8] Robust Classification and 6D Pose Estimation by Sensor Dual Fusion of Image and Point Cloud Data
    Xu, Yaming
    wang, Yan
    Li, Boliang
    [J]. ACM TRANSACTIONS ON SENSOR NETWORKS, 2024, 20 (02)
  • [9] 6D Pose Estimation with Correlation Fusion
    Cheng, Yi
    Zhu, Hongyuan
    Sun, Ying
    Acar, Cihan
    Jing, Wei
    Wu, Yan
    Li, Liyuan
    Tan, Cheston
    Lim, Joo-Hwee
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 2988 - 2994
  • [10] Deep instance segmentation and 6D object pose estimation in cluttered scenes for robotic autonomous grasping
    Wu, Yongxiang
    Fu, Yili
    Wang, Shuguo
    [J]. INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2020, 47 (04): : 593 - 606