Defect segmentation with local embedding in industrial 3D point clouds based on transformer

被引:2
|
作者
Jing, Junfeng [1 ]
Wang, Huaqing [1 ]
机构
[1] Xi An Polytech Univ, Sch Elect Informat, 19 Jinhua South Rd, Xian 710048, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
3D defect detection; 3D point cloud; local neighborhood feature; point cloud segmentation;
D O I
10.1088/1361-6501/ad1289
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Three-dimensional (3D) defect detection provides an effective method for improving industrial production efficiency. However, the 3D dataset is scarce, which is valuable for the industrial production field. This study proposes a new approach for detecting defect point clouds, which can provide an end-to-end 3D defect detection model. A self-attention mechanism is used to enrich the semantic relationships between local neighborhood features and global features based on the connection between them. Through adding multi-channel features, the rich structural features of the target point cloud are obtained, and the defect areas are accurately segmented to finally complete the 3D point cloud defect detection task. Furthermore, the multi-feature fusion in the model makes the segmented defect regions closer to the ground truth. Our method outperforms four state-of-the-art point cloud segmentation methods in terms of both segmentation region accuracy and defect detection point cloud accuracy. In the field of 3D defect detection, it provides an effective method to detect 3D information of industrial products.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Graph Transformer for 3D point clouds classification and semantic segmentation
    Zhou, Wei
    Wang, Qian
    Jin, Weiwei
    Shi, Xinzhe
    He, Ying
    COMPUTERS & GRAPHICS-UK, 2024, 124
  • [2] Transformer for 3D Point Clouds
    Wang, Jiayun
    Chakraborty, Rudrasis
    Yu, Stella X.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (08) : 4419 - 4431
  • [3] U-shaped network based on Transformer for 3D point clouds semantic segmentation
    Zhang, Jiazhe
    Li, Xingwei
    Zhao, Xianfa
    Ge, Yizhi
    Zhang, Zheng
    2021 THE 5TH INTERNATIONAL CONFERENCE ON VIDEO AND IMAGE PROCESSING, ICVIP 2021, 2021, : 170 - 176
  • [4] MATNet: Semantic segmentation of 3D point clouds with multiscale adaptive transformer
    Zheng, Yufei
    Lu, Jian
    Chen, Xiaogai
    Zhang, Kaibing
    Zhou, Jian
    COMPUTERS & ELECTRICAL ENGINEERING, 2024, 119
  • [5] Local Transformer Network on 3D Point Cloud Semantic Segmentation
    Wang, Zijun
    Wang, Yun
    An, Lifeng
    Liu, Jian
    Liu, Haiyang
    INFORMATION, 2022, 13 (04)
  • [6] On the Segmentation of 3D LIDAR Point Clouds
    Douillard, B.
    Underwood, J.
    Kuntz, N.
    Vlaskine, V.
    Quadros, A.
    Morton, P.
    Frenkel, A.
    2011 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2011,
  • [7] Segmentation-Based Classification for 3D Urban Point Clouds
    Xiang, Binbin
    Yao, Jian
    Lu, Xiaohu
    Li, Li
    Xie, Renping
    2016 IEEE INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION (ICIA), 2016, : 172 - 177
  • [8] Exemplar-Based 3D Shape Segmentation in Point Clouds
    Qiu, Rongqi
    Neumann, Ulrich
    PROCEEDINGS OF 2016 FOURTH INTERNATIONAL CONFERENCE ON 3D VISION (3DV), 2016, : 203 - 211
  • [9] GPU-based supervoxel segmentation for 3D point clouds
    Dong, Xiao
    Xiao, Yanyang
    Chen, Zhonggui
    Yao, Junfeng
    Guo, Xiaohu
    COMPUTER AIDED GEOMETRIC DESIGN, 2022, 93
  • [10] Object Detection in 3D Point Clouds via Local Correlation-Aware Point Embedding
    Wu, Chengzhi
    Pfrommer, Julius
    Beyerer, Jurgen
    Li, Kangning
    Neubert, Boris
    2020 Joint 9th International Conference on Informatics, Electronics and Vision and 2020 4th International Conference on Imaging, Vision and Pattern Recognition, ICIEV and icIVPR 2020, 2020,