Defect segmentation with local embedding in industrial 3D point clouds based on transformer

被引:2
|
作者
Jing, Junfeng [1 ]
Wang, Huaqing [1 ]
机构
[1] Xi An Polytech Univ, Sch Elect Informat, 19 Jinhua South Rd, Xian 710048, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
3D defect detection; 3D point cloud; local neighborhood feature; point cloud segmentation;
D O I
10.1088/1361-6501/ad1289
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Three-dimensional (3D) defect detection provides an effective method for improving industrial production efficiency. However, the 3D dataset is scarce, which is valuable for the industrial production field. This study proposes a new approach for detecting defect point clouds, which can provide an end-to-end 3D defect detection model. A self-attention mechanism is used to enrich the semantic relationships between local neighborhood features and global features based on the connection between them. Through adding multi-channel features, the rich structural features of the target point cloud are obtained, and the defect areas are accurately segmented to finally complete the 3D point cloud defect detection task. Furthermore, the multi-feature fusion in the model makes the segmented defect regions closer to the ground truth. Our method outperforms four state-of-the-art point cloud segmentation methods in terms of both segmentation region accuracy and defect detection point cloud accuracy. In the field of 3D defect detection, it provides an effective method to detect 3D information of industrial products.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Clusterformer: Cluster-based Transformer for 3D Object Detection in Point Clouds
    Pei, Yu
    Zhao, Xian
    Li, Hao
    Ma, Jingyuan
    Zhang, Jingwei
    Pu, Shiliang
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 6641 - 6650
  • [32] Scalable SoftGroup for 3D Instance Segmentation on Point Clouds
    Vu, Thang
    Kim, Kookhoi
    Nguyen, Thanh
    Luu, Tung M.
    Kim, Junyeong
    Yoo, Chang D.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (04) : 1981 - 1995
  • [33] GrowSP: Unsupervised Semantic Segmentation of 3D Point Clouds
    Zhang, Zihui
    Yang, Bo
    Wang, Bing
    Li, Bo
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 17619 - 17629
  • [34] Fast Segmentation of 3D Point Clouds for Ground Vehicles
    Himmelsbach, M.
    v. Hundelshausen, Felix
    Wuensche, H. -J.
    2010 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2010, : 560 - 565
  • [35] BPNet: Bezier Primitive Segmentation on 3D Point Clouds
    Fu, Rao
    Wen, Cheng
    Li, Qian
    Xiao, Xiao
    Alliez, Pierre
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 754 - 762
  • [36] 3D Segmentation of Humans in Point Clouds with Synthetic Data
    Takmaz, Ayca
    Schult, Jonas
    Kaftan, Irem
    Akcay, Mertcan
    Leibe, Bastian
    Sumner, Robert
    Engelmann, Francis
    Tang, Siyu
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 1292 - 1304
  • [37] Recurrent Slice Networks for 3D Segmentation of Point Clouds
    Huang, Qiangui
    Wang, Weiyue
    Neumann, Ulrich
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 2626 - 2635
  • [38] 3D Point Clouds Segmentation for Autonomous Ground Vehicle
    Habermann, Danilo
    Hata, Alberto
    Wolf, Denis
    Osorio, Fernando
    2013 III BRAZILIAN SYMPOSIUM ON COMPUTING SYSTEMS ENGINEERING (SBESC 2013), 2013, : 143 - 148
  • [39] Using t-distributed stochastic neighbor embedding for visualization and segmentation of 3D point clouds of plants
    Dutagaci, Helin
    TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES, 2023, 31 (05) : 792 - 813
  • [40] Depth grid-based local description for 3D point clouds
    Sa, Jiming
    Zhang, Xuecheng
    Zhang, Chi
    Song, Yuyan
    Ding, Liwei
    Huang, Yechen
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (05) : 4085 - 4102