Defect segmentation with local embedding in industrial 3D point clouds based on transformer

被引:2
|
作者
Jing, Junfeng [1 ]
Wang, Huaqing [1 ]
机构
[1] Xi An Polytech Univ, Sch Elect Informat, 19 Jinhua South Rd, Xian 710048, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
3D defect detection; 3D point cloud; local neighborhood feature; point cloud segmentation;
D O I
10.1088/1361-6501/ad1289
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Three-dimensional (3D) defect detection provides an effective method for improving industrial production efficiency. However, the 3D dataset is scarce, which is valuable for the industrial production field. This study proposes a new approach for detecting defect point clouds, which can provide an end-to-end 3D defect detection model. A self-attention mechanism is used to enrich the semantic relationships between local neighborhood features and global features based on the connection between them. Through adding multi-channel features, the rich structural features of the target point cloud are obtained, and the defect areas are accurately segmented to finally complete the 3D point cloud defect detection task. Furthermore, the multi-feature fusion in the model makes the segmented defect regions closer to the ground truth. Our method outperforms four state-of-the-art point cloud segmentation methods in terms of both segmentation region accuracy and defect detection point cloud accuracy. In the field of 3D defect detection, it provides an effective method to detect 3D information of industrial products.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Sewer defect detection from 3D point clouds using a transformer-based deep learning model
    Zhou, Yunxiang
    Ji, Ankang
    Zhang, Limao
    AUTOMATION IN CONSTRUCTION, 2022, 136
  • [22] BERT-ENHANCED WITH CONTEXT-AWARE EMBEDDING FOR INSTANCE SEGMENTATION IN 3D POINT CLOUDS
    Yang, Hongxin
    Yan, Hailun
    Wang, Ruisheng
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 7519 - 7522
  • [23] Point attention network for semantic segmentation of 3D point clouds
    Feng, Mingtao
    Zhang, Liang
    Lin, Xuefei
    Gilani, Syed Zulqarnain
    Mian, Ajmal
    PATTERN RECOGNITION, 2020, 107 (107)
  • [24] Segmentation-based classification for 3D point clouds in the road environment
    Xiang, Binbin
    Yao, Jian
    Lu, Xiaohu
    Li, Li
    Xie, Renping
    Li, Jie
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2018, 39 (19) : 6182 - 6212
  • [25] Graph based over-segmentation methods for 3D point clouds
    Ben-Shabat, Yizhak
    Avraham, Tamar
    Lindenbaum, Michael
    Fischer, Anath
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2018, 174 : 12 - 23
  • [26] A Ground Segmentation Method Based on Gradient Fields for 3D Point Clouds
    Hoang Vu
    Hieu Trong Nguyen
    Phuong Chu
    Cho, Seoungjae
    Cho, Kyungeun
    ADVANCES IN COMPUTER SCIENCE AND UBIQUITOUS COMPUTING, 2018, 474 : 388 - 393
  • [27] Graph-based Segmentation for Colored 3D Laser Point Clouds
    Strom, Johannes
    Richardson, Andrew
    Olson, Edwin
    IEEE/RSJ 2010 INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2010), 2010, : 2131 - 2136
  • [28] Joint Semantic and Instance Segmentation in 3D Point Cloud Based on Transformer
    Liu, Suyi
    Wu, Chengdong
    Xu, Fang
    Wang, Juxiang
    Chi, Jianning
    Yu, Xiaosheng
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 4074 - 4080
  • [29] Advancements in point cloud-based 3D defect classification and segmentation for industrial systems: A comprehensive survey
    Rani, Anju
    Ortiz-Arroyo, Daniel
    Durdevic, Petar
    INFORMATION FUSION, 2024, 112
  • [30] Boundary constrained voxel segmentation for 3D point clouds using local geometric differences
    Saglam, Ali
    Makineci, Hasan Bilgehan
    Baykan, Nurdan Akhan
    Baykan, Omer Kaan
    EXPERT SYSTEMS WITH APPLICATIONS, 2020, 157