U-shaped network based on Transformer for 3D point clouds semantic segmentation

被引:0
|
作者
Zhang, Jiazhe [1 ]
Li, Xingwei [1 ]
Zhao, Xianfa [1 ]
Ge, Yizhi [1 ]
Zhang, Zheng [1 ]
机构
[1] Natl Univ Def Technol, Coll Intelligence Sci & Technol, Changsha 410073, Peoples R China
关键词
3D point clouds; semantic segmentation; Transformer; S3DIS;
D O I
10.1145/3511176.3511209
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D point clouds processing is a significant technical direction of autonomous driving, computer vision, and 3D mapping. However, due to the disorder and irregularity of 3D point clouds, it brings some challenges to its development. In recent years, Transformer, as an important technology in natural language processing, has been successfully applied in 2D image processing and achieved excellent results. Recently, relevant research on the application of Transformer on 3D point clouds has also been published. In this paper, we refer to the self-attention mechanism in the transformer architecture and propose a U-shaped network based on Transformer for 3D point clouds segmentation. And we do semantic segmentation experiments on the Stanford Large-Scale 3D Indoor Spaces Dataset (S3DIS). Experiments show that the performance of our proposed network is better than some semantic segmentation algorithms in common evaluation metrics.
引用
收藏
页码:170 / 176
页数:7
相关论文
共 50 条
  • [21] Defect segmentation with local embedding in industrial 3D point clouds based on transformer
    Jing, Junfeng
    Wang, Huaqing
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (03)
  • [22] Sweet Pepper Leaf Area Estimation Using Semantic 3D Point Clouds Based on Semantic Segmentation Neural Network
    Giang, Truong Thi Huong
    Ryoo, Young-Jae
    AGRIENGINEERING, 2024, 6 (01): : 645 - 656
  • [23] A 3D U-Net Based on a Vision Transformer for Radar Semantic Segmentation
    Zhang, Tongrui
    Fan, Yunsheng
    SENSORS, 2023, 23 (24)
  • [24] Transformer for 3D Point Clouds
    Wang, Jiayun
    Chakraborty, Rudrasis
    Yu, Stella X.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (08) : 4419 - 4431
  • [25] Hierarchical Depthwise Graph Convolutional Neural Network for 3D Semantic Segmentation of Point Clouds
    Liang, Zhidong
    Yang, Ming
    Deng, Liuyuan
    Wang, Chunxiang
    Wang, Bing
    2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 8152 - 8158
  • [26] Exploring Spatial Context for 3D Semantic Segmentation of Point Clouds
    Engelmann, Francis
    Kontogianni, Theodora
    Hermans, Alexander
    Leibe, Bastian
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, : 716 - 724
  • [27] GECNN for Weakly Supervised Semantic Segmentation of 3D Point Clouds
    He, Zifen
    Zhu, Shouye
    Huang, Ying
    Zhang, Yinhui
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2021, E104D (12) : 2237 - 2243
  • [28] A Dual-Decoding branch U-shaped semantic segmentation network combining Transformer attention with Decoder: DBUNet
    Wang, Yuefei
    Yu, Xi
    Guo, Xiaoyan
    Wang, Xilei
    Wei, Yuanhong
    Zeng, Shijie
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 95
  • [29] Global Context Reasoning for Semantic Segmentation of 3D Point Clouds
    Ma, Yanni
    Guo, Yulan
    Liu, Hao
    Lei, Yinjie
    Wen, Gongjian
    2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 2920 - 2929
  • [30] Semantic Segmentation of Geometric Primitives in Dense 3D Point Clouds
    Stanescu, Ana
    Fleck, Philipp
    Schmalstieg, Dieter
    Arth, Clemens
    ADJUNCT PROCEEDINGS OF THE 2018 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR), 2018, : 206 - 211