DGC-TnT: Enhancing Point Cloud Object Classification by Dynamic Graph Convolutions With Transformer in Transformer

被引:0
|
作者
Lin, Chien-Chou [1 ]
Chen, Po-Yu [1 ]
机构
[1] Natl Yunlin Univ Sci & Technol, Dept Comp Sci & Informat Engn, Touliu 64002, Taiwan
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Transformers; Point cloud compression; Feature extraction; Three-dimensional displays; Computer architecture; Task analysis; Accuracy; Object detection; Object classification; dynamic graph convolution (DGC); global feature; local feature; transformer in transformer (TnT); edge-convolution (EdgeConv);
D O I
10.1109/ACCESS.2024.3442928
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, deep learning neural networks have been widely used in object classification. The process of object classification typically involves extracting features from the point cloud using neural networks and integrating these features into a global feature for recognizing the object. However, most existing methods perform well in global feature extraction but still fall short in capturing local details, or lack an attention mechanism to focus on informative feature signals. This paper presents DGC-TnT which combines dynamic graph convolution (DGC) structure with the Point-TnT module. Employing a two-stage TnT architecture, DGC-TnT utilizes a self-attention mechanism to deeply analyze local features derived from dynamic graph convolution, expanding their scope globally. This mechanism effectively operates between individual points and clusters of points, thereby enhancing overall object classification performance. DGC-TnT facilitates enhanced feature communication between points and point clusters within the point cloud through the Transformer module. On the ModelNet40 and ScanobjectNN datasets, DGC-TnT has a significant improvement in accuracy.
引用
收藏
页码:111924 / 111931
页数:8
相关论文
共 50 条
  • [31] An efficient point cloud place recognition approach based on transformer in dynamic environment
    Li, Qipeng
    Zhuang, Yuan
    Huai, Jianzhu
    Chen, Yiwen
    Yilmaz, Alper
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2024, 207 : 14 - 26
  • [32] SGFormer: Semantic Graph Transformer for Point Cloud-Based 3D Scene Graph Generation
    Lv, Changsheng
    Qi, Mengshi
    Li, Xia
    Yang, Zhengyuan
    Ma, Huadong
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 5, 2024, : 4035 - 4043
  • [33] MGT-PC: MEMORY-GUIDED TRANSFORMER FOR ROBUST POINT CLOUD CLASSIFICATION
    Lv, Huanhuan
    Jiang, Songru
    Sun, Yiming
    Liu, Jia
    Chen, Zhiyu
    Chen, Lijun
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1745 - 1749
  • [34] EGCT: enhanced graph convolutional transformer for 3D point cloud representation learning
    Chen, Gang
    Wang, Wenju
    Zhou, Haoran
    Wang, Xiaolin
    VISUAL COMPUTER, 2024, : 3239 - 3261
  • [35] An Optimized Point Cloud Classification and Object Extraction Method Using Graph Cuts
    Guo, Bo
    Zuo, Xiaohan
    IEEE ACCESS, 2020, 8 : 188515 - 188525
  • [36] PTA-Det: Point Transformer Associating Point Cloud and Image for 3D Object Detection
    Wan, Rui
    Zhao, Tianyun
    Zhao, Wei
    SENSORS, 2023, 23 (06)
  • [37] Dynamic point cloud compression with spatio-temporal transformer-style modeling
    Zhou, Yichen
    Zhang, Xinfeng
    Ma, Xiaoqi
    Xu, Yingzhan
    Zhang, Kai
    Zhang, Li
    2024 DATA COMPRESSION CONFERENCE, DCC, 2024, : 53 - 62
  • [38] Point cloud classification by dynamic graph CNN with adaptive feature fusion
    Guo, Rui
    Zhou, Yong
    Zhao, Jiaqi
    Man, Yiyun
    Liu, Minjie
    Yao, Rui
    Liu, Bing
    IET COMPUTER VISION, 2021, 15 (03) : 235 - 244
  • [39] Point Cloud Classification Using Content-Based Transformer via Clustering in Feature Space
    Liu, Yahui
    Tian, Bin
    Lv, Yisheng
    Li, Lingxi
    Wang, Fei-Yue
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2024, 11 (01) : 231 - 239
  • [40] Point Cloud Classification Using Content-Based Transformer via Clustering in Feature Space
    Yahui Liu
    Bin Tian
    Yisheng Lv
    Lingxi Li
    Fei-Yue Wang
    IEEE/CAA Journal of Automatica Sinica, 2024, 11 (01) : 231 - 239