DGC-TnT: Enhancing Point Cloud Object Classification by Dynamic Graph Convolutions With Transformer in Transformer

被引:0
|
作者
Lin, Chien-Chou [1 ]
Chen, Po-Yu [1 ]
机构
[1] Natl Yunlin Univ Sci & Technol, Dept Comp Sci & Informat Engn, Touliu 64002, Taiwan
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Transformers; Point cloud compression; Feature extraction; Three-dimensional displays; Computer architecture; Task analysis; Accuracy; Object detection; Object classification; dynamic graph convolution (DGC); global feature; local feature; transformer in transformer (TnT); edge-convolution (EdgeConv);
D O I
10.1109/ACCESS.2024.3442928
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, deep learning neural networks have been widely used in object classification. The process of object classification typically involves extracting features from the point cloud using neural networks and integrating these features into a global feature for recognizing the object. However, most existing methods perform well in global feature extraction but still fall short in capturing local details, or lack an attention mechanism to focus on informative feature signals. This paper presents DGC-TnT which combines dynamic graph convolution (DGC) structure with the Point-TnT module. Employing a two-stage TnT architecture, DGC-TnT utilizes a self-attention mechanism to deeply analyze local features derived from dynamic graph convolution, expanding their scope globally. This mechanism effectively operates between individual points and clusters of points, thereby enhancing overall object classification performance. DGC-TnT facilitates enhanced feature communication between points and point clusters within the point cloud through the Transformer module. On the ModelNet40 and ScanobjectNN datasets, DGC-TnT has a significant improvement in accuracy.
引用
收藏
页码:111924 / 111931
页数:8
相关论文
共 50 条
  • [21] Enhancing point cloud registration with transformer: cultural heritage protection of the Terracotta Warriors
    Wang, Yong
    Zhou, Pengbo
    Geng, Guohua
    An, Li
    Zhou, Mingquan
    HERITAGE SCIENCE, 2024, 12 (01):
  • [22] Point cloud completion by dynamic transformer with adaptive neighbourhood feature fusion
    Liu, Xinpu
    Xu, Guoquan
    Xu, Ke
    Wan, Jianwei
    Ma, Yanxin
    IET COMPUTER VISION, 2022, 16 (07) : 619 - 631
  • [23] Hierarchical Graph Interaction Transformer With Dynamic Token Clustering for Camouflaged Object Detection
    Yao, Siyuan
    Sun, Hao
    Xiang, Tian-Zhu
    Wang, Xiao
    Cao, Xiaochun
    IEEE Transactions on Image Processing, 2024, 33 : 5936 - 5948
  • [24] Graph Transformer for 3D point clouds classification and semantic segmentation
    Zhou, Wei
    Wang, Qian
    Jin, Weiwei
    Shi, Xinzhe
    He, Ying
    COMPUTERS & GRAPHICS-UK, 2024, 124
  • [25] ALS Point Cloud Semantic Segmentation Based on Graph Convolution and Transformer With Elevation Attention
    Huang, Shuowen
    Hu, Qingwu
    Zhao, Pengcheng
    Li, Jiayuan
    Ai, Mingyao
    Wang, Shaohua
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 2877 - 2889
  • [26] 6-D Object Pose Estimation Using Multiscale Point Cloud Transformer
    Zhou, Guangliang
    Wang, Deming
    Yan, Yi
    Liu, Chengju
    Chen, Qijun
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [27] 6-D Object Pose Estimation Using Multiscale Point Cloud Transformer
    Zhou, Guangliang
    Wang, Deming
    Yan, Yi
    Liu, Chengju
    Chen, Qijun
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [28] Point Cloud Classification Network Based on Dynamic Graph Convolution
    Wu, Ke
    Dai, Hong
    Wang, Shuang
    Liu, Chengrui
    ENGINEERING LETTERS, 2023, 31 (04) : 1859 - 1866
  • [29] Exploring Point-BEV Fusion for 3D Point Cloud Object Tracking With Transformer
    Luo, Zhipeng
    Zhou, Changqing
    Pan, Liang
    Zhang, Gongjie
    Liu, Tianrui
    Luo, Yueru
    Zhao, Haiyu
    Liu, Ziwei
    Lu, Shijian
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (09) : 5921 - 5935
  • [30] Exploring Point-BEV Fusion for 3D Point Cloud Object Tracking with Transformer
    Luo, Zhipeng
    Zhou, Changqing
    Pan, Liang
    Zhang, Gongjie
    Liu, Tianrui
    Luo, Yueru
    Zhao, Haiyu
    Liu, Ziwei
    Lu, Shijian
    arXiv, 2022,