DGC-TnT: Enhancing Point Cloud Object Classification by Dynamic Graph Convolutions With Transformer in Transformer

被引:0
|
作者
Lin, Chien-Chou [1 ]
Chen, Po-Yu [1 ]
机构
[1] Natl Yunlin Univ Sci & Technol, Dept Comp Sci & Informat Engn, Touliu 64002, Taiwan
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Transformers; Point cloud compression; Feature extraction; Three-dimensional displays; Computer architecture; Task analysis; Accuracy; Object detection; Object classification; dynamic graph convolution (DGC); global feature; local feature; transformer in transformer (TnT); edge-convolution (EdgeConv);
D O I
10.1109/ACCESS.2024.3442928
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, deep learning neural networks have been widely used in object classification. The process of object classification typically involves extracting features from the point cloud using neural networks and integrating these features into a global feature for recognizing the object. However, most existing methods perform well in global feature extraction but still fall short in capturing local details, or lack an attention mechanism to focus on informative feature signals. This paper presents DGC-TnT which combines dynamic graph convolution (DGC) structure with the Point-TnT module. Employing a two-stage TnT architecture, DGC-TnT utilizes a self-attention mechanism to deeply analyze local features derived from dynamic graph convolution, expanding their scope globally. This mechanism effectively operates between individual points and clusters of points, thereby enhancing overall object classification performance. DGC-TnT facilitates enhanced feature communication between points and point clusters within the point cloud through the Transformer module. On the ModelNet40 and ScanobjectNN datasets, DGC-TnT has a significant improvement in accuracy.
引用
收藏
页码:111924 / 111931
页数:8
相关论文
共 50 条
  • [41] Large Scale Point Cloud Lightweight Method for Power Transformer Area Based on Spectral Graph Theory
    Yang, Fan
    Wu, Tao
    Hao, Hanxue
    Diao, Guanxun
    Li, Yong
    Diangong Jishu Xuebao/Transactions of China Electrotechnical Society, 39 (23): : 7528 - 7541
  • [42] Pavement Point Cloud Upsampling Based on Transformer: Toward Enhancing 3D Pavement Data
    Bu, Tianxiang
    Zhu, Junqing
    Ma, Tao
    Jiang, Shun
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024,
  • [43] EGCN: A Node Classification Model Based on Transformer and Spatial Feature Attention GCN for Dynamic Graph
    Cao, Yunqi
    Chen, Haopeng
    Ruan, Jinteng
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT VI, 2023, 14259 : 357 - 368
  • [44] Point Cloud Classification and Segmentation Network Based on Dynamic Graph Convolutional Network
    Wang Jiang'an
    He Jiao
    Pang Dawei
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (12)
  • [45] Efficiently localizing system anomalies for cloud infrastructures: a novel Dynamic Graph Transformer based Parallel Framework
    He, Hongxia
    Li, Xi
    Chen, Peng
    Chen, Juan
    Liu, Ming
    Wu, Lei
    JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS, 2024, 13 (01):
  • [46] URBAN CLASSIFICATION BASED ON TOP-VIEW POINT CLOUD AND SAR IMAGE FUSION WITH SWIN TRANSFORMER
    Xue, R.
    Zhang, X.
    Soergel, U.
    XXIV ISPRS CONGRESS: IMAGING TODAY, FORESEEING TOMORROW, COMMISSION III, 2022, 43-B3 : 559 - 564
  • [47] 3DCTN: 3D Convolution-Transformer Network for Point Cloud Classification
    Lu, Dening
    Xie, Qian
    Gao, Kyle
    Xu, Linlin
    Li, Jonathan
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (12) : 24854 - 24865
  • [48] GPT-COPE: A Graph-Guided Point Transformer for Category-Level Object Pose Estimation
    Zou, Lu
    Huang, Zhangjin
    Gu, Naijie
    Wang, Guoping
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (04) : 2385 - 2398
  • [49] Enhancing the Local Graph Semantic Feature for 3D Point Cloud Classification and Segmentation
    Wang, Yong
    Tang, Xintong
    Yue, Chenke
    IEEE ACCESS, 2022, 10 : 74620 - 74628
  • [50] LINKED ATTENTION-BASED DYNAMIC GRAPH CONVOLUTION MODULE FOR POINT CLOUD CLASSIFICATION
    Lu, Xiaolong
    Liu, Baodi
    Liu, Weifeng
    Zhang, Kai
    Li, Ye
    Lu, Xiaoping
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 3153 - 3157