DGC-TnT: Enhancing Point Cloud Object Classification by Dynamic Graph Convolutions With Transformer in Transformer

被引:0
|
作者
Lin, Chien-Chou [1 ]
Chen, Po-Yu [1 ]
机构
[1] Natl Yunlin Univ Sci & Technol, Dept Comp Sci & Informat Engn, Touliu 64002, Taiwan
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Transformers; Point cloud compression; Feature extraction; Three-dimensional displays; Computer architecture; Task analysis; Accuracy; Object detection; Object classification; dynamic graph convolution (DGC); global feature; local feature; transformer in transformer (TnT); edge-convolution (EdgeConv);
D O I
10.1109/ACCESS.2024.3442928
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, deep learning neural networks have been widely used in object classification. The process of object classification typically involves extracting features from the point cloud using neural networks and integrating these features into a global feature for recognizing the object. However, most existing methods perform well in global feature extraction but still fall short in capturing local details, or lack an attention mechanism to focus on informative feature signals. This paper presents DGC-TnT which combines dynamic graph convolution (DGC) structure with the Point-TnT module. Employing a two-stage TnT architecture, DGC-TnT utilizes a self-attention mechanism to deeply analyze local features derived from dynamic graph convolution, expanding their scope globally. This mechanism effectively operates between individual points and clusters of points, thereby enhancing overall object classification performance. DGC-TnT facilitates enhanced feature communication between points and point clusters within the point cloud through the Transformer module. On the ModelNet40 and ScanobjectNN datasets, DGC-TnT has a significant improvement in accuracy.
引用
下载
收藏
页码:111924 / 111931
页数:8
相关论文
共 50 条
  • [1] Point cloud classification based on transformer
    Wu, Xianfeng
    Liu, Xinyi
    Wang, Junfei
    Lai, Zhongyuan
    Zhou, Jing
    Liu, Xia
    COMPUTERS & ELECTRICAL ENGINEERING, 2022, 104
  • [2] Object Detection of Occlusion Point Cloud based on Transformer
    Zhou, Jing
    Zhou, Jian
    Lin, Teng Xing
    Gong, Zi Xin
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [3] SparseFormer: Sparse transformer network for point cloud classification
    Wang, Yong
    Liu, Yangyang
    Zhou, Pengbo
    Geng, Guohua
    Zhang, Qi
    COMPUTERS & GRAPHICS-UK, 2023, 116 : 24 - 32
  • [4] Dynamic clustering transformer network for point cloud segmentation
    Lu, Dening
    Zhou, Jun
    Gao, Kyle
    Du, Jing
    Xu, Linlin
    Li, Jonathan
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2024, 128
  • [5] Dynamic graph transformer for 3D object detection
    Ren, Siyuan
    Pan, Xiao
    Zhao, Wenjie
    Nie, Binling
    Han, Bo
    KNOWLEDGE-BASED SYSTEMS, 2023, 259
  • [6] MO-Transformer: A Transformer-Based Multi-Object Point Cloud Reconstruction Network
    Lyu, Erli
    Zhang, Zhengyan
    Liu, Wei
    Wang, Jiaole
    Song, Shuang
    Meng, Max Q. -H.
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 1024 - 1030
  • [7] F-Transformer: Point Cloud Fusion Transformer for Cooperative 3D Object Detection
    Wang, Jie
    Luo, Guiyang
    Yuan, Quan
    Li, Jinglin
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT I, 2022, 13529 : 171 - 182
  • [8] MULTISCALE REPRESENTATIONS LEARNING TRANSFORMER FRAMEWORK FOR POINT CLOUD CLASSIFICATION
    Sun, Yajie
    Zia, Ali
    Zhou, Jun
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3354 - 3358
  • [9] LAPTRAN: TRANSFORMER EMBEDDING GRAPH LAPLACIAN FOR POINT CLOUD PART SEGMENTATION
    Li, Abiao
    Lv, Chenlei
    Fang, Yuming
    Zuo, Yifan
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3070 - 3074
  • [10] Point cloud semantic segmentation with adaptive spatial structure graph transformer
    Han, Ting
    Chen, Yiping
    Ma, Jin
    Liu, Xiaoxue
    Zhang, Wuming
    Zhang, Xinchang
    Wang, Huajuan
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2024, 133