DualMLP: a two-stream fusion model for 3D point cloud classification

被引:3
|
作者
Paul, Sneha [1 ]
Patterson, Zachary [1 ]
Bouguila, Nizar [1 ]
机构
[1] Concordia Univ, Concordia Inst Informat Syst Engn CIISE, Montreal, PQ, Canada
来源
VISUAL COMPUTER | 2024年 / 40卷 / 08期
基金
英国科研创新办公室;
关键词
Point cloud classification; 3D computer vision; Supervised learning; NEURAL-NETWORKS;
D O I
10.1007/s00371-023-03114-3
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this paper, we present DualMLP, a novel 3D model that introduces the idea of a two-stream network for existing 3D models to handle the trade-off between the number of points and the computational overhead. Existing works on point clouds use a small subset of points sampled from the entire 3D object as input. Although increasing the number of input points can enhance scene understanding, it also incurs a higher computational cost for existing networks. To tackle this challenge, we propose a novel architecture called DualMLP, which effectively mitigates the linear increase in computational expense as the number of input points grows. While we evaluate this concept on PointMLP and demonstrate its effectiveness, the idea can be applied to other existing models with minimal adjustments. DualMLP consists of two branches: DenseNet and SparseNet. The SparseNet, a relatively larger network, samples a small number of points from the complete point cloud, while the DenseNet, a lightweight network, takes in a larger number of points as input. Extensive experiments on the ScanObjectNN and ModelNet40 datasets demonstrate the effectiveness of the proposed model, achieving a 1.00% and 0.81% improvement over PointMLP for ScanObjectNN and ModelNet40 while being computationally efficient than the original PointMLP. To ensure the reproducibility of our experimental results, the code for this work is publicly available at https://github.com/snehaputul/DualMLP.
引用
收藏
页码:5435 / 5449
页数:15
相关论文
共 50 条
  • [41] Learning Space-Time-Frequency Representation with Two-Stream Attention Based 3D Network for Motor Imagery Classification
    Li, Zhenqi
    Wang, Jing
    Jia, Ziyu
    Lin, Youfang
    20TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2020), 2020, : 1124 - 1129
  • [42] Point Cloud Classification and Segmentation Model Based on Graph Convolution and 3D Direction Convolution
    Lan, Hong
    Chen, Hao
    Zhang, Pufen
    Computer Engineering and Applications, 2023, 59 (08) : 182 - 191
  • [43] 3D Orientation and Object Classification from Partial Model Point Cloud based on PointNet
    Tuan Anh Nguyen
    Lee, Sukhan
    2018 IEEE THIRD INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, APPLICATIONS AND SYSTEMS (IPAS), 2018, : 192 - 197
  • [44] 3D Object Detection with Fusion Point Attention Mechanism in LiDAR Point Cloud
    Liu Weili
    Zhu Deli
    Luo Huahao
    Li Yi
    ACTA PHOTONICA SINICA, 2023, 52 (09)
  • [45] A Two-Stream Deep Fusion Framework for High-Resolution Aerial Scene Classification
    Yu, Yunlong
    Liu, Fuxian
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2018, 2018
  • [46] Generating 3D Model of Furniture from 3D Point Cloud of Room
    Osakama, Shunta
    Manabe, Yoshitsugu
    Yata, Noriko
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY (IWAIT) 2020, 2020, 11515
  • [47] Automated Classification of General Movements in Infants Using Two-Stream Spatiotemporal Fusion Network
    Hashimoto, Yuki
    Furui, Akira
    Shimatani, Koji
    Casadio, Maura
    Moretti, Paolo
    Morasso, Pietro
    Tsuji, Toshio
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT II, 2022, 13432 : 753 - 762
  • [48] Dissimilarity to Class Medoids as Features for 3D Point Cloud Classification
    Chabanet, Sylvain
    Chazelle, Valentin
    Thomas, Philippe
    El-Haouzi, Hind Bril
    ADVANCES IN PRODUCTION MANAGEMENT SYSTEMS: ARTIFICIAL INTELLIGENCE FOR SUSTAINABLE AND RESILIENT PRODUCTION SYSTEMS (APMS 2021), PT III, 2021, 632 : 573 - 581
  • [49] Imperceptible Transfer Attack and Defense on 3D Point Cloud Classification
    Liu, Daizong
    Hu, Wei
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (04) : 4727 - 4746
  • [50] Parameter optimization criteria guided 3D point cloud classification
    Li, Hongjun
    Meng, Weiliang
    Liu, Xinying
    Xiang, Shiming
    Zhang, Xiaopeng
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (04) : 5081 - 5104