DualMLP: a two-stream fusion model for 3D point cloud classification

被引:3
|
作者
Paul, Sneha [1 ]
Patterson, Zachary [1 ]
Bouguila, Nizar [1 ]
机构
[1] Concordia Univ, Concordia Inst Informat Syst Engn CIISE, Montreal, PQ, Canada
来源
VISUAL COMPUTER | 2024年 / 40卷 / 08期
基金
英国科研创新办公室;
关键词
Point cloud classification; 3D computer vision; Supervised learning; NEURAL-NETWORKS;
D O I
10.1007/s00371-023-03114-3
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this paper, we present DualMLP, a novel 3D model that introduces the idea of a two-stream network for existing 3D models to handle the trade-off between the number of points and the computational overhead. Existing works on point clouds use a small subset of points sampled from the entire 3D object as input. Although increasing the number of input points can enhance scene understanding, it also incurs a higher computational cost for existing networks. To tackle this challenge, we propose a novel architecture called DualMLP, which effectively mitigates the linear increase in computational expense as the number of input points grows. While we evaluate this concept on PointMLP and demonstrate its effectiveness, the idea can be applied to other existing models with minimal adjustments. DualMLP consists of two branches: DenseNet and SparseNet. The SparseNet, a relatively larger network, samples a small number of points from the complete point cloud, while the DenseNet, a lightweight network, takes in a larger number of points as input. Extensive experiments on the ScanObjectNN and ModelNet40 datasets demonstrate the effectiveness of the proposed model, achieving a 1.00% and 0.81% improvement over PointMLP for ScanObjectNN and ModelNet40 while being computationally efficient than the original PointMLP. To ensure the reproducibility of our experimental results, the code for this work is publicly available at https://github.com/snehaputul/DualMLP.
引用
收藏
页码:5435 / 5449
页数:15
相关论文
共 50 条
  • [1] Fusion Technology of 3D Point Cloud Map for Objects Classification
    Fan, Yu-Cheng
    Li, Pei-Cian
    Liu, Yi-Cheng
    2019 4TH IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - ASIA (IEEE ICCE-ASIA 2019), 2019, : 45 - 46
  • [2] Multi-scale 3D Convolution Fusion Two-Stream Networks for Action Recognition
    Song L.
    Weng L.
    Wang L.
    Xia M.
    Weng, Liguo (liguoweng@hotmail.com), 2018, Institute of Computing Technology (30): : 2074 - 2083
  • [3] Two-Stream Network Based on Visual Saliency Sharing for 3D Model Recognition
    Nie, Weizhi
    Qu, Lu
    Ren, Minjie
    Liang, Qi
    Su, Yuting
    Li, Yangyang
    Jin, Hao
    IEEE ACCESS, 2020, 8 : 5979 - 5989
  • [4] Deep 3D point cloud classification network based on competitive attention fusion
    Chen H.-J.
    Da F.-P.
    Gai S.-Y.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2021, 55 (12): : 2342 - 2351
  • [5] Two-Stream 3D Convolution Attentional Network for Action Recognition
    Kusumoseniarto, Raden Hadapiningsyah
    2020 JOINT 9TH INTERNATIONAL CONFERENCE ON INFORMATICS, ELECTRONICS & VISION (ICIEV) AND 2020 4TH INTERNATIONAL CONFERENCE ON IMAGING, VISION & PATTERN RECOGNITION (ICIVPR), 2020,
  • [6] Two-Stream RNN/CNN for Action Recognition in 3D Videos
    Zhao, Rui
    Ali, Haider
    van der Smagt, Patrick
    2017 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2017, : 4260 - 4267
  • [7] 3D Convolutional Two-Stream Network for Action Recognition in Videos
    Li, Min
    Qi, Yuezhu
    Yang, Jian
    Zhang, Yanfang
    Ren, Junxing
    Du, Hong
    2019 IEEE 31ST INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2019), 2019, : 1697 - 1701
  • [8] A two-stream network with complementary feature fusion for pest image classification
    Wang, Chao
    Zhang, Jinrui
    He, Jin
    Luo, Wei
    Yuan, Xiaohui
    Gu, Lichuan
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 124
  • [9] Attention EdgeConv For 3D Point Cloud Classification
    Lin, Yen-Po
    Yeh, Yang-Ming
    Chou, Yu-Chen
    Lu, Yi-Chang
    2021 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2021, : 2018 - 2022
  • [10] Improved Training for 3D Point Cloud Classification
    Paul, Sneha
    Patterson, Zachary
    Bouguila, Nizar
    STRUCTURAL, SYNTACTIC, AND STATISTICAL PATTERN RECOGNITION, S+SSPR 2022, 2022, 13813 : 253 - 263