DualMLP: a two-stream fusion model for 3D point cloud classification

被引:3
|
作者
Paul, Sneha [1 ]
Patterson, Zachary [1 ]
Bouguila, Nizar [1 ]
机构
[1] Concordia Univ, Concordia Inst Informat Syst Engn CIISE, Montreal, PQ, Canada
来源
VISUAL COMPUTER | 2024年 / 40卷 / 08期
基金
英国科研创新办公室;
关键词
Point cloud classification; 3D computer vision; Supervised learning; NEURAL-NETWORKS;
D O I
10.1007/s00371-023-03114-3
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this paper, we present DualMLP, a novel 3D model that introduces the idea of a two-stream network for existing 3D models to handle the trade-off between the number of points and the computational overhead. Existing works on point clouds use a small subset of points sampled from the entire 3D object as input. Although increasing the number of input points can enhance scene understanding, it also incurs a higher computational cost for existing networks. To tackle this challenge, we propose a novel architecture called DualMLP, which effectively mitigates the linear increase in computational expense as the number of input points grows. While we evaluate this concept on PointMLP and demonstrate its effectiveness, the idea can be applied to other existing models with minimal adjustments. DualMLP consists of two branches: DenseNet and SparseNet. The SparseNet, a relatively larger network, samples a small number of points from the complete point cloud, while the DenseNet, a lightweight network, takes in a larger number of points as input. Extensive experiments on the ScanObjectNN and ModelNet40 datasets demonstrate the effectiveness of the proposed model, achieving a 1.00% and 0.81% improvement over PointMLP for ScanObjectNN and ModelNet40 while being computationally efficient than the original PointMLP. To ensure the reproducibility of our experimental results, the code for this work is publicly available at https://github.com/snehaputul/DualMLP.
引用
收藏
页码:5435 / 5449
页数:15
相关论文
共 50 条
  • [21] Point-selection and multi-level-point-feature fusion-based 3D point cloud classification
    Zhang, Qieshi
    Cheng, Jun
    Wang, Shengwen
    Xu, Chengjun
    Gao, Xiangyang
    ELECTRONICS LETTERS, 2020, 56 (06) : 291 - +
  • [22] A GRAPH-CNN FOR 3D POINT CLOUD CLASSIFICATION
    Zhang, Yingxue
    Rabbat, Michael
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 6279 - 6283
  • [23] PointGuard: Provably Robust 3D Point Cloud Classification
    Liu, Hongbin
    Jia, Jinyuan
    Gong, Neil Zhenqiang
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 6182 - 6191
  • [24] Time and Memory Efficient 3D Point Cloud Classification
    Ullah, Shan
    Qayyum, Usman
    Choudhry, Aadil Jaleel
    PROCEEDINGS OF 2019 16TH INTERNATIONAL BHURBAN CONFERENCE ON APPLIED SCIENCES AND TECHNOLOGY (IBCAST), 2019, : 521 - 525
  • [25] Pointwise CNN for 3D Object Classification on Point Cloud
    Song, Wei
    Liu, Zishu
    Tian, Yifei
    Fong, Simon
    JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2021, 17 (04): : 787 - 800
  • [26] Multiview 3D Reconstruction and Human Point Cloud Classification
    Nasab, Sarah Ershadi
    Kasaei, Shohreh
    Sanaei, Esmaeil
    Ossia, Ali
    Mobini, Majid
    2014 22ND IRANIAN CONFERENCE ON ELECTRICAL ENGINEERING (ICEE), 2014, : 1119 - 1124
  • [27] Point-voxel dual stream transformer for 3d point cloud learning
    Zhao, Tianmeng
    Zeng, Hui
    Zhang, Baoqing
    Fan, Bin
    Li, Chen
    VISUAL COMPUTER, 2024, 40 (08): : 5323 - 5339
  • [28] PEMCNet: An Efficient Multi-Scale Point Feature Fusion Network for 3D LiDAR Point Cloud Classification
    Zhao, Genping
    Zhang, Weiguang
    Peng, Yeping
    Wu, Heng
    Wang, Zhuowei
    Cheng, Lianglun
    REMOTE SENSING, 2021, 13 (21)
  • [29] 3D Point Cloud Classification for Autonomous Driving via Dense-Residual Fusion Network
    Chiang, Chung-Hsin
    Kuo, Chih-Hung
    Lin, Chien-Chou
    Chiang, Hsin-Te
    IEEE ACCESS, 2020, 8 : 163775 - 163783
  • [30] Two-Stream Neural Network Fusion Model for Highway Fog Detection
    Xiang Y.
    Cong D.
    Zhang Y.
    Yuan F.
    Xinan Jiaotong Daxue Xuebao/Journal of Southwest Jiaotong University, 2019, 54 (01): : 173 - 179