Recognition and Segmentation of 3D Point Clouds Sensitive to Fusion Features

被引:0
|
作者
Zhu A. [1 ,2 ]
Da F. [1 ,2 ]
Gai S. [1 ,2 ]
机构
[1] School of Automation, Southeast University, Nanjing
[2] Key Laboratory of Measurement and Control of Complex Systems of Engineering, Ministry of Education, Southeast University, Nanjing
关键词
3D point cloud; attentive mechanism; classification; curve feature; fusion feature screening; segmentation;
D O I
10.7652/xjtuxb202405006
中图分类号
学科分类号
摘要
The 3D point cloud classification and segmentation networks ignore the redundant information in the fusion features, lack the ability to amplify the proportion of effective features, and cannot fully explore the expressiveness of features. Based on the CurveNet network, this paper proposes a method that can filter and enrich the fusion features, and the recognition and segmentation effect of point cloud reaches a relatively advanced level. Firstly, a feature selection subnetwork with filtering ability for fusion features is proposed, which combines TopK operator and a scoring mechanism to select fusion features containing valid information and adaptively assign weight to the selected features. Secondly, two new branches arc added to the aggregation curve feature module, so as to learn the curve internal point distance features and the curve line distance features, respectively, and extract the internal correlation of each branch through the quick channel affinity attention mechanism, which enhances the information description ability of the network features. The experimental results show that the accuracy of the classification task on the ModclNct40 datasct reaches 93. 8%, and the average intersection over union of the segmentation task on the ShapeNet Part datasct reaches 86. 4%. Compared with the benchmark network, the classification effect and segmentation effect are improved, which proves the effectiveness of the proposed algorithm. © 2024 Xi'an Jiaotong University. All rights reserved.
引用
收藏
页码:52 / 63
页数:11
相关论文
共 30 条
  • [1] CHARLES R Q, SU Hao, KAICHUN M, Et al., PointNet: deep learning on point sets for 3D classification and segmentation [C], 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 77-85, (2017)
  • [2] QI C R, YI Li, SU Hao, Et al., PomtNet+ +: deep hierarchical feature learning on point sets in a metric space, Proceedings of the 31st International Conference on Neural Information Processing Systems, pp. 5105-5114, (2017)
  • [3] JIANG Mmgyang, WU Yiran, ZHAO Tianqi, Et al., PointSIFT: a SIFT-like network module for 3D point cloud semantic segmentation
  • [4] JOSEPH-RIVLIN M, ZVIRIN A, KIMMEL R., Moment e)t: flavor the moments in learning to classify shapes, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW), pp. 4085-4094, (2019)
  • [5] ZHAO Hengshuang, JIANG Li, FU C W, Et al., PointWeb: enhancing local neighborhood features for point cloud processing, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5560-5568, (2019)
  • [6] WANG Xibo, CAO Shipeng, ZHAO Huaici, Et al., Semantic segmentation of point cloud via bilateral feature aggregation and attention mechanism [J], Chinese Journal of Scientific Instrument, 42, 12, pp. 175-183, (2021)
  • [7] KOMARICHEV A, ZHONG Zichun, HUA Jing, A-CNN: annularly convolutional neural networks on point clouds, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 7413-7422, (2019)
  • [8] LI Yangyan, BU Rui, SUN Mingchao, Et al., PointC-NN: convolution on X-transformed points, Advances in Neural Information Processing Systems, pp. 820-830, (2018)
  • [9] LIU Yongcheng, FAN Bin, XIANG Shiming, Et al., Relation-shape convolutional neural network for point cloud analysis, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 8887-8896, (2019)
  • [10] WU Wenxuan, QI Zhongang, FUXIN Li, PointConv: deep convolutional networks on 3D point clouds, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 9613-9622, (2019)