A point contextual transformer network for point cloud completion

被引:0
|
作者
Leng, Siyi [1 ,2 ,3 ]
Zhang, Zhenxin [1 ,2 ]
Zhang, Liqiang [4 ]
机构
[1] Capital Normal Univ, Key Lab Informat Acquisit & Applicat 3D, MOE, Beijing 100048, Peoples R China
[2] Capital Normal Univ, Coll Resource Environm & Tourism, Beijing 100048, Peoples R China
[3] Xinjiang Normal Univ, Coll Geosci & Tourism, Urumqi 830054, Peoples R China
[4] Beijing Normal Univ, State Key Lab Remote Sensing Sci, Beijing 100875, Peoples R China
基金
北京市自然科学基金;
关键词
Point cloud completion; Feature extraction; Point contextual transformer; Attention mechanism;
D O I
10.1016/j.eswa.2024.123672
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Point cloud completion is an essential task for recovering a complete point cloud from its partial observation to support downstream applications, such as object detection and reconstruction. Existing point cloud completion networks primarily rely on large-scale datasets to learn the mapping between the partial shapes and the complete shapes. They often adopt a multi-stage strategy to progressively generate complete point clouds with finer details. However, underutilization of shape priors and complex modelling frameworks still plague these networks. To address these issues, we innovatively propose a point contextual transformer (PCoT) for point cloud completion (PCoT-Net). We design the PCoT to adaptively fuse static and dynamic point contextual information. This allows for the effective capture of fine-grained local contextual features. We then propose a one-stage network with a feature completion module to directly generate credible and detailed complete point cloud results. Furthermore, we incorporate External Attention (EA) into the feature completion module, which is lightweight and further improves the performance of learning complete features and reconstructing the complete point cloud. Extensive experiments on various datasets validate the effectiveness of our PCoT-based approach and the EA-enhanced feature completion module, which achieves superior quantitative performance in Chamfer Distance (CD) and F1-Score. In comparison to PMP-Net++ (Wen et al., 2022), our method improves the F1-Score by 0.010, 0.022, and 0.026, and reduces the CD by 0.16, 0.95, and 1.74 on the MVP, CRN, and ScanNet datasets, respectively, while providing visually superior results, capturing more fine-grained details and producing smoother reconstructed surfaces.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] FPTNet: Full Point Transformer Network for Point Cloud Completion
    Wang, Chunmao
    Yan, Xuejun
    Wang, Jingjing
    [J]. PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT II, 2024, 14426 : 142 - 154
  • [2] Point Cloud Completion Network Based on Multiencoders and Residual-Transformer
    Gao Hui
    Yang Zhijing
    Ling Wing-Kuen
    Cao Jiangzhong
    Li Weijie
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (02)
  • [3] PCTMA-Net: Point Cloud Transformer with Morphing Atlas-based Point Generation Network for Dense Point Cloud Completion
    Lin, Jianjie
    Rickert, Markus
    Perzylo, Alexander
    Knoll, Alois
    [J]. 2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 5657 - 5663
  • [4] SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-Transformer
    Xiang, Peng
    Wen, Xin
    Liu, Yu-Shen
    Cao, Yan-Pei
    Wan, Pengfei
    Zheng, Wen
    Han, Zhizhong
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 5479 - 5489
  • [5] Snowflake Point Deconvolution for Point Cloud Completion and Generation With Skip-Transformer
    Xiang, Peng
    Wen, Xin
    Liu, Yu-Shen
    Cao, Yan-Pei
    Wan, Pengfei
    Zheng, Wen
    Han, Zhizhong
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (05) : 6320 - 6338
  • [6] Plant point cloud completion network based on multi-scale geometry-aware point Transformer
    Zeng, An
    Peng, Jiewei
    Liu, Chang
    Pan, Dan
    Jiang, Yanrong
    Zhang, Xiaobo
    [J]. Nongye Gongcheng Xuebao/Transactions of the Chinese Society of Agricultural Engineering, 2022, 38 (04): : 198 - 205
  • [7] SPCNet: Stepwise Point Cloud Completion Network
    Hu, Fei
    Chen, Honghua
    Lu, Xuequan
    Zhu, Zhe
    Wang, Jun
    Wang, Weiming
    Wang, Fu Lee
    Wei, Mingqiang
    [J]. COMPUTER GRAPHICS FORUM, 2022, 41 (07) : 153 - 164
  • [8] FBNet: Feedback Network for Point Cloud Completion
    Yan, Xuejun
    Yan, Hongyu
    Wang, Jingjing
    Du, Hang
    Wu, Zhihong
    Xie, Di
    Pu, Shiliang
    Lu, Li
    [J]. COMPUTER VISION - ECCV 2022, PT II, 2022, 13662 : 676 - 693
  • [9] FBNet: Feedback Network for Point Cloud Completion
    Yan, Xuejun
    Yan, Hongyu
    Wang, Jingjing
    Du, Hang
    Wu, Zhihong
    Xie, Di
    Pu, Shiliang
    Lu, Li
    [J]. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2022, 13662 LNCS : 676 - 693
  • [10] FBNet: Feedback Network for Point Cloud Completion
    Yan, Xuejun
    Yan, Hongyu
    Wang, Jingjing
    Du, Hang
    Wu, Zhihong
    Xie, Di
    Pu, Shiliang
    Lu, Li
    [J]. arXiv, 2022,