A point contextual transformer network for point cloud completion

被引:0
|
作者
Leng, Siyi [1 ,2 ,3 ]
Zhang, Zhenxin [1 ,2 ]
Zhang, Liqiang [4 ]
机构
[1] Capital Normal Univ, Key Lab Informat Acquisit & Applicat 3D, MOE, Beijing 100048, Peoples R China
[2] Capital Normal Univ, Coll Resource Environm & Tourism, Beijing 100048, Peoples R China
[3] Xinjiang Normal Univ, Coll Geosci & Tourism, Urumqi 830054, Peoples R China
[4] Beijing Normal Univ, State Key Lab Remote Sensing Sci, Beijing 100875, Peoples R China
基金
北京市自然科学基金;
关键词
Point cloud completion; Feature extraction; Point contextual transformer; Attention mechanism;
D O I
10.1016/j.eswa.2024.123672
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Point cloud completion is an essential task for recovering a complete point cloud from its partial observation to support downstream applications, such as object detection and reconstruction. Existing point cloud completion networks primarily rely on large-scale datasets to learn the mapping between the partial shapes and the complete shapes. They often adopt a multi-stage strategy to progressively generate complete point clouds with finer details. However, underutilization of shape priors and complex modelling frameworks still plague these networks. To address these issues, we innovatively propose a point contextual transformer (PCoT) for point cloud completion (PCoT-Net). We design the PCoT to adaptively fuse static and dynamic point contextual information. This allows for the effective capture of fine-grained local contextual features. We then propose a one-stage network with a feature completion module to directly generate credible and detailed complete point cloud results. Furthermore, we incorporate External Attention (EA) into the feature completion module, which is lightweight and further improves the performance of learning complete features and reconstructing the complete point cloud. Extensive experiments on various datasets validate the effectiveness of our PCoT-based approach and the EA-enhanced feature completion module, which achieves superior quantitative performance in Chamfer Distance (CD) and F1-Score. In comparison to PMP-Net++ (Wen et al., 2022), our method improves the F1-Score by 0.010, 0.022, and 0.026, and reduces the CD by 0.16, 0.95, and 1.74 on the MVP, CRN, and ScanNet datasets, respectively, while providing visually superior results, capturing more fine-grained details and producing smoother reconstructed surfaces.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] A Survey of Point Cloud Completion
    Zhuang, Zhiyun
    Zhi, Zhiyang
    Han, Ting
    Chen, Yiping
    Chen, Jun
    Wang, Cheng
    Cheng, Ming
    Zhang, Xinchang
    Qin, Nannan
    Ma, Lingfei
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 5691 - 5711
  • [32] Slice Sequential Network: A Lightweight Unsupervised Point Cloud Completion Network
    Chen, Bofeng
    Fan, Jiaqi
    Zhao, Ping
    Wei, Zhihua
    [J]. PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2021, PT II, 2021, 13020 : 103 - 114
  • [33] Point Cloud Completion: A Survey
    Tesema, Keneni W.
    Hill, Lyndon
    Jones, Mark W.
    Ahmad, Muneeb I.
    Tam, Gary K. L.
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (10) : 6880 - 6899
  • [34] Sequence Generation Completion Method and Resolution Scaling Network for Point Cloud Completion
    Xu, Jiabo
    Zhang, Yirui
    Zou, Yanni
    Liu, Peter X.
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [35] A Partial Point Cloud Completion Network Focusing on Detail Reconstruction
    Wei, Ming
    Sun, Jiaqi
    Zhang, Yaoyuan
    Zhu, Ming
    Nie, Haitao
    Liu, Huiying
    Wang, Jiarong
    [J]. REMOTE SENSING, 2023, 15 (23)
  • [36] Adaptive Recurrent Forward Network for Dense Point Cloud Completion
    Huang, Tianxin
    Zou, Hao
    Cui, Jinhao
    Zhang, Jiangning
    Yang, Xuemeng
    Li, Lin
    Liu, Yong
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 5903 - 5915
  • [37] RFNet: Recurrent Forward Network for Dense Point Cloud Completion
    Huang, Tianxin
    Zou, Hao
    Cui, Jinhao
    Yang, Xuemeng
    Wang, Mengmeng
    Zhao, Xiangrui
    Zhang, Jiangning
    Yuan, Yi
    Xu, Yifan
    Liu, Yong
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 12488 - 12497
  • [38] Multi-feature fusion point cloud completion network
    Chen, Xiu
    Li, Yujie
    Li, Yun
    [J]. WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2022, 25 (04): : 1551 - 1564
  • [39] Cross-Regional Attention Network for Point Cloud Completion
    Wu, Hang
    Miao, Yubin
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 10274 - 10280
  • [40] Orthogonal Dictionary Guided Shape Completion Network for Point Cloud
    Cai, Pingping
    Scott, Deja
    Li, Xiaoguang
    Wang, Song
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 2, 2024, : 864 - 872