COCCA: POINT CLOUD COMPLETION THROUGH CAD CROSS-ATTENTION

被引:0
|
作者
Misik, Adam [1 ,2 ]
Salihu, Driton [2 ]
Brock, Heike [1 ]
Steinbach, Eckehard [2 ]
机构
[1] Siemens Technol, Munich, Germany
[2] Tech Univ Munich, Sch Comp Informat & Technol, Chair Media Technol, Munich Inst Robot & Machine Intelligence MIRMI, Munich, Germany
关键词
Group-invariance; Cross-Attention; Point Cloud Completion; Scan-to-CAD; Deep Learning; REGISTRATION;
D O I
10.1109/ICIP49359.2023.10222436
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D scene- and object-level scans typically result in sparse and incomplete point clouds. Since dense point clouds of high quality are essential for the 3D reconstruction process, a promising approach is to improve the scan quality by point cloud completion. In this paper, we present COCCA, an extension of point cloud completion networks for scan-to-CAD use cases. The proposed extension is based on cross-attention of features extracted from a scan with rotation-, translation-, and scale-invariant features extracted from a sampled CAD point cloud. With the proposed cross-attention operation, we improve the learning of scan features and the subsequent decoding to a complete shape. We demonstrate the effectiveness of COCCA on the ShapeNet dataset in quantitative and qualitative experiments. COCCA improves the overall completion performance of point cloud completion networks by up to 11.8% for Chamfer Distance and up to 2.2% for F-Score. Our qualitative experiments visualize how COCCA completes point clouds with higher geometric detail. In addition, we demonstrate how completion by COCCA improves the point cloud registration task required for scan-to-CAD alignment.
引用
收藏
页码:580 / 584
页数:5
相关论文
共 50 条
  • [21] Point Cloud Completion via Multi-Scale Edge Convolution and Attention
    Cao, Rui
    Zhang, Kaiyi
    Chen, Yang
    Yang, Ximing
    Jin, Cheng
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 6183 - 6192
  • [22] Ganet: graph attention based Terracotta Warriors point cloud completion network
    Gao, Jian
    Zhang, Yuhe
    Shiqin, Gaoxue
    Zhou, Pengbo
    Wen, Yue
    Geng, Guohua
    HERITAGE SCIENCE, 2024, 12 (01):
  • [23] Attention-Based Multi-Stage Network for Point Cloud Completion
    Yin Xiyang
    Zhou Pei
    Zhu Jiangping
    LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (10)
  • [24] WaveNet With Cross-Attention for Audiovisual Speech Recognition
    Wang, Hui
    Gao, Fei
    Zhao, Yue
    Wu, Licheng
    IEEE ACCESS, 2020, 8 : 169160 - 169168
  • [25] Deception Detection System with Joint Cross-Attention
    Jiang, Peili
    Wang, Yunfan
    Li, Jiajun
    Wang, Ziyang
    PROCEEDINGS OF THE 2024 6TH INTERNATIONAL SYMPOSIUM ON SIGNAL PROCESSING SYSTEMS, SSPS 2024, 2024, : 40 - 47
  • [26] SCATT: Transformer tracking with symmetric cross-attention
    Zhang, Jianming
    Chen, Wentao
    Dai, Jiangxin
    Zhang, Jin
    APPLIED INTELLIGENCE, 2024, 54 (08) : 6069 - 6084
  • [27] A Survey of Point Cloud Completion
    Zhuang, Zhiyun
    Zhi, Zhiyang
    Han, Ting
    Chen, Yiping
    Chen, Jun
    Wang, Cheng
    Cheng, Ming
    Zhang, Xinchang
    Qin, Nannan
    Ma, Lingfei
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 5691 - 5711
  • [28] Point Cloud Completion: A Survey
    Tesema, Keneni W.
    Hill, Lyndon
    Jones, Mark W.
    Ahmad, Muneeb I.
    Tam, Gary K. L.
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (10) : 6880 - 6899
  • [29] Deblurring transformer tracking with conditional cross-attention
    Sun, Fuming
    Zhao, Tingting
    Zhu, Bing
    Jia, Xu
    Wang, Fasheng
    MULTIMEDIA SYSTEMS, 2023, 29 (03) : 1131 - 1144
  • [30] Deblurring transformer tracking with conditional cross-attention
    Fuming Sun
    Tingting Zhao
    Bing Zhu
    Xu Jia
    Fasheng Wang
    Multimedia Systems, 2023, 29 : 1131 - 1144