Diffusion Transformer for point cloud registration: digital modeling of cultural heritage

被引:0
|
作者
An, Li [1 ]
Zhou, Pengbo [2 ]
Zhou, Mingquan [1 ]
Wang, Yong [1 ]
Geng, Guohua [1 ]
机构
[1] Northwest Univ, Sch Informat Sci & Technol, Xian 710127, Peoples R China
[2] Beijing Normal Univ, Sch Arts & Commun, Beijing 100875, Peoples R China
来源
HERITAGE SCIENCE | 2024年 / 12卷 / 01期
关键词
Point cloud registration; Diffusion transformer; Cultural heritage; Digital modeling; BINARY SHAPE CONTEXT;
D O I
10.1186/s40494-024-01314-1
中图分类号
C [社会科学总论];
学科分类号
03 ; 0303 ;
摘要
Digital modeling is an essential means for preserving and passing down historical culture within cultural heritage. Point cloud registration technology, by aligning point cloud data captured from multiple perspectives, enhances the accuracy of reconstructing the complex structures of artifacts and buildings and provides a reliable digital foundation for their protection, exhibition, and research. Due to the challenges posed by complex morphology, noise, and missing data when processing cultural heritage data, this paper proposes a point cloud registration method based on the Diffusion Transformer (PointDT). Compared to traditional methods, the Diffusion Transformer can better capture both the global features and local structures of point cloud data, more accurately capturing the geometric and semantic information of the target point cloud, thereby achieving precise digital reconstruction. In this study, we trained our method using indoor datasets such as 3DMatch and large-scale outdoor datasets like KITTI, and validated it on various cultural heritage datasets, including those of the Terracotta Warriors and heritage buildings. The results demonstrate that this method not only significantly improves accuracy but also shows advantages in computational efficiency.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Enhancing point cloud registration with transformer: cultural heritage protection of the Terracotta Warriors
    Wang, Yong
    Zhou, Pengbo
    Geng, Guohua
    An, Li
    Zhou, Mingquan
    [J]. HERITAGE SCIENCE, 2024, 12 (01):
  • [2] PointDifformer: Robust Point Cloud Registration With Neural Diffusion and Transformer
    She, Rui
    Kang, Qiyu
    Wang, Sijie
    Tay, Wee Peng
    Zhao, Kai
    Song, Yang
    Geng, Tianyu
    Xu, Yi
    Navarro, Diego Navarro
    Hartmannsgruber, Andreas
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 15
  • [3] MATR: Multicompound Adaptive Transformer for Point Cloud Registration
    Wang, Yong
    Zhou, Pengbo
    Geng, Guohua
    An, Li
    Zhou, Mingquan
    Li, Kang
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, : 12903 - 12912
  • [4] Low-Overlap Point Cloud Registration With Transformer
    Wang, Yong
    Zhou, Pengbo
    Geng, Guohua
    An, Li
    Zhang, Qi
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 1469 - 1473
  • [5] GETr: A Geometric Equivariant Transformer for Point Cloud Registration
    Yu, Chang
    Zhang, Sanguo
    Shen, Li-Yong
    [J]. Computer Graphics Forum, 2024, 43 (07)
  • [6] Geometric Transformer for Fast and Robust Point Cloud Registration
    Qin, Zheng
    Yu, Hao
    Wang, Changjian
    Guo, Yulan
    Peng, Yuxing
    Xu, Kai
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 11133 - 11142
  • [7] End-to-end point cloud registration with transformer
    Wang, Yong
    Zhou, Pengbo
    Geng, Guohua
    An, Li
    Zhang, Qi
    [J]. Artificial Intelligence Review, 2025, 58 (01)
  • [8] Latent diffusion transformer for point cloud generation
    Ji, Junzhong
    Zhao, Runfeng
    Lei, Minglong
    [J]. VISUAL COMPUTER, 2024, 40 (06): : 3903 - 3917
  • [9] Procedural Modeling for Digital Cultural Heritage
    Simon Haegler
    Pascal Müller
    Luc Van Gool
    [J]. EURASIP Journal on Image and Video Processing, 2009
  • [10] Procedural Modeling for Digital Cultural Heritage
    Haegler, Simon
    Mueller, Pascal
    Van Gool, Luc
    [J]. EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2009,