PointUR-RL: Unified Self-Supervised Learning Method Based on Variable Masked Autoencoder for Point Cloud Reconstruction and Representation Learning

被引:0
|
作者
Li, Kang [1 ]
Zhu, Qiuquan [1 ]
Wang, Haoyu [1 ]
Wang, Shibo [1 ]
Tian, He [1 ]
Zhou, Ping [2 ]
Cao, Xin [1 ]
机构
[1] Northwest Univ, Sch Informat Sci & Technol, Xian 710127, Peoples R China
[2] Key Sci Res Base Ancient Polychrome Pottery Conser, Emperor Qin Shihuangs Mausoleum Site Museum, Xian 710600, Peoples R China
基金
中国国家自然科学基金;
关键词
self-supervised learning; point cloud reconstruction; representation learning; variable masked autoencoder; contrastive learning; NETWORKS;
D O I
10.3390/rs16163045
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Self-supervised learning has made significant progress in point cloud processing. Currently, the primary tasks of self-supervised learning, which include point cloud reconstruction and representation learning, are trained separately due to their structural differences. This separation inevitably leads to increased training costs and neglects the potential for mutual assistance between tasks. In this paper, a self-supervised method named PointUR-RL is introduced, which integrates point cloud reconstruction and representation learning. The method features two key components: a variable masked autoencoder (VMAE) and contrastive learning (CL). The VMAE is capable of processing input point cloud blocks with varying masking ratios, ensuring seamless adaptation to both tasks. Furthermore, CL is utilized to enhance the representation learning capabilities and improve the separability of the learned representations. Experimental results confirm the effectiveness of the method in training and its strong generalization ability for downstream tasks. Notably, high-accuracy classification and high-quality reconstruction have been achieved with the public datasets ModelNet and ShapeNet, with competitive results also obtained with the ScanObjectNN real-world dataset.
引用
收藏
页数:18
相关论文
共 50 条
  • [41] Self-Contrastive Learning with Hard Negative Sampling for Self-supervised Point Cloud Learning
    Du, Bi'an
    Gao, Xiang
    Hu, Wei
    Li, Xin
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3133 - 3142
  • [42] A Cross Branch Fusion-Based Contrastive Learning Framework for Point Cloud Self-supervised Learning
    Wu, Chengzhi
    Huang, Qianliang
    Jin, Kun
    Pfrommer, Julius
    Beyerer, Juergen
    2024 INTERNATIONAL CONFERENCE IN 3D VISION, 3DV 2024, 2024, : 528 - 538
  • [43] Point2Vec for Self-supervised Representation Learning on Point Clouds
    Abou Zeid, Karim
    Schult, Jonas
    Hermans, Alexander
    Leibe, Bastian
    PATTERN RECOGNITION, DAGM GCPR 2023, 2024, 14264 : 131 - 146
  • [44] Applying masked autoencoder-based self-supervised learning for high-capability vision transformers of electrocardiographies
    Sawano, Shinnosuke
    Kodera, Satoshi
    Setoguchi, Naoto
    Tanabe, Kengo
    Kushida, Shunichi
    Kanda, Junji
    Saji, Mike
    Nanasato, Mamoru
    Maki, Hisataka
    Fujita, Hideo
    Kato, Nahoko
    Watanabe, Hiroyuki
    Suzuki, Minami
    Takahashi, Masao
    Sawada, Naoko
    Yamasaki, Masao
    Sato, Masataka
    Katsushika, Susumu
    Shinohara, Hiroki
    Takeda, Norifumi
    Fujiu, Katsuhito
    Daimon, Masao
    Akazawa, Hiroshi
    Morita, Hiroyuki
    Komuro, Issei
    PLOS ONE, 2024, 19 (08):
  • [45] Self-supervised speech representation learning based on positive sample comparison and masking reconstruction
    Zhang, Wenlin
    Liu, Xuepeng
    Niu, Tong
    Chen, Qi
    Qu, Dan
    Tongxin Xuebao/Journal on Communications, 2022, 43 (07): : 163 - 171
  • [46] Self-Supervised Graph Representation Learning Method Based on Data and Feature Augmentation
    Xu, Yunfeng
    Fan, Hexun
    Computer Engineering and Applications, 2024, 60 (17) : 148 - 157
  • [47] Self-Supervised Learning of Part Mobility from Point Cloud Sequence
    Shi, Yahao
    Cao, Xinyu
    Zhou, Bin
    COMPUTER GRAPHICS FORUM, 2021, 40 (06) : 104 - 116
  • [48] Contrastive Predictive Autoencoders for Dynamic Point Cloud Self-Supervised Learning
    Sheng, Xiaoxiao
    Shen, Zhiqiang
    Xiao, Gang
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 8, 2023, : 9802 - 9810
  • [49] An autoencoder-based self-supervised learning for multimodal sentiment analysis
    Feng, Wenjun
    Wang, Xin
    Cao, Donglin
    Lin, Dazhen
    INFORMATION SCIENCES, 2024, 675
  • [50] Point Cloud Registration with Self-supervised Feature Learning and Beam Search
    Mei, Guofeng
    2021 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA 2021), 2021, : 82 - 89