Self-ensembling for 3D point cloud domain adaptation

被引:0
|
作者
Li, Qing [1 ,4 ]
Peng, Xiaojiang [1 ]
Yan, Chuan [2 ]
Gao, Pan [3 ]
Hao, Qi [4 ]
机构
[1] Shenzhen Technol Univ, Coll Big data & Internet, Shenzhen 518118, Peoples R China
[2] George Mason Univ, Comp Sci & Engn, Fairfax, VA 22030 USA
[3] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Coll Artificial Intelligence, Nanjing 210016, Peoples R China
[4] Southern Univ Sci & Technol, Sch Comp Sci & Engn, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
3D point clouds; Unsupervised domain adaptation; SEN; Self-supervised learning;
D O I
10.1016/j.imavis.2024.105409
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently 3D point cloud learning has been a hot topic in computer vision and autonomous driving. Due to the fact that it is difficult to manually annotate a qualitative large-scale 3D point cloud dataset, unsupervised domain adaptation (UDA) is popular in 3D point cloud learning which aims to transfer the learned knowledge from the labeled source domain to the unlabeled target domain. Existing methods mainly resort to a deformation reconstruction in the target domain, leveraging the deformable invariance process for generalization and domain adaptation. In this paper, we propose a conceptually new yet simple method, termed as selfensembling network (SEN) for domain generalization and adaptation. In SEN, we propose a soft classification loss on the source domain and a consistency loss on the target domain to stabilize the feature representations and to capture better invariance in the UDA task. In addition, we extend the pointmixup module on the target domain to increase the diversity of point clouds which further boosts cross domain generalization. Extensive experiments on several 3D point cloud UDA benchmarks show that our SEN outperforms the state-of-the-art methods on both classification and segmentation tasks.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] Robust and Fast Self Localization by 3D Point Cloud
    Fukai, Hironobu
    Takagi, Jumpei
    Xu, Gang
    4TH INTERNATIONAL CONFERENCE ON HUMAN SYSTEM INTERACTION (HSI 2011), 2011, : 392 - 397
  • [22] Self-Distillation for Unsupervised 3D Domain Adaptation
    Cardace, Adriano
    Spezialetti, Riccardo
    Ramirez, Pierluigi Zama
    Salti, Samuele
    Di Stefano, Luigi
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 4155 - 4166
  • [23] Unsupervised Domain Adaptation for 3D Point Clouds by Searched Transformations
    Kang, Dongmin
    Nam, Yeongwoo
    Kyung, Daeun
    Choi, Jonghyun
    IEEE ACCESS, 2022, 10 : 56901 - 56913
  • [24] GENERATION FOR UNSUPERVISED DOMAIN ADAPTATION: A GAN-BASED APPROACH FOR OBJECT CLASSIFICATION WITH 3D POINT CLOUD DATA
    Huang, Junxuan
    Yuan, Junsong
    Qiao, Chunming
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 3753 - 3757
  • [25] Intramodality Domain Adaptation Using Self Ensembling and Adversarial Training
    Shanis, Zahil
    Gerber, Samuel
    Gao, Mingchen
    Enquobahrie, Andinet
    DOMAIN ADAPTATION AND REPRESENTATION TRANSFER AND MEDICAL IMAGE LEARNING WITH LESS LABELS AND IMPERFECT DATA, DART 2019, MIL3ID 2019, 2019, 11795 : 28 - 36
  • [26] Cross self-attention network for 3D point cloud
    Wang, Gaihua
    Zhai, Qianyu
    Liu, Hong
    KNOWLEDGE-BASED SYSTEMS, 2022, 247
  • [27] Triple Consistency-based Self-ensembling Model for Unsupervised Domain Adaption in Medical Image Segmentation
    Shi, Andrew
    Feng, Wei
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [28] Domain Adaptive LiDAR Point Cloud Segmentation With 3D Spatial Consistency
    Xiao, Aoran
    Guan, Dayan
    Zhang, Xiaoqin
    Lu, Shijian
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 5536 - 5547
  • [29] Exploring the Devil in Graph Spectral Domain for 3D Point Cloud Attacks
    Hu, Qianjiang
    Liu, Daizong
    Hu, Wei
    COMPUTER VISION - ECCV 2022, PT III, 2022, 13663 : 229 - 248
  • [30] DALi: Domain Adaptation in LiDAR Point Clouds for 3D Obstacle Detection
    Cortes, Irene
    Beltran, Jorge
    de la Escalera, Arturo
    Garcia, Fernando
    2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 3837 - 3842