Self-ensembling for 3D point cloud domain adaptation

被引:0
|
作者
Li, Qing [1 ,4 ]
Peng, Xiaojiang [1 ]
Yan, Chuan [2 ]
Gao, Pan [3 ]
Hao, Qi [4 ]
机构
[1] Shenzhen Technol Univ, Coll Big data & Internet, Shenzhen 518118, Peoples R China
[2] George Mason Univ, Comp Sci & Engn, Fairfax, VA 22030 USA
[3] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Coll Artificial Intelligence, Nanjing 210016, Peoples R China
[4] Southern Univ Sci & Technol, Sch Comp Sci & Engn, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
3D point clouds; Unsupervised domain adaptation; SEN; Self-supervised learning;
D O I
10.1016/j.imavis.2024.105409
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently 3D point cloud learning has been a hot topic in computer vision and autonomous driving. Due to the fact that it is difficult to manually annotate a qualitative large-scale 3D point cloud dataset, unsupervised domain adaptation (UDA) is popular in 3D point cloud learning which aims to transfer the learned knowledge from the labeled source domain to the unlabeled target domain. Existing methods mainly resort to a deformation reconstruction in the target domain, leveraging the deformable invariance process for generalization and domain adaptation. In this paper, we propose a conceptually new yet simple method, termed as selfensembling network (SEN) for domain generalization and adaptation. In SEN, we propose a soft classification loss on the source domain and a consistency loss on the target domain to stabilize the feature representations and to capture better invariance in the UDA task. In addition, we extend the pointmixup module on the target domain to increase the diversity of point clouds which further boosts cross domain generalization. Extensive experiments on several 3D point cloud UDA benchmarks show that our SEN outperforms the state-of-the-art methods on both classification and segmentation tasks.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Unsupervised domain adaptation for medical imaging segmentation with self-ensembling
    Perone, Christian S.
    Ballester, Pedro
    Barros, Rodrigo C.
    Cohen-Adad, Julien
    NEUROIMAGE, 2019, 194 : 1 - 11
  • [2] CATEGORY-LEVEL ADVERSARIAL SELF-ENSEMBLING FOR DOMAIN ADAPTATION
    Zuo, Yukun
    Yao, Hantao
    Xu, Changsheng
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [3] Unsupervised Domain Adaptation for the Histopathological Cell Segmentation through Self-Ensembling
    Li, Chaoqun
    Zhou, Yitian
    Shi, Tangqi
    Wu, Yenan
    Yang, Meng
    Li, Zhongyu
    MICCAI WORKSHOP ON COMPUTATIONAL PATHOLOGY, VOL 156, 2021, 156 : 151 - 158
  • [4] Self-ensembling with mask-boundary domain adaptation for optic disc and cup segmentation
    He, Yanlin
    Kong, Jun
    Liu, Di
    Li, Juan
    Zheng, Caixia
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 129
  • [5] Domain Adaptation Semantic Segmentation for Urban Scene Combining Self-ensembling and Adversarial Learning
    Zhang G.
    Lu F.
    Long B.
    Miao J.
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2021, 34 (01): : 58 - 67
  • [6] Self-Ensembling with GAN-based Data Augmentation for Domain Adaptation in Semantic Segmentation
    Choi, Jaehoon
    Kim, Taekyung
    Kim, Changick
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 6829 - 6839
  • [7] LiDAR-UDA: Self-ensembling Through Time for Unsupervised LiDAR Domain Adaptation
    Shaban, Amirreza
    Lee, JoonHo
    Jung, Sanghun
    Meng, Xiangyun
    Boots, Byron
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 19727 - 19737
  • [8] SE-SSD: Self-Ensembling Single-Stage Object Detector From Point Cloud
    Zheng, Wu
    Tang, Weiliang
    Jiang, Li
    Fu, Chi-Wing
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 14489 - 14498
  • [9] Self-Ensembling GAN for Cross-Domain Semantic Segmentation
    Xu, Yonghao
    He, Fengxiang
    Du, Bo
    Tao, Dacheng
    Zhang, Liangpei
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 7837 - 7850
  • [10] 3D Photogrammetry Point Cloud Segmentation Using a Model Ensembling Framework
    Chen, Meida
    Feng, Andrew
    McCullough, Kyle
    Prasad, Pratusha Bhuvana
    McAlinden, Ryan
    Soibelman, Lucio
    JOURNAL OF COMPUTING IN CIVIL ENGINEERING, 2020, 34 (06)