Scale-Consistent and Temporally Ensembled Unsupervised Domain Adaptation for Object Detection

被引:1
|
作者
Guo, Lunfeng [1 ,2 ,3 ]
Zhang, Yizhe [1 ,2 ,3 ]
Liu, Jiayin [1 ,4 ]
Liu, Huajie [5 ]
Li, Yunwang [1 ,3 ,4 ]
机构
[1] China Univ Min & Technol Beijing, Sch Mech & Elect Engn, Beijing 100083, Peoples R China
[2] Min Univ Beijing, Inner Mongolia Res Inst, Ordos 017000, Peoples R China
[3] Minist Emergency Management, Key Lab Smart Min & Robot, Beijing 100083, Peoples R China
[4] China Acad Safety Sci & Technol, Beijing 100083, Peoples R China
[5] Tsinghua Univ, Suzhou Automot Res Inst Wujiang, Suzhou 215200, Peoples R China
基金
中国国家自然科学基金;
关键词
object detection; autonomous driving; unsupervised domain adaption;
D O I
10.3390/s25010230
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Unsupervised Domain Adaptation for Object Detection (UDA-OD) aims to adapt a model trained on a labeled source domain to an unlabeled target domain, addressing challenges posed by domain shifts. However, existing methods often face significant challenges, particularly in detecting small objects and over-relying on classification confidence for pseudo-label selection, which often leads to inaccurate bounding box localization. To address these issues, we propose a novel UDA-OD framework that leverages scale consistency (SC) and Temporal Ensemble Pseudo-Label Selection (TEPLS) to enhance cross-domain robustness and detection performance. Specifically, we introduce Cross-Scale Prediction Consistency (CSPC) to enforce consistent detection across multiple resolutions, improving detection robustness for objects of varying scales. Additionally, we integrate Intra-Class Feature Consistency (ICFC), which employs contrastive learning to align feature representations within each class, further enhancing adaptation. To ensure high-quality pseudo-labels, TEPLS combines temporal localization stability with classification confidence, mitigating the impact of noisy predictions and improving both classification and localization accuracy. Extensive experiments on challenging benchmarks, including Cityscapes to Foggy Cityscapes, Sim10k to Cityscapes, and Virtual Mine to Actual Mine, demonstrate that our method achieves state-of-the-art performance, with notable improvements in small object detection and overall cross-domain robustness. These results highlight the effectiveness of our framework in addressing key limitations of existing UDA-OD approaches.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Unsupervised Scale-Consistent Depth Learning from Video
    Bian, Jia-Wang
    Zhan, Huangying
    Wang, Naiyan
    Li, Zhichao
    Zhang, Le
    Shen, Chunhua
    Cheng, Ming-Ming
    Reid, Ian
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (09) : 2548 - 2564
  • [2] Unsupervised Scale-Consistent Depth Learning from Video
    Jia-Wang Bian
    Huangying Zhan
    Naiyan Wang
    Zhichao Li
    Le Zhang
    Chunhua Shen
    Ming-Ming Cheng
    Ian Reid
    International Journal of Computer Vision, 2021, 129 : 2548 - 2564
  • [3] Unsupervised domain adaptation for multispectral object detection
    Jang, Hyunsung
    Lee, Minseok
    Kim, Jaeyeob
    Ha, Namkoo
    Sohn, Kwanghoon
    AUTOMATIC TARGET RECOGNITION XXXIII, 2023, 12521
  • [4] SCVO: Scale-Consistent Depth and Pose for Unsupervised Visual Odometry
    Zhang, Huiqing
    Yang, Yongjian
    Li, Ji
    Li, Weikang
    Chinese Control Conference, CCC, 2022, 2022-July : 7234 - 7239
  • [5] DesNet: Decomposed Scale-Consistent Network for Unsupervised Depth Completion
    Yan, Zhiqiang
    Wang, Kun
    Li, Xiang
    Zhang, Zhenyu
    Li, Jun
    Yang, Jian
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 3, 2023, : 3109 - 3117
  • [6] SCVO: Scale-Consistent Depth and Pose for Unsupervised Visual Odometry
    Zhang, Huiqing
    Yang, Yongjian
    Li, Ji
    Li, Weikang
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 7234 - 7239
  • [7] Disentangled Discriminator for Unsupervised Domain Adaptation on Object Detection
    Zhu, Yangguang
    Guo, Ping
    Wei, Haoran
    Zhao, Xin
    Wu, Xiangbin
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 5685 - 5691
  • [8] Unsupervised Domain Adaptation for Object Detection in Cultural Sites
    Pasqualino, Giovanni
    Furnari, Antonino
    Farinella, Giovanni Maria
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 983 - 990
  • [9] Multi-source unsupervised domain adaptation for object detection
    Zhang, Dan
    Ye, Mao
    Liu, Yiguang
    Xiong, Lin
    Zhou, Lihua
    INFORMATION FUSION, 2022, 78 : 138 - 148
  • [10] One-Shot Unsupervised Domain Adaptation for Object Detection
    Wan, Zhiqiang
    Li, Lusi
    Li, Hepeng
    He, Haibo
    Ni, Zhen
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,