Style-Guided Adversarial Teacher for Cross-Domain Object Detection

被引:1
|
作者
Jia, Longfei [1 ]
Tian, Xianlong [1 ]
Hu, Yuguo [1 ]
Jing, Mengmeng [1 ]
Zuo, Lin [1 ]
Li, Wen [1 ]
机构
[1] Univ Elect Sci & Technol China, Qingshuihe Campus, Chengdu 611731, Peoples R China
基金
中国国家自然科学基金;
关键词
target-style image generation; domain adaptation; teacher-student framework; adversarial learning; sample denoising; R-CNN; INVARIANT;
D O I
10.3390/electronics13050862
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The teacher-student framework is widely employed for cross-domain object detection. However, it suffers from two problems. One is that large distribution discrepancies will cause critical performance drops. The other is that the samples that deviate from the overall distributions of both domains will greatly mislead the model. To solve these problems, we propose a style-guided adversarial teacher (SGAT) method for domain adaptation. Specifically, on the domain level, we generate target-like images based on source images to effectively narrow the gaps between domains. On the sample level, we denoise samples by estimating the probability density ratio of the 'target-style' and target distributions, which could filter out the unrelated samples and highlight the related ones. In this way, we could guarantee reliable samples. With these reliable samples, we learn the domain-invariant features through teacher-student mutual learning and adversarial learning. Extensive experiments verify the effectiveness of our method. In particular, we achieve 52.9% mAP on Clipart1k and 42.7% on Comic2k, which are 6.4% and 5.0% higher than the compared baselines.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Teacher-Student Cross-Domain Object Detection Model Combining Style Transfer and Adversarial Learning
    Wu, Lijun
    Cao, Zhe
    Chen, Zhicong
    [J]. PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT X, 2024, 14434 : 334 - 345
  • [2] Cross-domain image translation with a novel style-guided diversity loss design
    Li, Tingting
    Zhao, Huan
    Huang, Jing
    Li, Keqin
    [J]. KNOWLEDGE-BASED SYSTEMS, 2022, 255
  • [3] Harmonious Teacher for Cross-domain Object Detection
    Deng, Jinhong
    Xu, Dongli
    Li, Wen
    Duan, Lixin
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 23829 - 23838
  • [4] Cross-Domain Adaptive Teacher for Object Detection
    Li, Yu-Jhe
    Dai, Xiaoliang
    Ma, Chih-Yao
    Liu, Yen-Cheng
    Chen, Kan
    Wu, Bichen
    He, Zijian
    Kitani, Kris
    Vajda, Peter
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 7571 - 7580
  • [5] Unbiased Mean Teacher for Cross-domain Object Detection
    Deng, Jinhong
    Li, Wen
    Chen, Yuhua
    Duan, Lixin
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 4089 - 4099
  • [6] Unsupervised style-guided cross-domain adaptation for few-shot stylized face translation
    Jiaying Lan
    Fenghua Ye
    Zhenghua Ye
    Pingping Xu
    Wing-Kuen Ling
    Guoheng Huang
    [J]. The Visual Computer, 2023, 39 : 6167 - 6181
  • [7] Unsupervised style-guided cross-domain adaptation for few-shot stylized face translation
    Lan, Jiaying
    Ye, Fenghua
    Ye, Zhenghua
    Xu, Pingping
    Ling, Wing-Kuen
    Huang, Guoheng
    [J]. VISUAL COMPUTER, 2023, 39 (12): : 6167 - 6181
  • [8] Exploring Object Relation in Mean Teacher for Cross-Domain Detection
    Cai, Qi
    Pan, Yingwei
    Ngo, Chong-Wah
    Tian, Xinmei
    Duan, Lingyu
    Yao, Ting
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11449 - 11458
  • [9] MTTrans: Cross-domain Object Detection with Mean Teacher Transformer
    Yu, Jinze
    Liu, Jiaming
    Wei, Xiaobao
    Zhou, Haoyi
    Nakata, Yohei
    Gudovskiy, Denis
    Okuno, Tomoyuki
    Li, Jianxin
    Keutzer, Kurt
    Zhang, Shanghang
    [J]. COMPUTER VISION, ECCV 2022, PT IX, 2022, 13669 : 629 - 645
  • [10] Cross-domain change object detection using generative adversarial networks
    Sugimoto, Takuma
    Tanaka, Kanji
    Yamaguchi, Kousuke
    [J]. Journal of Robotics and Mechatronics, 2019, 31 (02): : 221 - 230