Semi-supervised Domain Adaptation via Minimax Entropy

被引:381
|
作者
Saito, Kuniaki [1 ]
Kim, Donghyun [1 ]
Sclaroff, Stan [1 ]
Darrell, Trevor [2 ]
Saenko, Kate [1 ]
机构
[1] Boston Univ, Boston, MA 02215 USA
[2] Univ Calif Berkeley, Berkeley, CA 94720 USA
基金
美国国家科学基金会;
关键词
D O I
10.1109/ICCV.2019.00814
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Contemporary domain adaptation methods are very effective at aligning feature distributions of source and target domains without any target supervision. However, we show that these techniques perform poorly when even a few labeled examples are available in the target domain. To address this semi-supervised domain adaptation (SSDA) setting, we propose a novel Minimax Entropy (MME) approach that adversarially optimizes an adaptive few-shot model. Our base model consists of a feature encoding network, followed by a classification layer that computes the features' similarity to estimated prototypes (representatives of each class). Adaptation is achieved by alternately maximizing the conditional entropy of unlabeled target data with respect to the classifier and minimizing it with respect to the feature encoder. We empirically demonstrate the superiority of our method over many baselines, including conventional feature alignment and few-shot methods, setting a new state of the art for SSDA.
引用
收藏
页码:8049 / 8057
页数:9
相关论文
共 50 条
  • [1] Semi-supervised domain adaptation on graphs with contrastive learning and minimax entropy
    Xiao, Jiaren
    Dai, Quanyu
    Shen, Xiao
    Xie, Xiaochen
    Dai, Jing
    Lam, James
    Kwok, Ka-Wai
    [J]. NEUROCOMPUTING, 2024, 580
  • [2] Multicentric intelligent cardiotocography signal interpretation using deep semi-supervised domain adaptation via minimax entropy and domain invariance
    Li, Jialu
    Li, Jun
    Guo, Chenshuo
    Chen, Qinqun
    Liu, Guiqing
    Li, Li
    Luo, Xiaomu
    Wei, Hang
    [J]. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2024, 249
  • [3] SEMI-SUPERVISED DOMAIN ADAPTATION FOR ACOUSTIC SCENE CLASSIFICATION BY MINIMAX ENTROPY AND SELF-SUPERVISION APPROACHES
    Takahashi, Yukiko
    Takamuku, Sawa
    Imoto, Keisuke
    Natori, Naotake
    [J]. 2022 INTERNATIONAL WORKSHOP ON ACOUSTIC SIGNAL ENHANCEMENT (IWAENC 2022), 2022,
  • [4] Semi-supervised Domain Adaptation via adversarial training
    Couturier, Antonin
    Almasan, Anton-David
    [J]. 2021 SENSOR SIGNAL PROCESSING FOR DEFENCE CONFERENCE (SSPD), 2021, : 36 - 39
  • [5] Semi-supervised domain adaptation via subspace exploration
    Han, Zheng
    Zhu, Xiaobin
    Yang, Chun
    Fang, Zhiyu
    Qin, Jingyan
    Yin, Xucheng
    [J]. IET COMPUTER VISION, 2024, 18 (03) : 370 - 380
  • [6] Context-guided entropy minimization for semi-supervised domain adaptation
    Ma, Ning
    Bu, Jiajun
    Lu, Lixian
    Wen, Jun
    Zhou, Sheng
    Zhang, Zhen
    Gu, Jingjun
    Li, Haifeng
    Yan, Xifeng
    [J]. NEURAL NETWORKS, 2022, 154 : 270 - 282
  • [7] SEMI-SUPERVISED DOMAIN ADAPTATION VIA CONVOLUTIONAL NEURAL NETWORK
    Liu, Pengcheng
    Cheng, Cheng
    Feng, Youji
    Shao, Xiaohu
    Zhou, Xiangdong
    [J]. 2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 2841 - 2845
  • [8] Semi-supervised Domain Adaptation on Manifolds
    Cheng, Li
    Pan, Sinno Jialin
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2014, 25 (12) : 2240 - 2249
  • [9] Handling Domain Shift for Lesion Detection via Semi-supervised Domain Adaptation
    Sheoran, Manu
    Sharma, Monika
    Dani, Meghal
    Vig, Lovekesh
    [J]. COMPUTER VISION - ACCV 2022 WORKSHOPS, 2023, 13848 : 102 - 116
  • [10] Semi-Supervised Domain Adaptation with Source Label Adaptation
    Yu, Yu-Chu
    Lin, Hsuan-Tien
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 24100 - 24109