Mind the Class Weight Bias: Weighted Maximum Mean Discrepancy for Unsupervised Domain Adaptation

被引:396
|
作者
Yan, Hongliang [1 ]
Ding, Yukang [1 ]
Li, Peihua [2 ]
Wang, Qilong [2 ]
Xu, Yong [3 ]
Zuo, Wangmeng [1 ]
机构
[1] Harbin Inst Technol, Sch Comp Sci & Technol, Harbin, Heilongjiang, Peoples R China
[2] Dalian Univ Technol, Sch Informat & Commun Engn, Dalian, Peoples R China
[3] Harbin Inst Technol, Shenzhen Grad Sch, Biocomp Res Ctr, Shenzhen, Peoples R China
关键词
KERNEL;
D O I
10.1109/CVPR.2017.107
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In domain adaptation, maximum mean discrepancy (MMD) has been widely adopted as a discrepancy metric between the distributions of source and target domains. However, existing MMD-based domain adaptation methods generally ignore the changes of class prior distributions, i.e., class weight bias across domains. This remains an open problem but ubiquitous for domain adaptation, which can be caused by changes in sample selection criteria and application scenarios. We show that MMD cannot account for class weight bias and results in degraded domain adaptation performance. To address this issue, a weighted MMD model is proposed in this paper. Specifically, we introduce class-specific auxiliary weights into the original MMD for exploiting the class prior probability on source and target domains, whose challenge lies in the fact that the class label in target domain is unavailable. To account for it, our proposed weighted MMD model is defined by introducing an auxiliary weight for each class in the source domain, and a classification EM algorithm is suggested by alternating between assigning the pseudo-labels, estimating auxiliary weights and updating model parameters. Extensive experiments demonstrate the superiority of our weighted MMD over conventional MMD for domain adaptation.
引用
收藏
页码:945 / 954
页数:10
相关论文
共 50 条
  • [1] Weighted and Class-Specific Maximum Mean Discrepancy for Unsupervised Domain Adaptation
    Yan, Hongliang
    Li, Zhetao
    Wang, Qilong
    Li, Peihua
    Xu, Yong
    Zuo, Wangmeng
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (09) : 2420 - 2433
  • [2] Maximum Mean and Covariance Discrepancy for Unsupervised Domain Adaptation
    Wenju Zhang
    Xiang Zhang
    Long Lan
    Zhigang Luo
    [J]. Neural Processing Letters, 2020, 51 : 347 - 366
  • [3] Maximum Mean and Covariance Discrepancy for Unsupervised Domain Adaptation
    Zhang, Wenju
    Zhang, Xiang
    Lan, Long
    Luo, Zhigang
    [J]. NEURAL PROCESSING LETTERS, 2020, 51 (01) : 347 - 366
  • [4] Extreme Learning Machine Based on Maximum Weighted Mean Discrepancy for Unsupervised Domain Adaptation
    Si, Yanna
    Pu, Jiexin
    Zang, Shaofei
    Sun, Lifan
    [J]. IEEE ACCESS, 2021, 9 : 2283 - 2293
  • [5] Domain adaptation learning based on maximum distribution weighted mean discrepancy
    Zang, Shao-Fei
    Cheng, Yu-Hu
    Wang, Xue-Song
    [J]. Kongzhi yu Juece/Control and Decision, 2016, 31 (11): : 2083 - 2089
  • [6] Unsupervised Domain Adaptation using Maximum Mean Covariance Discrepancy and Variational Autoencoder
    Barreto, Fabian
    Sarvaiya, Jignesh
    Patnaik, Suprava
    Yadav, Sushilkumar
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (06) : 883 - 891
  • [7] Unsupervised domain adaptation using maximum mean discrepancy optimization for lithology identification
    Chang, Ji
    Li, Jing
    Kang, Yu
    Lv, Wenjun
    Xu, Ting
    Li, Zerui
    Zheng, Wei Xing
    Han, Hongwei
    Liu, Haining
    [J]. GEOPHYSICS, 2021, 86 (02) : ID19 - ID30
  • [8] Maximum Classifier Discrepancy for Unsupervised Domain Adaptation
    Saito, Kuniaki
    Watanabe, Kohei
    Ushiku, Yoshitaka
    Harada, Tatsuya
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 3723 - 3732
  • [9] Maximum Structural Generation Discrepancy for Unsupervised Domain Adaptation
    Xia, Haifeng
    Jing, Taotao
    Ding, Zhengming
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (03) : 3434 - 3445
  • [10] Unsupervised Domain Adaptation by Matching Distributions Based on the Maximum Mean Discrepancy via Unilateral Transformations
    Kumagai, Atsutoshi
    Iwata, Tomoharu
    [J]. THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 4106 - 4113