Extreme Learning Machine Based on Maximum Weighted Mean Discrepancy for Unsupervised Domain Adaptation

被引:8
|
作者
Si, Yanna [1 ]
Pu, Jiexin [1 ]
Zang, Shaofei [1 ]
Sun, Lifan [1 ,2 ]
机构
[1] Henan Univ Sci & Technol, Sch Informat Engn, Luoyang 471023, Peoples R China
[2] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Chengdu 611731, Peoples R China
基金
中国国家自然科学基金;
关键词
Silicon; Training; Testing; Adaptation models; Task analysis; Licenses; Training data; Extreme learning machine; domain adaptation; cross-domain weight; maximum mean discrepancy; joint distribution adaptation;
D O I
10.1109/ACCESS.2020.3047448
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Extreme Learning Machine (ELM) has shown fast learning speed and good generalization property in single-domain problems, such as classification and regression. However, the assumption that the training and testing data are subject to identical distribution often leads to significant performance degradation of ELM in cross-domain problems. To cope with unsupervised domain adaptation problems by ELM, we propose a novel method called Extreme Learning Machine based on Maximum Weighted Mean Discrepancy (ELM-MWMD) in this paper, which learns an adaptive ELM classifier with both labeled source data and unlabeled target data. Firstly, the cross-domain weight coefficients are specifically designed and assigned for each sample in source and target domains, fully considering the effects of individual information. Then the source classifier is adapted to the target domain by minimizing the distribution discrepancy between the two domains, both the marginal distribution and conditional distribution are simultaneously reduced to obtain a more accurate target classifier. Moreover, the predicted results for target data are utilized as pseudo labels to further improve the classification accuracy in multiple iterations. Extensive experiments on public image datasets demonstrate that ELM-MWMD performs better than several existing state-of-the-art domain adaptation methods by computation efficiency and classification accuracy.
引用
收藏
页码:2283 / 2293
页数:11
相关论文
共 50 条
  • [1] Domain adaptation learning based on maximum distribution weighted mean discrepancy
    Zang, Shao-Fei
    Cheng, Yu-Hu
    Wang, Xue-Song
    [J]. Kongzhi yu Juece/Control and Decision, 2016, 31 (11): : 2083 - 2089
  • [2] Weighted and Class-Specific Maximum Mean Discrepancy for Unsupervised Domain Adaptation
    Yan, Hongliang
    Li, Zhetao
    Wang, Qilong
    Li, Peihua
    Xu, Yong
    Zuo, Wangmeng
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (09) : 2420 - 2433
  • [3] Maximum Mean and Covariance Discrepancy for Unsupervised Domain Adaptation
    Wenju Zhang
    Xiang Zhang
    Long Lan
    Zhigang Luo
    [J]. Neural Processing Letters, 2020, 51 : 347 - 366
  • [4] Maximum Mean and Covariance Discrepancy for Unsupervised Domain Adaptation
    Zhang, Wenju
    Zhang, Xiang
    Lan, Long
    Luo, Zhigang
    [J]. NEURAL PROCESSING LETTERS, 2020, 51 (01) : 347 - 366
  • [5] Mind the Class Weight Bias: Weighted Maximum Mean Discrepancy for Unsupervised Domain Adaptation
    Yan, Hongliang
    Ding, Yukang
    Li, Peihua
    Wang, Qilong
    Xu, Yong
    Zuo, Wangmeng
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 945 - 954
  • [6] Discriminative Extreme Learning Machine with Cross-Domain Mean Approximation for Unsupervised Domain Adaptation
    Zang, Shaofei
    Li, Xinghai
    Ma, Jianwei
    Yan, Yongyi
    Lv, Jinfeng
    Wei, Yuan
    [J]. COMPLEXITY, 2022, 2022
  • [7] Unsupervised Domain Adaptation by Matching Distributions Based on the Maximum Mean Discrepancy via Unilateral Transformations
    Kumagai, Atsutoshi
    Iwata, Tomoharu
    [J]. THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 4106 - 4113
  • [8] Unsupervised Domain Adaptation using Maximum Mean Covariance Discrepancy and Variational Autoencoder
    Barreto, Fabian
    Sarvaiya, Jignesh
    Patnaik, Suprava
    Yadav, Sushilkumar
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (06) : 883 - 891
  • [9] Unsupervised domain adaptation using maximum mean discrepancy optimization for lithology identification
    Chang, Ji
    Li, Jing
    Kang, Yu
    Lv, Wenjun
    Xu, Ting
    Li, Zerui
    Zheng, Wei Xing
    Han, Hongwei
    Liu, Haining
    [J]. GEOPHYSICS, 2021, 86 (02) : ID19 - ID30
  • [10] Maximum Classifier Discrepancy for Unsupervised Domain Adaptation
    Saito, Kuniaki
    Watanabe, Kohei
    Ushiku, Yoshitaka
    Harada, Tatsuya
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 3723 - 3732