Domain generalization based on domain-specific adversarial learning

被引:1
|
作者
Wang, Ziping [1 ,2 ]
Zhang, Xiaohang [1 ,2 ]
Li, Zhengren [3 ]
Chen, Fei [3 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Econ & Management, Beijing 100876, Peoples R China
[2] Beijing Univ Posts & Telecommun, Key Lab Trustworthy Distributed Comp & Serv, Beijing 100876, Peoples R China
[3] Beijing Univ Posts & Telecommun, Sch Modern Posts, Beijing 100876, Peoples R China
基金
中国国家自然科学基金;
关键词
Domain generalization; Adversarial learning; Distribution alignment; Transfer learning;
D O I
10.1007/s10489-024-05423-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning models often suffer from degraded performance when the distributions of the training and testing data differ (i.e., domain shift). Domain generalization (DG) techniques can help improve the generalization performance for unseen target domains by using multiple source domains. The recently developed domain generalization methods focus on extracting domain-invariant features from all source domains. However, some task-relevant discriminative information can be removed during this process. In addition, the various source domains are treated equally ignoring the negative impacts of distant source domains. Both problems can lead to unsatisfactory performance. This paper proposed a domain-specific adversarial neural network (DSANN) based on adversarial learning to learn effective feature representations and reduce the influence of distantsource domains. The DSANN introduces a reference distribution that is adaptively generated during training. Additionally, domain-invariant features are extracted through a domain-specific adversarial learning process , in which each source domain distribution is aligned only with the reference distribution instead of all the other source domains. Moreover, the DSANN also aligns the outputs of multiple classifiers and adopts the weighted average of the predictions; thus, the employed label classifiers can become more robust to unknown domain shifts. Experiments conducted on popular benchmark datasets demonstrate that our proposed method can achieve remarkable generalization performance and has better classification accuracy than the existing DG algorithms.
引用
收藏
页码:4878 / 4889
页数:12
相关论文
共 50 条
  • [21] Identification of Domain-Specific Senses Based on Word Embedding Learning
    Wangpoonsarp, Attaporn
    Fukumoto, Fumiyo
    HUMAN LANGUAGE TECHNOLOGY. CHALLENGES FOR COMPUTER SCIENCE AND LINGUISTICS, LTC 2017, 2020, 12598 : 341 - 350
  • [22] Kernel-Based Learning for Domain-Specific Relation Extraction
    Basili, Roberto
    Giannone, Cristina
    Del Vescovo, Chiara
    Moschitti, Alessandro
    Naggar, Paolo
    AI (ASTERISK) IA 2009: EMERGENT PERSPECTIVES IN ARTIFICIAL INTELLIGENCE, 2009, 5883 : 161 - +
  • [23] Decomposed adversarial domain generalization
    Chen, Sentao
    KNOWLEDGE-BASED SYSTEMS, 2023, 263
  • [24] Localized Adversarial Domain Generalization
    Zhu, Wei
    Lu, Le
    Xiao, Jing
    Han, Mei
    Luo, Jiebo
    Harrison, Adam P.
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 7098 - 7108
  • [25] Improving Generalization of Drowsiness State Classification by Domain-Specific Normalization
    Kim, Dong-Young
    Han, Dong-Kyun
    Park, Seo-Hyeon
    Jang, Geun-Deok
    2024 12TH INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE, BCI 2024, 2024,
  • [26] Domain-specific and domain-general constraints on word and sequence learning
    Archibald, Lisa M. D.
    Joanisse, Marc F.
    MEMORY & COGNITION, 2013, 41 (02) : 268 - 280
  • [27] Domain-specific and domain-general constraints on word and sequence learning
    Lisa M. D. Archibald
    Marc F. Joanisse
    Memory & Cognition, 2013, 41 : 268 - 280
  • [28] Learning to Discover Domain-Specific Web Content
    Pham, Kien
    Santos, Aecio
    Freire, Juliana
    WSDM'18: PROCEEDINGS OF THE ELEVENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2018, : 432 - 440
  • [29] A Survey of Domain-Specific Architectures for Reinforcement Learning
    Rothmann, Marc
    Porrmann, Mario
    IEEE ACCESS, 2022, 10 : 13753 - 13767
  • [30] The Evolution of Domain-Specific Computing for Deep Learning
    Neuendorffer S.
    Khodamoradi A.K.
    Denolf K.
    Jain A.K.
    Bayliss S.
    IEEE Circuits and Systems Magazine, 2021, 21 (02) : 75 - 96