Domain generalization based on domain-specific adversarial learning

被引:0
|
作者
Wang, Ziping [1 ,2 ]
Zhang, Xiaohang [1 ,2 ]
Li, Zhengren [3 ]
Chen, Fei [3 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Econ & Management, Beijing 100876, Peoples R China
[2] Beijing Univ Posts & Telecommun, Key Lab Trustworthy Distributed Comp & Serv, Beijing 100876, Peoples R China
[3] Beijing Univ Posts & Telecommun, Sch Modern Posts, Beijing 100876, Peoples R China
基金
中国国家自然科学基金;
关键词
Domain generalization; Adversarial learning; Distribution alignment; Transfer learning;
D O I
10.1007/s10489-024-05423-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning models often suffer from degraded performance when the distributions of the training and testing data differ (i.e., domain shift). Domain generalization (DG) techniques can help improve the generalization performance for unseen target domains by using multiple source domains. The recently developed domain generalization methods focus on extracting domain-invariant features from all source domains. However, some task-relevant discriminative information can be removed during this process. In addition, the various source domains are treated equally ignoring the negative impacts of distant source domains. Both problems can lead to unsatisfactory performance. This paper proposed a domain-specific adversarial neural network (DSANN) based on adversarial learning to learn effective feature representations and reduce the influence of distantsource domains. The DSANN introduces a reference distribution that is adaptively generated during training. Additionally, domain-invariant features are extracted through a domain-specific adversarial learning process , in which each source domain distribution is aligned only with the reference distribution instead of all the other source domains. Moreover, the DSANN also aligns the outputs of multiple classifiers and adopts the weighted average of the predictions; thus, the employed label classifiers can become more robust to unknown domain shifts. Experiments conducted on popular benchmark datasets demonstrate that our proposed method can achieve remarkable generalization performance and has better classification accuracy than the existing DG algorithms.
引用
收藏
页码:4878 / 4889
页数:12
相关论文
共 50 条
  • [1] Domain Generalization by Learning and Removing Domain-specific Features
    Ding, Yu
    Wang, Lei
    Liang, Bin
    Liang, Shuming
    Wang, Yang
    Chen, Fang
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [2] Domain-Specific Risk Minimization for Domain Generalization
    Zhang, Yi-Fan
    Wang, Jindong
    Liang, Jian
    Zhang, Zhang
    Yu, Baosheng
    Wang, Liang
    Tao, Dacheng
    Xie, Xing
    [J]. PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 3409 - 3421
  • [3] Exploiting Domain-Specific Features to Enhance Domain Generalization
    Bui, Manh-Ha
    Tran, Toan
    Tran, Tuan
    Phung, Dinh
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [4] Ensembling disentangled domain-specific prompts for domain generalization
    Xu, Fangbin
    Deng, Shizhuo
    Jia, Tong
    Yu, Xiaosheng
    Chen, Dongyue
    [J]. KNOWLEDGE-BASED SYSTEMS, 2024, 301
  • [5] Domain Generalization with Adversarial Feature Learning
    Li, Haoliang
    Pan, Sinno Jialin
    Wang, Shiqi
    Kot, Alex C.
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 5400 - 5409
  • [6] Domain-Specific Bias Filtering for Single Labeled Domain Generalization
    Yuan, Junkun
    Ma, Xu
    Chen, Defang
    Kuang, Kun
    Wu, Fei
    Lin, Lanfen
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2023, 131 (02) : 552 - 571
  • [7] Domain-Specific Bias Filtering for Single Labeled Domain Generalization
    Junkun Yuan
    Xu Ma
    Defang Chen
    Kun Kuang
    Fei Wu
    Lanfen Lin
    [J]. International Journal of Computer Vision, 2023, 131 : 552 - 571
  • [8] MADG: Margin-based Adversarial Learning for Domain Generalization
    Dayal, Aveen
    Vimal, K. B.
    Cenkeramaddi, Linga Reddy
    Mohan, C. Krishna
    Kumar, Abhinav
    Balasubramanian, Vineeth N.
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [9] Discriminative adversarial domain generalization with meta-learning based cross-domain validation
    Chen, Keyu
    Zhuang, Di
    Chang, J. Morris
    [J]. NEUROCOMPUTING, 2022, 467 : 418 - 426
  • [10] Graph-based domain adversarial learning framework for video anomaly detection domain generalization
    Mei, Xue
    Wei, Yachuan
    Chen, Haoyang
    [J]. JOURNAL OF SUPERCOMPUTING, 2024, 80 (13): : 18977 - 19002