Cross-Domain Gated Learning for Domain Generalization

被引:0
|
作者
Dapeng Du
Jiawei Chen
Yuexiang Li
Kai Ma
Gangshan Wu
Yefeng Zheng
Limin Wang
机构
[1] Nanjing University,State Key Laboratory for Novel Software Technology
[2] Tencent Jarvis Lab,undefined
来源
关键词
Domain generalization; Representation learning; Dropout; Information bottleneck;
D O I
暂无
中图分类号
学科分类号
摘要
Domain generalization aims to improve the generalization capacity of a model by leveraging useful information from the multi-domain data. However, learning an effective feature representation from such multi-domain data is challenging, due to the domain shift problem. In this paper, we propose an information gating strategy, termed cross-domain gating (CDG), to address this problem. Specifically, we try to distill the domain-invariant feature by adaptively muting the domain-related activations in the feature maps. This feature distillation process prevents the network from overfitting to the domain-related detailed information, and thereby improves the generalization ability of learned feature representation. Extensive experiments are conducted on three public datasets. The experimental results show that the proposed CDG training strategy can excellently enforce the network to exploit the intrinsic features of objects from the multi-domain data, and achieve a new state-of-the-art domain generalization performance on these benchmarks.
引用
收藏
页码:2842 / 2857
页数:15
相关论文
共 50 条
  • [31] Representation Learning for Imbalanced Cross-Domain Classification
    Cheng, Lu
    Guo, Ruocheng
    Candan, K. Selcuk
    Liu, Huan
    PROCEEDINGS OF THE 2020 SIAM INTERNATIONAL CONFERENCE ON DATA MINING (SDM), 2020, : 478 - 486
  • [32] Unsupervised Cross-Domain Word Representation Learning
    Bollegala, Danushka
    Maehara, Takanori
    Kawarabayashi, Ken-Ichi
    PROCEEDINGS OF THE 53RD ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 7TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 1, 2015, : 730 - 740
  • [33] Triple Sequence Learning for Cross-domain Recommendation
    Ma, Haokai
    Xie, Ruobing
    Meng, Lei
    Chen, Xin
    Zhang, Xu
    Lin, Leyu
    Zhou, Jie
    ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2024, 42 (04)
  • [34] Learning cross-domain representations by vision transformer for unsupervised domain adaptation
    Ye, Yifan
    Fu, Shuai
    Chen, Jing
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (15): : 10847 - 10860
  • [35] Cross-domain continual learning via CLAMP
    Weng, Weiwei
    Pratama, Mahardhika
    Zhang, Jie
    Chen, Chen
    Yie, Edward Yapp Kien
    Savitha, Ramasamy
    INFORMATION SCIENCES, 2024, 676
  • [36] TLRec: Transfer Learning for Cross-domain Recommendation
    Chen, Leihui
    Zheng, Jianbing
    Gao, Ming
    Zhou, Aoying
    Zeng, Wei
    Chen, Hui
    2017 IEEE INTERNATIONAL CONFERENCE ON BIG KNOWLEDGE (IEEE ICBK 2017), 2017, : 167 - 172
  • [37] Transfer learning in cross-domain sequential recommendation
    Xu, Zitao
    Pan, Weike
    Ming, Zhong
    INFORMATION SCIENCES, 2024, 669
  • [38] Structure Preserving Generative Cross-Domain Learning
    Xia, Haifeng
    Ding, Zhengming
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 4363 - 4372
  • [39] Boosted Multifeature Learning for Cross-Domain Transfer
    Yang, Xiaoshan
    Zhang, Tianzhu
    Xu, Changsheng
    Yang, Ming-Hsuan
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2015, 11 (03)
  • [40] Acoustic Echo Cancellation with Cross-Domain Learning
    Pfeifenberger, Lukas
    Zoehrer, Matthias
    Pernkopf, Franz
    INTERSPEECH 2021, 2021, : 4753 - 4757