Adversarial Self-Supervised Learning for Out-of-Domain Detection

被引:0
|
作者
Zeng, Zhiyuan [1 ,2 ]
He, Keqing [1 ,2 ,3 ]
Yan, Yuanmeng [1 ,2 ]
Xu, Hong [1 ,2 ]
Xu, Weiran [1 ,2 ]
机构
[1] Pattern Recognit Intelligent Syst Lab, Beijing, Peoples R China
[2] Beijing Univ Posts & Telecommun, Beijing, Peoples R China
[3] Meituan Grp, Beijing, Peoples R China
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Detecting out-of-domain (OOD) intents is crucial for the deployed task-oriented dialogue system. Previous unsupervised OOD detection methods only extract discriminative features of different in-domain intents while supervised counterparts can directly distinguish OOD and in-domain intents but require extensive labeled OOD data. To combine the benefits of both types, we propose a self-supervised contrastive learning framework to model discriminative semantic features of both in-domain intents and OOD intents from unlabeled data. Besides, we introduce an adversarial augmentation neural module to improve the efficiency and robustness of contrastive learning. Experiments on two public benchmark datasets show that our method can consistently outperform the baselines with a statistically significant margin.(1)
引用
收藏
页码:5631 / 5639
页数:9
相关论文
共 50 条
  • [1] FUSDOM: COMBINING IN-DOMAIN AND OUT-OF-DOMAIN KNOWLEDGE FOR CONTINUOUS SELF-SUPERVISED LEARNING
    Seth, Ashish
    Ghosh, Sreyan
    Umesh, S.
    Manocha, Dinesh
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2024), 2024, : 12572 - 12576
  • [2] Practical and Efficient Out-of-Domain Detection with Adversarial Learning
    Wang, Bo
    Mine, Tsunenori
    37TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, 2022, : 853 - 862
  • [3] Fully Self-Supervised Out-of-Domain Few-Shot Learning with Masked Autoencoders
    Walsh, Reece
    Osman, Islam
    Abdelaziz, Omar
    Shehata, Mohamed S.
    JOURNAL OF IMAGING, 2024, 10 (01)
  • [4] SSMBA: Self-Supervised Manifold Based Data Augmentation for Improving Out-of-Domain Robustness
    Ng, Nathan
    Cho, Kyunghyun
    Ghassemi, Marzyeh
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 1268 - 1283
  • [5] Optimizing Upstream Representations for Out-of-Domain Detection with Supervised Contrastive Learning
    Wang, Bo
    Mine, Tsunenori
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 2585 - 2595
  • [6] Modeling Discriminative Representations for Out-of-Domain Detection with Supervised Contrastive Learning
    Zeng, Zhiyuan
    He, Keqing
    Yan, Yuanmeng
    Liu, Zijun
    Wu, Yanan
    Xu, Hong
    Jiang, Huixing
    Xu, Weiran
    ACL-IJCNLP 2021: THE 59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 2, 2021, : 870 - 878
  • [7] Self-Supervised Adversarial Variational Learning
    Ye, Fei
    Bors, Adrian. G.
    PATTERN RECOGNITION, 2024, 148
  • [8] Out-of-domain Detection based on Generative Adversarial Network
    Ryu, Seonghan
    Koo, Sangjun
    Yu, Hwanjo
    Lee, Gary Geunbae
    2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 714 - 718
  • [9] Adversarial Masking for Self-Supervised Learning
    Shi, Yuge
    Siddharth, N.
    Torr, Philip H. S.
    Kosiorek, Adam R.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [10] Graph Adversarial Self-Supervised Learning
    Yang, Longqi
    Zhang, Liangliang
    Yang, Wenjing
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34