Adversarial Self-Supervised Learning for Out-of-Domain Detection

被引:0
|
作者
Zeng, Zhiyuan [1 ,2 ]
He, Keqing [1 ,2 ,3 ]
Yan, Yuanmeng [1 ,2 ]
Xu, Hong [1 ,2 ]
Xu, Weiran [1 ,2 ]
机构
[1] Pattern Recognit Intelligent Syst Lab, Beijing, Peoples R China
[2] Beijing Univ Posts & Telecommun, Beijing, Peoples R China
[3] Meituan Grp, Beijing, Peoples R China
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Detecting out-of-domain (OOD) intents is crucial for the deployed task-oriented dialogue system. Previous unsupervised OOD detection methods only extract discriminative features of different in-domain intents while supervised counterparts can directly distinguish OOD and in-domain intents but require extensive labeled OOD data. To combine the benefits of both types, we propose a self-supervised contrastive learning framework to model discriminative semantic features of both in-domain intents and OOD intents from unlabeled data. Besides, we introduce an adversarial augmentation neural module to improve the efficiency and robustness of contrastive learning. Experiments on two public benchmark datasets show that our method can consistently outperform the baselines with a statistically significant margin.(1)
引用
收藏
页码:5631 / 5639
页数:9
相关论文
共 50 条
  • [21] Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detection
    Chen, Liang
    Zhang, Yong
    Song, Yibing
    Liu, Lingqiao
    Wang, Jue
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 18689 - 18698
  • [22] Combining Self-supervised Learning and Adversarial Training based Domain Adaptation for Speaker Verification
    Chen, Zhengyang
    Wang, Shuai
    Han, Bing
    Qian, Yanmin
    2024 IEEE 14TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING, ISCSLP 2024, 2024, : 701 - 705
  • [23] Feature Extraction for Out of Distribution Detection via Self-Supervised Learning
    Thorp, Claire
    Sisti, Sean
    Bennette, Walter
    2022 21ST IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, ICMLA, 2022, : 920 - 924
  • [24] Self-Supervised Vessel Segmentation via Adversarial Learning
    Ma, Yuxin
    Hua, Yang
    Deng, Hanming
    Song, Tao
    Wang, Hao
    Xue, Zhengui
    Cao, Heng
    Ma, Ruhui
    Guan, Haibing
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 7516 - 7525
  • [25] Self-supervised graph representations with generative adversarial learning
    Sun, Xuecheng
    Wang, Zonghui
    Lu, Zheming
    Lu, Ziqian
    NEUROCOMPUTING, 2024, 592
  • [26] CHARACTERIZING THE ADVERSARIAL VULNERABILITY OF SPEECH SELF-SUPERVISED LEARNING
    Wu, Haibin
    Zheng, Bo
    Li, Xu
    Wu, Xixin
    Lee, Hung-Yi
    Meng, Helen
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 3164 - 3168
  • [27] Metric Learning and Adaptive Boundary for Out-of-Domain Detection
    Lorenc, Petr
    Gargiani, Tommaso
    Pichl, Jan
    Konrad, Jakub
    Marek, Petr
    Kobza, Ondrej
    Sedivy, Jan
    NATURAL LANGUAGE PROCESSING AND INFORMATION SYSTEMS (NLDB 2022), 2022, 13286 : 127 - 134
  • [28] Effective Targeted Attacks for Adversarial Self-Supervised Learning
    Kim, Minseon
    Ha, Hyeonjeong
    Son, Sooel
    Hwang, Sung Ju
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [29] A Comprehensive and Adversarial Approach to Self-Supervised Representation Learning
    Xu, Yi-Zhan
    Han, Sungwon
    Park, Sungwon
    Cha, Meeyoung
    Li, Cheng-Te
    2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, : 709 - 717
  • [30] Self-Supervised Adversarial Example Detection by Disentangled Representation
    Zhang, Zhaoxi
    Zhang, Leo Yu
    Zheng, Xufei
    Tian, Jinyu
    Zhou, Jiantao
    2022 IEEE INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS, TRUSTCOM, 2022, : 1000 - 1007