Adversarial Self-Supervised Learning for Out-of-Domain Detection

被引:0
|
作者
Zeng, Zhiyuan [1 ,2 ]
He, Keqing [1 ,2 ,3 ]
Yan, Yuanmeng [1 ,2 ]
Xu, Hong [1 ,2 ]
Xu, Weiran [1 ,2 ]
机构
[1] Pattern Recognit Intelligent Syst Lab, Beijing, Peoples R China
[2] Beijing Univ Posts & Telecommun, Beijing, Peoples R China
[3] Meituan Grp, Beijing, Peoples R China
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Detecting out-of-domain (OOD) intents is crucial for the deployed task-oriented dialogue system. Previous unsupervised OOD detection methods only extract discriminative features of different in-domain intents while supervised counterparts can directly distinguish OOD and in-domain intents but require extensive labeled OOD data. To combine the benefits of both types, we propose a self-supervised contrastive learning framework to model discriminative semantic features of both in-domain intents and OOD intents from unlabeled data. Besides, we introduce an adversarial augmentation neural module to improve the efficiency and robustness of contrastive learning. Experiments on two public benchmark datasets show that our method can consistently outperform the baselines with a statistically significant margin.(1)
引用
收藏
页码:5631 / 5639
页数:9
相关论文
共 50 条
  • [11] Adversarial Self-Supervised Contrastive Learning
    Kim, Minseon
    Tack, Jihoon
    Hwang, Sung Ju
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS (NEURIPS 2020), 2020, 33
  • [12] Self-Supervised Adversarial Imitation Learning
    Monteiro, Juarez
    Gavenski, Nathan
    Meneguzzi, Felipe
    Barros, Rodrigo C.
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [13] Deep anomaly detection with self-supervised learning and adversarial training
    Zhang, Xianchao
    Mu, Jie
    Zhang, Xiaotong
    Liu, Han
    Zong, Linlin
    Li, Yuangang
    PATTERN RECOGNITION, 2022, 121
  • [14] Self-Supervised Adversarial Learning for Domain Adaptation of Pavement Distress Classification
    Wu, Yanwen
    Hong, Mingjian
    Li, Ao
    Huang, Sheng
    Liu, Huijun
    Ge, Yongxin
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (02) : 1966 - 1977
  • [15] A Self-supervised Adversarial Learning Approach for Network Intrusion Detection System
    Deng, Lirui
    Zhao, Youjian
    Bao, Heng
    CYBER SECURITY, CNCERT 2022, 2022, 1699 : 73 - 85
  • [16] Self-Supervised Learning for Generalizable Out-of-Distribution Detection
    Mohseni, Sina
    Pitale, Mandar
    Yadawa, J. B. S.
    Wang, Zhangyang
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 5216 - 5223
  • [17] Decoupled Adversarial Contrastive Learning for Self-supervised Adversarial Robustness
    Zhang, Chaoning
    Zhang, Kang
    Zhang, Chenshuang
    Niu, Axi
    Feng, Jiu
    Yoo, Chang D.
    Kweon, In So
    COMPUTER VISION - ECCV 2022, PT XXX, 2022, 13690 : 725 - 742
  • [18] Domain adaptation and self-supervised learning for surgical margin detection
    Santilli, Alice M. L.
    Jamzad, Amoon
    Sedghi, Alireza
    Kaufmann, Martin
    Logan, Kathryn
    Wallis, Julie
    Ren, Kevin Y. M.
    Janssen, Natasja
    Merchant, Shaila
    Engel, Jay
    McKay, Doug
    Varma, Sonal
    Wang, Ami
    Fichtinger, Gabor
    Rudan, John F.
    Mousavi, Parvin
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2021, 16 (05) : 861 - 869
  • [19] Domain adaptation and self-supervised learning for surgical margin detection
    Alice M. L. Santilli
    Amoon Jamzad
    Alireza Sedghi
    Martin Kaufmann
    Kathryn Logan
    Julie Wallis
    Kevin Y. M Ren
    Natasja Janssen
    Shaila Merchant
    Jay Engel
    Doug McKay
    Sonal Varma
    Ami Wang
    Gabor Fichtinger
    John F. Rudan
    Parvin Mousavi
    International Journal of Computer Assisted Radiology and Surgery, 2021, 16 : 861 - 869
  • [20] Domain Adversarial Self-Supervised Speech Representation Learning for Improving Unknown Domain Downstream Tasks
    Tanaka, Tomohiro
    Masumura, Ryo
    Sato, Hiroshi
    Ihori, Mana
    Matsuura, Kohei
    Ashihara, Takanori
    Moriya, Takafumi
    INTERSPEECH 2022, 2022, : 1066 - 1070