Generalized Zero-shot Intent Detection via Commonsense Knowledge

被引:10
|
作者
Siddique, A. B. [1 ]
Jamour, Fuad [1 ]
Xu, Luxun [1 ]
Hristidis, Vagelis [1 ]
机构
[1] Univ Calif Riverside, Riverside, CA 92521 USA
基金
美国国家科学基金会;
关键词
generalized zero-shot learning; out of domain intent detection; natural language understanding; natural language processing;
D O I
10.1145/3404835.3462985
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Identifying user intents from natural language utterances is a crucial step in conversational systems that has been extensively studied as a supervised classification problem. However, in practice, new intents emerge after deploying an intent detection model. Thus, these models should seamlessly adapt and classify utterances with both seen and unseen intents - unseen intents emerge after deployment and they do not have training data. The few existing models that target this setting rely heavily on the training data of seen intents and consequently overfit to these intents, resulting in a bias to misclassify utterances with unseen intents into seen ones. We propose RIDE: an intent detection model that leverages commonsense knowledge in an unsupervised fashion to overcome the issue of training data scarcity. RIDE computes robust and generalizable relationship meta-features that capture deep semantic relationships between utterances and intent labels; these features are computed by considering how the concepts in an utterance are linked to those in an intent label via commonsense knowledge. Our extensive experimental analysis on three widely-used intent detection benchmarks shows that relationship meta-features significantly improve the detection of both seen and unseen intents and that RIDE outperforms the state-of-the-art models.
引用
收藏
页码:1925 / 1929
页数:5
相关论文
共 50 条
  • [1] Enhancing Zero-shot and Few-shot Stance Detection with Commonsense Knowledge Graph
    Liu, Rui
    Lin, Zheng
    Tan, Yutong
    Wang, Weiping
    [J]. FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 3152 - 3157
  • [2] Improving Zero-Shot Learning Baselines with Commonsense Knowledge
    Abhinaba Roy
    Deepanway Ghosal
    Erik Cambria
    Navonil Majumder
    Rada Mihalcea
    Soujanya Poria
    [J]. Cognitive Computation, 2022, 14 : 2212 - 2222
  • [3] Improving Zero-Shot Learning Baselines with Commonsense Knowledge
    Roy, Abhinaba
    Ghosal, Deepanway
    Cambria, Erik
    Majumder, Navonil
    Mihalcea, Rada
    Poria, Soujanya
    [J]. COGNITIVE COMPUTATION, 2022, 14 (06) : 2212 - 2222
  • [4] Zero-shot User Intent Detection via Capsule Neural Networks
    Xia, Congying
    Zhang, Chenwei
    Yan, Xiaohui
    Chang, Yi
    Yu, Philip S.
    [J]. 2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 3090 - 3099
  • [5] Robust Zero-Shot Intent Detection via Contrastive Transfer Learning
    Maqbool, M. H.
    Khan, F. A.
    Siddique, A. B.
    Foroosh, Hassan
    [J]. 2023 IEEE 17TH INTERNATIONAL CONFERENCE ON SEMANTIC COMPUTING, ICSC, 2023, : 49 - 56
  • [6] Model-Agnostic Zero-Shot Intent Detection via Contrastive Transfer Learning
    Maqbool, M. H.
    Fereidouni, Moghis
    Siddique, A. B.
    Foroosh, Hassan
    [J]. INTERNATIONAL JOURNAL OF SEMANTIC COMPUTING, 2024, 18 (01) : 5 - 24
  • [7] Learning Class-Transductive Intent Representations for Zero-shot Intent Detection
    Si, Qingyi
    Liu, Yuanxin
    Fu, Peng
    Lin, Zheng
    Li, Jiangnan
    Wang, Weiping
    [J]. PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 3922 - 3928
  • [8] Enhancing Zero-Shot Stance Detection via Targeted Background Knowledge
    Zhu, Qinglin
    Liang, Bin
    Sun, Jingyi
    Du, Jiachen
    Zhou, Lanjun
    Xu, Ruifeng
    [J]. PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 2070 - 2075
  • [9] Modularized Transfer Learning with Multiple Knowledge Graphs for Zero-shot Commonsense Reasoning
    Kim, Yu Jin
    Kwak, Beong-woo
    Kim, Youngwook
    Amplayo, Reinald Kim
    Hwang, Seung-won
    Yeo, Jinyoung
    [J]. NAACL 2022: THE 2022 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES, 2022, : 2244 - 2257
  • [10] Zero-Shot Scene Graph Relation Prediction Through Commonsense Knowledge Integration
    Kan, Xuan
    Cui, Hejie
    Yang, Carl
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2021: RESEARCH TRACK, PT II, 2021, 12976 : 466 - 482