SLIM: EXPLICIT SLOT-INTENT MAPPING WITH BERT FOR JOINT MULTI-INTENT DETECTION AND SLOT FILLING

被引:11
|
作者
Cai, Fengyu [1 ]
Zhou, Wanhao [1 ]
Mi, Fei [2 ]
Faltings, Boi [1 ]
机构
[1] Ecole Polytech Fed Lausanne EPFL, Lausanne, Switzerland
[2] Huawei Noahs Ark Lab, Shenzhen, Peoples R China
关键词
Spoken Language Understanding; Multi-intent Classification; Slot Filling;
D O I
10.1109/ICASSP43922.2022.9747477
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Utterance-level intent detection and token-level slot filling are two key tasks for spoken language understanding (SLU) in task-oriented systems. Most existing approaches assume that only a single intent exists in an utterance. However, there are often multiple intents within an utterance in real-life scenarios. In this paper, we propose a multi-intent SLU framework, called SLIM, to jointly learn multi-intent detection and slot filling based on BERT. To fully exploit the existing annotation data and capture the interactions between slots and intents, SLIM introduces an explicit slot-intent classifier to learn the many-to-one mapping between slots and intents. Empirical results on three public multi-intent datasets demonstrate (1) the superior performance of SLIM compared to the current state-of-the-art for SLU with multiple intents and (2) the benefits obtained from the slot-intent classifier.
引用
收藏
页码:7607 / 7611
页数:5
相关论文
共 50 条
  • [41] Semantically Guided Enhanced Fusion for Intent Detection and Slot Filling
    Cai, Songtao
    Ma, Qicheng
    Hou, Yupeng
    Zeng, Guangping
    APPLIED SCIENCES-BASEL, 2023, 13 (22):
  • [42] A novel model based on a transformer for intent detection and slot filling
    Dapeng Li
    Shuliang Wang
    Boxiang Zhao
    Zhiqiang Ma
    Leixiao Li
    Urban Informatics, 3 (1):
  • [43] A BERT-based Intent Recognition and Slot Filling Joint Model for Air Traffic Control Instruction Understanding
    Deng, Qihan
    Yang, Yang
    Zhang, Xiaoxiao
    Qian, Shengsheng
    Zhang, Minghua
    Cai, Kaiquan
    2023 IEEE/AIAA 42ND DIGITAL AVIONICS SYSTEMS CONFERENCE, DASC, 2023,
  • [44] Intent Classification and Slot Filling for Privacy Policies
    Ahmad, Wasi Uddin
    Chi, Jianfeng
    Le, Tu
    Norton, Thomas
    Tian, Yuan
    Chang, Kai-Wei
    59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (ACL-IJCNLP 2021), VOL 1, 2021, : 4402 - 4417
  • [45] Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Filling
    Liu, Bing
    Lane, Ian
    17TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2016), VOLS 1-5: UNDERSTANDING SPEECH PROCESSING IN HUMANS AND MACHINES, 2016, : 685 - 689
  • [46] AGIF: An Adaptive Graph-Interactive Framework for Joint Multiple Intent Detection and Slot Filling
    Qin, Libo
    Xu, Xiao
    Che, Wanxiang
    Liu, Ting
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2020, 2020, : 1807 - 1816
  • [47] Focus on Interaction: A Novel Dynamic Graph Model for Joint Multiple Intent Detection and Slot Filling
    Ding, Zeyuan
    Yang, Zhihao
    Lin, Hongfei
    Wang, Jian
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 3801 - 3807
  • [48] Towards Explainable Joint Models via Information Theory for Multiple Intent Detection and Slot Filling
    Zhuang, Xianwei
    Cheng, Xuxin
    Zou, Yuexian
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 17, 2024, : 19786 - 19794
  • [49] Encoding Syntactic Knowledge in Transformer Encoder for Intent Detection and Slot Filling
    Wang, Jixuan
    Wei, Kai
    Radfar, Martin
    Zhang, Weiwei
    Chung, Clement
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 13943 - 13951
  • [50] Multitask learning for multilingual intent detection and slot filling in dialogue systems
    Firdaus, Mauajama
    Ekbal, Asif
    Cambria, Erik
    INFORMATION FUSION, 2023, 91 : 299 - 315