SLIM: EXPLICIT SLOT-INTENT MAPPING WITH BERT FOR JOINT MULTI-INTENT DETECTION AND SLOT FILLING

被引:11
|
作者
Cai, Fengyu [1 ]
Zhou, Wanhao [1 ]
Mi, Fei [2 ]
Faltings, Boi [1 ]
机构
[1] Ecole Polytech Fed Lausanne EPFL, Lausanne, Switzerland
[2] Huawei Noahs Ark Lab, Shenzhen, Peoples R China
关键词
Spoken Language Understanding; Multi-intent Classification; Slot Filling;
D O I
10.1109/ICASSP43922.2022.9747477
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Utterance-level intent detection and token-level slot filling are two key tasks for spoken language understanding (SLU) in task-oriented systems. Most existing approaches assume that only a single intent exists in an utterance. However, there are often multiple intents within an utterance in real-life scenarios. In this paper, we propose a multi-intent SLU framework, called SLIM, to jointly learn multi-intent detection and slot filling based on BERT. To fully exploit the existing annotation data and capture the interactions between slots and intents, SLIM introduces an explicit slot-intent classifier to learn the many-to-one mapping between slots and intents. Empirical results on three public multi-intent datasets demonstrate (1) the superior performance of SLIM compared to the current state-of-the-art for SLU with multiple intents and (2) the benefits obtained from the slot-intent classifier.
引用
收藏
页码:7607 / 7611
页数:5
相关论文
共 50 条
  • [31] The Impact of Romanian Diacritics on Intent Detection and Slot Filling
    Stoica, Anda Diana
    Rad, Andrei-Cristian
    Muntean, Joan Horia
    Daian, George
    Lemnaru, Camelia
    Potolea, Rodica
    Dinsoreanu, Mihaela
    PROCEEDINGS OF 2020 IEEE INTERNATIONAL CONFERENCE ON AUTOMATION, QUALITY AND TESTING, ROBOTICS (AQTR), 2020, : 467 - 472
  • [32] A Survey of Joint Intent Detection and Slot Filling Models in Natural Language Understanding
    Weld, Henry
    Huang, Xiaoqi
    Long, Siqu
    Poon, Josiah
    Han, Soyeon Caren
    ACM COMPUTING SURVEYS, 2023, 55 (08)
  • [33] A Neural Framework for Joint Prediction on Intent Identification and Slot Filling
    Shan, Jiawei
    Xu, Huayun
    Gong, Zeyang
    Su, Hanchen
    Han, Xu
    Li, Binyang
    COGNITIVE COMPUTING - ICCC 2019, 2019, 11518 : 12 - 25
  • [34] Transformers for Multi-Intent Classification and Slot Filling of Supreme Court Decisions Related to Sexual Violence Law
    Munthuli, Adirek
    Socatiyanurak, Vorada
    Sangchocanonta, Sirikorn
    Kovudhikulrungsri, Lalin
    Saksakulkunakorn, Nantawat
    Chairuangsri, Phornkanok
    Tantibundhit, Charturong
    IEEE ACCESS, 2023, 11 : 76448 - 76467
  • [35] A Two-Stage Selective Fusion Framework for Joint Intent Detection and Slot Filling
    Ma, Ziyu
    Sun, Bin
    Li, Shutao
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (03) : 3874 - 3885
  • [36] SlotRefine: A Fast Non-Autoregressive Model for Joint Intent Detection and Slot Filling
    Wu, Di
    Ding, Liang
    Lu, Fan
    Xie, Jian
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 1932 - 1937
  • [37] A Novel Bi-directional Interrelated Model for Joint Intent Detection and Slot Filling
    E, Haihong
    Niu, Peiqing
    Chen, Zhongfu
    Song, Meina
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 5467 - 5471
  • [38] CONVOLUTIONAL NEURAL NETWORK BASED TRIANGULAR CRF FOR JOINT INTENT DETECTION AND SLOT FILLING
    Xu, Puyang
    Sarikaya, Ruhi
    2013 IEEE WORKSHOP ON AUTOMATIC SPEECH RECOGNITION AND UNDERSTANDING (ASRU), 2013, : 78 - 83
  • [39] Joint agricultural intent detection and slot filling based on enhanced heterogeneous attention mechanism
    Hao, Xia
    Wang, Lu
    Zhu, Hongmei
    Guo, Xuchao
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2023, 207
  • [40] Joint Intent Detection and Slot Filling of Knowledge Question Answering for Agricultural Diseases and Pests
    Guo X.
    Hao X.
    Yao X.
    Li L.
    Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2023, 54 (01): : 205 - 215