PAPER Special Technology Support Hyperconnectivity Conceptual Knowledge Enhanced Model for Multi-Intent Detection and Slot Filling

被引:0
|
作者
He, Li [1 ,2 ]
Zhao, Jingxuan [1 ,2 ]
Duan, Jianyong [1 ,2 ]
Wang, Hao [1 ,2 ,3 ]
Li, Xin [1 ,2 ]
机构
[1] North China Univ Technol, Coll Informat, Beijing, Peoples R China
[2] CNONIX Natl Stand Applicat & Promot Lab, Beijing 100144, Peoples R China
[3] Beijing Urban Governance Res Ctr, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
knowledge enhancement; multi-intent detection; semantic slot filling; joint model;
D O I
10.1587/transinf.2023IHP0004
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In Natural Language Understanding, intent detection and slot filling have been widely used to understand user queries. However, current methods tend to rely on single words and sentences to understand complex semantic concepts, and can only consider local information within the sentence. Therefore, they usually cannot capture long-distance dependencies well and are prone to problems where complex intentions in sentences are difficult to recognize. In order to solve the problem of longdistance dependency of the model, this paper uses ConceptNet as an external knowledge source and introduces its extensive semantic information into the multi -intent detection and slot filling model. Specifically, for a certain sentence, based on confidence scores and semantic relationships, the most relevant conceptual knowledge is selected to equip the sentence, and a concept context map with rich information is constructed. Then, the multi -head graph attention mechanism is used to strengthen context correlation and improve the semantic understanding ability of the model. The experimental results indicate that the model has significantly improved performance compared to other models on the MixATIS and MixSNIPS multi -intent datasets.
引用
收藏
页码:468 / 476
页数:9
相关论文
共 10 条
  • [1] SLIM: EXPLICIT SLOT-INTENT MAPPING WITH BERT FOR JOINT MULTI-INTENT DETECTION AND SLOT FILLING
    Cai, Fengyu
    Zhou, Wanhao
    Mi, Fei
    Faltings, Boi
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 7607 - 7611
  • [2] Promoting Unified Generative Framework with Descriptive Prompts for Joint Multi-Intent Detection and Slot Filling
    Ma, Zhiyuan
    Qin, Jiwei
    Pan, Meiqi
    Tang, Song
    Mi, Jinpeng
    Liu, Dan
    ELECTRONICS, 2024, 13 (06)
  • [3] Co-RGCN: A Bi-path GCN-Based Co-Regression Model for Multi-intent Detection and Slot Filling
    Wen, Qingpeng
    Zeng, Bi
    Wei, Pengfei
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT IV, 2023, 14257 : 316 - 327
  • [4] Joint Training Model of Intent Detection and Slot Filling for Multi Granularity Implicit Guidance
    Li, Bin
    Wang, Weihua
    Bao, Feilong
    2022 INTERNATIONAL CONFERENCE ON ASIAN LANGUAGE PROCESSING (IALP 2022), 2022, : 271 - 274
  • [5] Research on Co-Interactive Model Based on Knowledge Graph for Intent Detection and Slot Filling
    Zhang, Wenwen
    Gao, Yanfang
    Xu, Zifan
    Wang, Lin
    Ji, Shengxu
    Zhang, Xiaohui
    Yuan, Guanyu
    APPLIED SCIENCES-BASEL, 2025, 15 (02):
  • [6] A Deep Multi-task Model for Dialogue Act Classification, Intent Detection and Slot Filling
    Mauajama Firdaus
    Hitesh Golchha
    Asif Ekbal
    Pushpak Bhattacharyya
    Cognitive Computation, 2021, 13 : 626 - 645
  • [7] A Deep Multi-task Model for Dialogue Act Classification, Intent Detection and Slot Filling
    Firdaus, Mauajama
    Golchha, Hitesh
    Ekbal, Asif
    Bhattacharyya, Pushpak
    COGNITIVE COMPUTATION, 2021, 13 (03) : 626 - 645
  • [8] A Transformer based Multi-task Model for Domain Classification, Intent Detection and Slot-Filling
    Saha, Tulika
    Priya, Neeti
    Saha, Sriparna
    Bhattacharyya, Pushpak
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [9] Joint model of intent detection and slot filling of knowledge question for crop diseases and pests using CNN-Transformer
    Wang, Lu
    Liu, Ruilin
    Huang, Jingzhong
    Guo, Xuchao
    Nongye Gongcheng Xuebao/Transactions of the Chinese Society of Agricultural Engineering, 2024, 40 (13): : 156 - 162
  • [10] A Deep Learning Based Multi-task Ensemble Model for Intent Detection and Slot Filling in Spoken Language Understanding
    Firdaus, Mauajama
    Bhatnagar, Shobhit
    Ekbal, Asif
    Bhattacharyya, Pushpak
    NEURAL INFORMATION PROCESSING (ICONIP 2018), PT IV, 2018, 11304 : 647 - 658