Attention Based Dialogue Context Selection Model

被引:0
|
作者
Xu, Weidi [1 ,2 ]
Ren, Yong [3 ]
Tan, Ying [1 ,2 ]
机构
[1] Peking Univ, Key Lab Machine Percept, Minist Educ, Beijing 100871, Peoples R China
[2] Peking Univ, Dept Machine Intelligence, Sch Elect Engn & Comp Sci, Beijing 100871, Peoples R China
[3] Tsinghua Univ, Dept Elect Engn, Complex Engn Syst Lab CESL, Beijing 100084, Peoples R China
基金
北京市自然科学基金;
关键词
D O I
10.1007/978-3-030-04179-3_25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The particular phenomena of Information Overload and Conversational Dependency in multi-turn dialogues have brought massive noise for feature learning in existing deep learning models. To solve the problem, the Attention Based Dialogue Context Selection Model (ABDCS) is proposed in this paper. This model uses attention mechanism to extract the relationship between current response utterance and previous utterances. Qualitative and quantitative analysis show that ABDCS is able to choose the semantically related utterances in its dialogue history as context and be robust against the noise.
引用
收藏
页码:286 / 295
页数:10
相关论文
共 50 条
  • [1] Dialogue emotion model based on local-global context encoder and commonsense knowledge fusion attention
    Yu, Weilun
    Li, Chengming
    Hu, Xiping
    Zhu, Wenhua
    Cambria, Erik
    Jiang, Dazhi
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (07) : 2811 - 2825
  • [2] A context-based model of attention
    Bergboer, N
    Postma, E
    van den Herik, J
    ECAI 2004: 16TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2004, 110 : 927 - 931
  • [3] BERT-based response selection in dialogue systems using utterance attention mechanisms
    Park, Yeongjoon
    Ko, Youngjoong
    Seo, Jungyun
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 209
  • [4] Future Context Attention for Unidirectional LSTM Based Acoustic Model
    Tang, Jian
    Zhang, Shiliang
    Wei, Si
    Dai, Li-Rong
    17TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2016), VOLS 1-5: UNDERSTANDING SPEECH PROCESSING IN HUMANS AND MACHINES, 2016, : 3394 - 3398
  • [5] Service selection model based on user intention and context
    Jaafar, Ako A.
    Jawawi, Dayang N. A.
    Isa, Mohd Adham
    Saadon, Nor Azizah
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2023, 35 (04) : 209 - 223
  • [6] DEM Void Filling Based on Context Attention Generation Model
    Zhang, Chunsen
    Shi, Shu
    Ge, Yingwei
    Liu, Hengheng
    Cui, Weihong
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2020, 9 (12)
  • [7] Dialogue Generation Model with Hierarchical Encoding and Semantic Segmentation of Dialogue Context
    Wei, Xiao
    Lin, Yidian
    Hu, Qitao
    INTERNATIONAL JOURNAL OF SOFTWARE ENGINEERING AND KNOWLEDGE ENGINEERING, 2024, 34 (03) : 427 - 447
  • [8] Dialogue Act Classification with Context-Aware Self-Attention
    Raheja, Vipul
    Tetreault, Joel
    2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, 2019, : 3727 - 3733
  • [9] Multi-turn dialogue model based on the improved hierarchical recurrent attention network
    Miao J.
    Wu J.
    International Journal for Engineering Modelling, 2021, 34 (02) : 17 - 29
  • [10] RAP -Net: Recurrent Attention Pooling Networks for Dialogue Response Selection
    Huang, Chao-Wei
    Chiang, Ting-Rui
    Su, Shang-Yu
    Chen, Yun-Nung
    COMPUTER SPEECH AND LANGUAGE, 2020, 63