Enhanced Speaker-Aware Multi-Party Multi-Turn Dialogue Comprehension

被引:3
|
作者
Ma, Xinbei [1 ,2 ]
Zhang, Zhuosheng [1 ,2 ]
Zhao, Hai [1 ,2 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Key Lab Shanghai Educ Commiss Intelligent Interact, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Natural language processing; machine reading comprehension; multi-turn multi-party dialogue; questiong answering; discourse analysis; graph network;
D O I
10.1109/TASLP.2023.3284516
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Multi-party multi-turn dialogue comprehension brings unprecedented challenges in handling complicated scenarios, as the co-occurrence of multiple speakers causes complexity and inconsistency. As a result of the multiple participation, the shift of speaker roles and crisscrossed discourse relations among utterances hinder reading comprehension. Motivated by this, we further integrate the enhancements of speaker-related features for dialogue comprehension performance. This work proposes a novel model with enhancement from both sides of speaker roles and speaker-aware relations. At the token level, we apply a speaker mask for attention, while at the discourse level, we utilize heterogeneous graph networks for comprehensive speaker-aware discourse clues. Experimental results show that our Enhanced Speaker-Aware method (ESA) helps achieve state-of-the-art performance on the Molweni dataset, as well as significant improvements on the FriendsQA dataset. We find that our method makes steady improvements on stronger backbones. Analysis shows that our model enhances the connections between utterances and their own speakers and captures the speaker-aware discourse relations. Discussions on data features and error cases are presented, and a visualized case is displayed. The findings reveal the importance of speaker-aware signals in dialogue comprehension.
引用
收藏
页码:2410 / 2423
页数:14
相关论文
共 50 条
  • [1] Filling the Gap of Utterance-aware and Speaker-aware Representation for Multi-turn Dialogue
    Liu, Longxiang
    Zhang, Zhuosheng
    Zhao, Hai
    Zhou, Xi
    Zhou, Xiang
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 13406 - 13414
  • [2] PHAED: A Speaker-Aware Parallel Hierarchical Attentive Encoder-Decoder Model for Multi-Turn Dialogue Generation
    Wang, Zihao
    Jiang, Ming
    Wang, Junli
    [J]. IEEE TRANSACTIONS ON BIG DATA, 2024, 10 (01) : 23 - 34
  • [3] Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots
    Gu, Jia-Chen
    Li, Tianda
    Liu, Quan
    Ling, Zhen-Hua
    Su, Zhiming
    Wei, Si
    Zhu, Xiaodan
    [J]. CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 2041 - 2044
  • [4] Multi-turn dialogue comprehension from a topic-aware perspective
    Ma, Xinbei
    Xu, Yi
    Zhao, Hai
    Zhang, Zhuosheng
    [J]. NEUROCOMPUTING, 2024, 578
  • [5] Dialogue Logic Aware and Key Utterance Decoupling Model for Multi-Party Dialogue Reading Comprehension
    Yang, Tianqing
    Wu, Tao
    Gao, Song
    Yang, Jingzong
    [J]. IEEE ACCESS, 2023, 11 : 10985 - 10994
  • [6] Topic-Aware Multi-turn Dialogue Modeling
    Xu, Yi
    Zhao, Hai
    Zhang, Zhuosheng
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 14176 - 14184
  • [7] MULTI-TURN RNN-T FOR STREAMING RECOGNITION OF MULTI-PARTY SPEECH
    Sklyar, Ilya
    Piunova, Anna
    Zheng, Xianrui
    Liu, Yulan
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 8402 - 8406
  • [8] Multi-Turn Dialogue Reading Comprehension With Pivot Turns and Knowledge
    Zhang, Zhuosheng
    Li, Junlong
    Zhao, Hai
    [J]. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2021, 29 : 1161 - 1173
  • [9] ROLE AWARE MULTI-PARTY DIALOGUE QUESTION ANSWERING
    Hsu, Jui-Heng
    Shen, Po-Wei
    Su, Hung-Ting
    Chang, Chen-Hsi
    Yeh, Jia-Fong
    Hsu, Winston H.
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 7813 - 7817
  • [10] Coreference-aware Double-channel Attention Network for Multi-party Dialogue Reading Comprehension
    Li, Yanling
    Zou, Bowei
    Fan, Yifan
    Dong, Mengxing
    Hong, Yu
    [J]. 2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,