Enhanced Speaker-Aware Multi-Party Multi-Turn Dialogue Comprehension

被引:3
|
作者
Ma, Xinbei [1 ,2 ]
Zhang, Zhuosheng [1 ,2 ]
Zhao, Hai [1 ,2 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Key Lab Shanghai Educ Commiss Intelligent Interact, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Natural language processing; machine reading comprehension; multi-turn multi-party dialogue; questiong answering; discourse analysis; graph network;
D O I
10.1109/TASLP.2023.3284516
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Multi-party multi-turn dialogue comprehension brings unprecedented challenges in handling complicated scenarios, as the co-occurrence of multiple speakers causes complexity and inconsistency. As a result of the multiple participation, the shift of speaker roles and crisscrossed discourse relations among utterances hinder reading comprehension. Motivated by this, we further integrate the enhancements of speaker-related features for dialogue comprehension performance. This work proposes a novel model with enhancement from both sides of speaker roles and speaker-aware relations. At the token level, we apply a speaker mask for attention, while at the discourse level, we utilize heterogeneous graph networks for comprehensive speaker-aware discourse clues. Experimental results show that our Enhanced Speaker-Aware method (ESA) helps achieve state-of-the-art performance on the Molweni dataset, as well as significant improvements on the FriendsQA dataset. We find that our method makes steady improvements on stronger backbones. Analysis shows that our model enhances the connections between utterances and their own speakers and captures the speaker-aware discourse relations. Discussions on data features and error cases are presented, and a visualized case is displayed. The findings reveal the importance of speaker-aware signals in dialogue comprehension.
引用
收藏
页码:2410 / 2423
页数:14
相关论文
共 50 条
  • [21] Multi-Level Curriculum Learning for Multi-Turn Dialogue Generation
    Chen, Guanhua
    Zhan, Runzhe
    Wong, Derek F.
    Chao, Lidia S.
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2023, 31 : 3958 - 3967
  • [22] Improving Multi-turn Dialogue Modelling with Utterance ReWriter
    Su, Hui
    Shen, Xiaoyu
    Zhang, Rongzhi
    Sun, Fei
    Hu, Pengwei
    Niu, Cheng
    Zhou, Jie
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 22 - 31
  • [23] Multi-Turn Dialogue Agent as Sales' Assistant in Telemarketing
    Gao, Wanting
    Gao, Xinyi
    Tang, Yin
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [24] Modeling Topical Relevance for Multi-Turn Dialogue Generation
    Zhang, Hainan
    Lan, Yanyan
    Pang, Liang
    Chen, Hongshen
    Ding, Zhuoye
    Yin, Dawei
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 3737 - 3743
  • [25] EmoEM: Emotional Expression in a Multi-turn Dialogue Model
    Zhang, Ao
    Wu, Shaojuan
    Zhang, Xiaowang
    Chen, Shizhan
    Shu, Yuchun
    Feng, Zhiyong
    2020 IEEE 32ND INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI), 2020, : 496 - 501
  • [26] Multi-party Dialogue Games for Dialectical Argumentation
    Yuan, Jinping
    Yao, Li
    Hao, Zhiyong
    Wang, Yanjuan
    JOURNAL OF COMPUTERS, 2012, 7 (10) : 2564 - 2571
  • [27] Speaker-Aware Multi-Task Learning for Automatic Speech Recognition
    Pironkov, Gueorgui
    Dupont, Stephane
    Dutoit, Thierry
    2016 23RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2016, : 2900 - 2905
  • [28] Multi-turn Response Selection using Dialogue Dependency Relations
    Jia, Qi
    Liu, Yizhu
    Rena, Siyu
    Zhu, Kenny Q.
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 1911 - 1920
  • [29] HRG: A Hybrid Retrieval and Generation Model in Multi-turn Dialogue
    Zhao, Deji
    Liu, Xinyi
    Ning, Bo
    Liu, Chengfei
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2022, PT III, 2022, : 181 - 196
  • [30] Memory Graph with Message Rehearsal for Multi-Turn Dialogue Generation
    Cai, Xiaoyu
    Fu, Yao
    Zhao, Hong
    Jiang, Weihao
    Pu, Shiliang
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 108 - 117