Dialogue History Matters! Personalized Response Selection in Multi-Turn Retrieval-Based Chatbots

被引:10
|
作者
Li, Juntao [1 ,2 ]
Liu, Chang [1 ,2 ]
Tao, Chongyang [3 ]
Chan, Zhangming [3 ]
Zhao, Dongyan [3 ]
Zhang, Min [4 ]
Yan, Rui [5 ]
机构
[1] Peking Univ, Acad Adv Interdisciplinary Studies, Wangxuan Inst Comp Technol, 5 Yibeyuan Rd, Beijing, Peoples R China
[2] Peking Univ, Acad Adv Interdisciplinary Studies, Ctr Data Sci, 5 Yibeyuan Rd, Beijing, Peoples R China
[3] Peking Univ, Wangxuan Inst Comp Technol, 5 Yiheyuan Rd, Beijing, Peoples R China
[4] Soochow Univ, 1 Shizi Rd, Suzhou, Jiangsu, Peoples R China
[5] Renmin Univ China, Gaoling Sch Artificial Intelligence, 59 Zhongguancun Rd, Beijing, Peoples R China
关键词
Open-domain dialogue system; dialogue history modeling; personalized ranking; retrieval-based chatbot; semantic matching; hybrid representation learning;
D O I
10.1145/3453183
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Existing multi-turn context-response matching methods mainly concentrate on obtaining multi-level and multi-dimension representations and better interactions between context utterances and response. However, in real-place conversation scenarios, whether a response candidate is suitable not only counts on the given dialogue context but also other backgrounds, e.g., wording habits, user-specific dialogue history content. To fill the gap between these up-to-date methods and the real-world applications, we incorporate user-specific dialogue history into the response selection and propose a personalized hybrid matching network (PHMN). Our contributions are two-fold: (1) our model extracts personalized wording behaviors from user-specific dialogue history as extra matching information; (2) we perform hybrid representation learning on context-response utterances and explicitly incorporate a customized attention mechanism to extract vital information from context-response interactions so as to improve the accuracy of matching. We evaluate our model on two large datasets with user identification, i.e., personalized Ubuntu dialogue Corpus (P-Ubuntu) and personalized Weibo dataset (P-Weibo). Experimental results confirm that our method significantly outperforms several strong models by combining personalized attention, wording behaviors, and hybrid representation learning.
引用
收藏
页数:25
相关论文
共 50 条
  • [1] Hierarchical matching network for multi-turn response selection in retrieval-based chatbots
    Hui Ma
    Jian Wang
    Hongfei Lin
    Yijia Zhang
    [J]. Soft Computing, 2021, 25 : 9609 - 9624
  • [2] Interactive Matching Network for Multi-Turn Response Selection in Retrieval-Based Chatbots
    Gu, Jia-Chen
    Ling, Zhen-Hua
    Liu, Quan
    [J]. PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT (CIKM '19), 2019, : 2321 - 2324
  • [3] Enhanced Matching Network for Multi-turn Response Selection in Retrieval-Based Chatbots
    Deng, Hui
    Xie, Xiang
    Zhang, XueJun
    [J]. 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [4] Hierarchical matching network for multi-turn response selection in retrieval-based chatbots
    Ma, Hui
    Wang, Jian
    Lin, Hongfei
    Zhang, Yijia
    [J]. SOFT COMPUTING, 2021, 25 (14) : 9609 - 9624
  • [5] A Sequential Matching Framework for Multi-Turn Response Selection in Retrieval-Based Chatbots
    Wu, Yu
    Wu, Wei
    Xing, Chen
    Xu, Can
    Li, Zhoujun
    Zhou, Ming
    [J]. COMPUTATIONAL LINGUISTICS, 2019, 45 (01) : 163 - 197
  • [6] Stacked Multi-head Attention for Multi-turn Response Selection in Retrieval-based Chatbots
    Yu, Chongchong
    Jiang, Weijie
    Zhu, Dongdong
    Li, Ruolan
    [J]. 2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 3918 - 3921
  • [7] Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots
    Gu, Jia-Chen
    Li, Tianda
    Liu, Quan
    Ling, Zhen-Hua
    Su, Zhiming
    Wei, Si
    Zhu, Xiaodan
    [J]. CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 2041 - 2044
  • [8] Multi-hop Selector Network for Multi-turn Response Selection in Retrieval-based Chatbots
    Yuan, Chunyuan
    Lv, Shangwen
    Li, Mingming
    Zhou, Wei
    Zhu, Fuqing
    Han, Jizhong
    Hu, Songlin
    [J]. 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 111 - 120
  • [9] Learning bi-utterance for multi-turn response selection in retrieval-based chatbots
    Wang, Shuliang
    Li, Dapeng
    Geng, Jing
    Yang, Longxing
    Dai, Tianru
    [J]. INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2019, 16 (02):
  • [10] Multi-Representation Fusion Network for Multi-turn Response Selection in Retrieval-based Chatbots
    Tao, Chongyang
    Wu, Wei
    Xu, Can
    Hu, Wenpeng
    Zhao, Dongyan
    Yan, Rui
    [J]. PROCEEDINGS OF THE TWELFTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING (WSDM'19), 2019, : 267 - 275