Self-Supervised learning for Conversational Recommendation

被引:11
|
作者
Li, Shuokai [1 ,2 ]
Xie, Ruobing [3 ]
Zhu, Yongchun [1 ,2 ]
Zhuang, Fuzhen [4 ,5 ]
Tang, Zhenwei [6 ]
Zhao, Wayne Xin [7 ,8 ]
He, Qing [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Tencent, WeChat Search Applicat Dept, Shenzhen, Peoples R China
[4] Beihang Univ, Inst Artificial Intelligence, Beijing 100191, Peoples R China
[5] Beihang Univ, Sch Comp Sci, SKLSDE, Beijing 100191, Peoples R China
[6] Univ Toronto, Toronto, ON, Canada
[7] Renmin Univ, Gaoling Sch Artificial Intelligence, Beijing, Peoples R China
[8] Beijing Acad Artificial Intelligence, Beijing Key Lab Big Data Management & Anal Methods, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Conversational recommender system; Self-supervised learning; Knowledge;
D O I
10.1016/j.ipm.2022.103067
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Conversational recommender system (CRS) aims to model user preference through interactive conversations. Although there are some works, they still have two drawbacks: (1) they rely on large amounts of training data and suffer from data sparsity problem; and (2) they do not fully leverage different types of knowledge extracted from dialogues. To address these issues in CRS, we explore the intrinsic correlations of different types of knowledge by self-supervised learning, and propose the model SSCR, which stands for Self-Supervised learning for Conversational Recommendation. The main idea is to jointly consider both the semantic and structural knowledge via three self-supervision signals in both recommendation and dialogue modules. First, we carefully design two auxiliary self-supervised objectives: token-level task and sentence-level task, to explore the semantic knowledge. Then, we extract the structural knowledge based on external knowledge graphs from user mentioned entities. Finally, we model the inter-information between the semantic and structural knowledge with the advantages of contrastive learning. As existing similarity functions fail to achieve this goal, we propose a novel similarity function based on negative log-likelihood loss. Comprehensive experimental results on two real-world CRS datasets (including both English and Chinese with about 10,000 dialogues) show the superiority of our proposed method. Concretely, in recommendation, SSCR gets an improvement about 5% similar to 15% compared with state-of-the-art baselines on hit rate, mean reciprocal rank and normalized discounted cumulative gain. In dialogue generation, SSCR outperforms baselines on both automatic evaluations (distinct n-gram, BLEU and perplexity) and human evaluations (fluency and informativeness).
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Self-Supervised Learning for Recommendation
    Huang, Chao
    Xia, Lianghao
    Wang, Xiang
    He, Xiangnan
    Yin, Dawei
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 5136 - 5139
  • [2] Self-Supervised Learning for Multimedia Recommendation
    Tao, Zhulin
    Liu, Xiaohao
    Xia, Yewei
    Wang, Xiang
    Yang, Lifang
    Huang, Xianglin
    Chua, Tat-Seng
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 5107 - 5116
  • [3] Self-supervised Graph Learning for Recommendation
    Wu, Jiancan
    Wang, Xiang
    Feng, Fuli
    He, Xiangnan
    Chen, Liang
    Lian, Jianxun
    Xie, Xing
    [J]. SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2021, : 726 - 735
  • [4] CONVERSATIONAL QUERY REWRITING WITH SELF-SUPERVISED LEARNING
    Liu, Hang
    Chen, Meng
    Wu, Youzheng
    He, Xiaodong
    Zhou, Bowen
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 7628 - 7632
  • [5] A Self-Supervised Learning Framework for Sequential Recommendation
    Jia, Renqi
    Bai, Xu
    Zhou, Xiaofei
    Pan, Shirui
    [J]. 2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [6] Adaptive self-supervised learning for sequential recommendation
    Sun, Xiujuan
    Sun, Fuzhen
    Zhang, Zhiwei
    Li, Pengcheng
    Wang, Shaoqing
    [J]. NEURAL NETWORKS, 2024, 179
  • [7] SSLRec: A Self-Supervised Learning Framework for Recommendation
    Ren, Xubin
    Xia, Lianghao
    Yang, Yuhao
    Wei, Wei
    Wang, Tianle
    Cai, Xuheng
    Huang, Chao
    [J]. PROCEEDINGS OF THE 17TH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, WSDM 2024, 2024, : 567 - 575
  • [8] Self-supervised representation learning for trip recommendation
    Gao, Qiang
    Wang, Wei
    Zhang, Kunpeng
    Yang, Xin
    Miao, Congcong
    Li, Tianrui
    [J]. KNOWLEDGE-BASED SYSTEMS, 2022, 247
  • [9] LARGE-CONTEXT CONVERSATIONAL REPRESENTATION LEARNING: SELF-SUPERVISED LEARNING FOR CONVERSATIONAL DOCUMENTS
    Masumura, Ryo
    Makishima, Naoki
    Ihori, Mana
    Takashima, Akihiko
    Tanaka, Tomohiro
    Orihashi, Shota
    [J]. 2021 IEEE SPOKEN LANGUAGE TECHNOLOGY WORKSHOP (SLT), 2021, : 1012 - 1019
  • [10] Self-Supervised Bot Play for Transcript-Free Conversational Recommendation with Rationales
    Li, Shuyang
    Majumder, Bodhisattwa Prasad
    McAuley, Julian
    [J]. PROCEEDINGS OF THE 16TH ACM CONFERENCE ON RECOMMENDER SYSTEMS, RECSYS 2022, 2022, : 327 - 337