Self-Supervised learning for Conversational Recommendation

被引:11
|
作者
Li, Shuokai [1 ,2 ]
Xie, Ruobing [3 ]
Zhu, Yongchun [1 ,2 ]
Zhuang, Fuzhen [4 ,5 ]
Tang, Zhenwei [6 ]
Zhao, Wayne Xin [7 ,8 ]
He, Qing [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Tencent, WeChat Search Applicat Dept, Shenzhen, Peoples R China
[4] Beihang Univ, Inst Artificial Intelligence, Beijing 100191, Peoples R China
[5] Beihang Univ, Sch Comp Sci, SKLSDE, Beijing 100191, Peoples R China
[6] Univ Toronto, Toronto, ON, Canada
[7] Renmin Univ, Gaoling Sch Artificial Intelligence, Beijing, Peoples R China
[8] Beijing Acad Artificial Intelligence, Beijing Key Lab Big Data Management & Anal Methods, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Conversational recommender system; Self-supervised learning; Knowledge;
D O I
10.1016/j.ipm.2022.103067
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Conversational recommender system (CRS) aims to model user preference through interactive conversations. Although there are some works, they still have two drawbacks: (1) they rely on large amounts of training data and suffer from data sparsity problem; and (2) they do not fully leverage different types of knowledge extracted from dialogues. To address these issues in CRS, we explore the intrinsic correlations of different types of knowledge by self-supervised learning, and propose the model SSCR, which stands for Self-Supervised learning for Conversational Recommendation. The main idea is to jointly consider both the semantic and structural knowledge via three self-supervision signals in both recommendation and dialogue modules. First, we carefully design two auxiliary self-supervised objectives: token-level task and sentence-level task, to explore the semantic knowledge. Then, we extract the structural knowledge based on external knowledge graphs from user mentioned entities. Finally, we model the inter-information between the semantic and structural knowledge with the advantages of contrastive learning. As existing similarity functions fail to achieve this goal, we propose a novel similarity function based on negative log-likelihood loss. Comprehensive experimental results on two real-world CRS datasets (including both English and Chinese with about 10,000 dialogues) show the superiority of our proposed method. Concretely, in recommendation, SSCR gets an improvement about 5% similar to 15% compared with state-of-the-art baselines on hit rate, mean reciprocal rank and normalized discounted cumulative gain. In dialogue generation, SSCR outperforms baselines on both automatic evaluations (distinct n-gram, BLEU and perplexity) and human evaluations (fluency and informativeness).
引用
收藏
页数:19
相关论文
共 50 条
  • [41] Self-supervised learning model
    Saga, Kazushie
    Sugasaka, Tamami
    Sekiguchi, Minoru
    [J]. Fujitsu Scientific and Technical Journal, 1993, 29 (03): : 209 - 216
  • [42] Self-Supervised Learning for Electroencephalography
    Rafiei, Mohammad H.
    Gauthier, Lynne V.
    Adeli, Hojjat
    Takabi, Daniel
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (02) : 1457 - 1471
  • [43] Credal Self-Supervised Learning
    Lienen, Julian
    Huellermeier, Eyke
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [44] Quantum self-supervised learning
    Jaderberg, B.
    Anderson, L. W.
    Xie, W.
    Albanie, S.
    Kiffner, M.
    Jaksch, D.
    [J]. QUANTUM SCIENCE AND TECHNOLOGY, 2022, 7 (03):
  • [45] A New Self-supervised Method for Supervised Learning
    Yang, Yuhang
    Ding, Zilin
    Cheng, Xuan
    Wang, Xiaomin
    Liu, Ming
    [J]. INTERNATIONAL CONFERENCE ON COMPUTER VISION, APPLICATION, AND DESIGN (CVAD 2021), 2021, 12155
  • [46] Improving Sequential Recommendation Consistency with Self-Supervised Imitation
    Yuan, Xu
    Chen, Hongshen
    Song, Yonghao
    Zhao, Xiaofang
    Ding, Zhuoye
    [J]. PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 3321 - 3327
  • [47] Popularity-Debiased Graph Self-Supervised for Recommendation
    Li, Shanshan
    Hu, Xinzhuan
    Guo, Jingfeng
    Liu, Bin
    Qi, Mingyue
    Jia, Yutong
    [J]. ELECTRONICS, 2024, 13 (04)
  • [48] Self-supervised Hypergraph Transformer with Alignment and Uniformity for Recommendation
    Yang, XianFeng
    Liu, Yang
    [J]. IAENG International Journal of Computer Science, 2024, 51 (03) : 292 - 300
  • [49] Social Recommendation with Self-Supervised Metagraph Informax Network
    Long, Xiaoling
    Huang, Chao
    Xu, Yong
    Xu, Huance
    Dai, Peng
    Xia, Lianghao
    Bo, Liefeng
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 1160 - 1169
  • [50] Self-Supervised Adversarial Distribution Regularization for Medication Recommendation
    Wang, Yanda
    Chen, Weitong
    Pi, Dechang
    Yue, Lin
    Wang, Sen
    Xu, Miao
    [J]. PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 3134 - 3140