Improving Sequential Recommendation Consistency with Self-Supervised Imitation

被引:0
|
作者
Yuan, Xu [1 ,2 ,3 ]
Chen, Hongshen [3 ]
Song, Yonghao [1 ]
Zhao, Xiaofang [1 ]
Ding, Zhuoye [3 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Beijing, Peoples R China
[3] JD Com, Beijing, Peoples R China
基金
国家重点研发计划;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most sequential recommendation models capture the features of consecutive items in a user-item interaction history. Though e ffective, their representation expressiveness is still hindered by the sparse learning signals. As a result, the sequential recommender is prone to make inconsistent predictions. In this paper, we propose a model, SSI, to improve sequential recommendation consistency with Self-Supervised Imitation. Precisely, we extract the consistency knowledge by utilizing three self-supervised pre-training tasks, where temporal consistency and persona consistency capture user-interaction dynamics in terms of the chronological order and persona sensitivities, respectively. Furthermore, to provide the model with a global perspective, global session consistency is introduced by maximizing the mutual information among global and local interaction sequences. Finally, to comprehensively take advantage of all three independent aspects of consistency-enhanced knowledge, we establish an integrated imitation learning framework. The consistency knowledge is e ffectively internalized and transferred to the student model by imitating the conventional prediction logit as well as the consistency-enhanced item representations. In addition, the flexible self-supervised imitation framework can also benefit other student recommenders. Experiments on four real-world datasets show that SSI effectively outperforms the state-of-the-art sequential recommendation methods.
引用
收藏
页码:3321 / 3327
页数:7
相关论文
共 50 条
  • [41] Self-supervised Visual-LiDAR Odometry with Flip Consistency
    Li, Bin
    Hu, Mu
    Wang, Shuling
    Wang, Lianghao
    Gong, Xiaojin
    [J]. 2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, : 3843 - 3851
  • [42] A self-supervised learning of semantic feature consistency for image clustering
    Chen, Junfen
    Han, Jie
    Xie, Bojun
    Li, Nana
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 45 (05) : 8651 - 8661
  • [43] Knowledge-Aware Graph Self-Supervised Learning for Recommendation
    Li, Shanshan
    Jia, Yutong
    Wu, You
    Wei, Ning
    Zhang, Liyan
    Guo, Jingfeng
    [J]. ELECTRONICS, 2023, 12 (23)
  • [44] Self-Supervised Signed Graph Attention Network for Social Recommendation
    Zhao, Qin
    Liu, Gang
    Yang, Fuli
    Yang, Ru
    Kou, Zuliang
    Wang, Dong
    [J]. 2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [45] Self-Supervised Image Representation Learning with Geometric Set Consistency
    Chen, Nenglun
    Chu, Lei
    Pan, Hao
    Lu, Yan
    Wang, Wenping
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 19270 - 19280
  • [46] A Recommendation Algorithm Based on a Self-supervised Learning Pretrain Transformer
    Yu-Hao Xu
    Zhen-Hai Wang
    Zhi-Ru Wang
    Rong Fan
    Xing Wang
    [J]. Neural Processing Letters, 2023, 55 : 4481 - 4497
  • [47] Self-supervised scientific document recommendation based on contrastive learning
    Tan, Shicheng
    Zhang, Tao
    Zhao, Shu
    Zhang, Yanping
    [J]. SCIENTOMETRICS, 2023, 128 (09) : 5027 - 5049
  • [48] A Recommendation Algorithm Based on a Self-supervised Learning Pretrain Transformer
    Xu, Yu-Hao
    Wang, Zhen-Hai
    Wang, Zhi-Ru
    Fan, Rong
    Wang, Xing
    [J]. NEURAL PROCESSING LETTERS, 2023, 55 (04) : 4481 - 4497
  • [49] Self-supervised scientific document recommendation based on contrastive learning
    Shicheng Tan
    Tao Zhang
    Shu Zhao
    Yanping Zhang
    [J]. Scientometrics, 2023, 128 : 5027 - 5049
  • [50] Self-supervised learning of hologram reconstruction using physics consistency
    Luzhe Huang
    Hanlong Chen
    Tairan Liu
    Aydogan Ozcan
    [J]. Nature Machine Intelligence, 2023, 5 : 895 - 907