Adaptive self-supervised learning for sequential recommendation

被引:0
|
作者
Sun, Xiujuan [1 ]
Sun, Fuzhen [1 ]
Zhang, Zhiwei [1 ]
Li, Pengcheng [1 ]
Wang, Shaoqing [1 ]
机构
[1] Shandong Univ Technol, Sch Comp Sci & Technol, Zibo, Peoples R China
关键词
Sequential recommendation; Self-supervised learning; Adaptive data augmentation; ATTENTION NETWORK;
D O I
10.1016/j.neunet.2024.106570
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sequential recommendation typically utilizes deep neural networks to mine rich information in interaction sequences. However, existing methods often face the issue of insufficient interaction data. To alleviate the sparsity issue, self-supervised learning is introduced into sequential recommendation. Despite its effectiveness, we argue that current self-supervised learning-based (i.e., SSL-based) sequential recommendation models have the following limitations: (1) using only a single self-supervised learning method, either contrastive self- supervised learning or generative self-supervised learning. (2) employing a simple data augmentation strategy in either the graph structure domain or the node feature domain. We believe that they have not fully utilized the capabilities of both self-supervised methods and have not sufficiently explored the advantages of combining graph augmentation schemes. As a result, they often fail to learn better item representations. In light of this, we propose a novel multi-task sequential recommendation framework named Adaptive Self-supervised Learning for sequential Recommendation ( ASLRec ). Specifically, our framework combines contrastive and generative self-supervised learning methods adaptively, simultaneously applying different perturbations at both the graph topology and node feature levels. This approach constructs diverse augmented graph views and employs multiple loss functions (including contrastive loss, generative loss, mask loss, and prediction loss) for joint training. By encompassing the capabilities of various methods, our model learns item representations across different augmented graph views to achieve better performance and effectively mitigate interaction noise and sparsity. In addition, we add a small proportion of random uniform noise to item representations, making the item representations more uniform and mitigating the inherent popularity bias in interaction records. We conduct extensive experiments on three publicly available benchmark datasets to evaluate our model. The results demonstrate that our approach achieves state-of-the-art performance compared to 14 other competitive methods: the hit rate (HR) improved by over 14.39%, and the normalized discounted cumulative gain (NDCG) increased by over 18.67%.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Self-supervised generative learning for sequential data prediction
    Ke Xu
    Guoqiang Zhong
    Zhaoyang Deng
    Kang Zhang
    Kaizhu Huang
    [J]. Applied Intelligence, 2023, 53 : 20675 - 20689
  • [22] Self-supervised graph learning with target-adaptive masking for session-based recommendation
    Wang, Yitong
    Cai, Fei
    Pan, Zhiqiang
    Song, Chengyu
    [J]. FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2023, 24 (01) : 73 - 87
  • [23] A Recommendation Algorithm Based on a Self-supervised Learning Pretrain Transformer
    Yu-Hao Xu
    Zhen-Hai Wang
    Zhi-Ru Wang
    Rong Fan
    Xing Wang
    [J]. Neural Processing Letters, 2023, 55 : 4481 - 4497
  • [24] Hierarchical Self-Supervised Learning for Knowledge-Aware Recommendation
    College of Intelligence Science and Technology, National University of Defense Technology, Changsha
    410073, China
    [J]. Appl. Sci, 2024, 20
  • [25] Knowledge-Aware Graph Self-Supervised Learning for Recommendation
    Li, Shanshan
    Jia, Yutong
    Wu, You
    Wei, Ning
    Zhang, Liyan
    Guo, Jingfeng
    [J]. ELECTRONICS, 2023, 12 (23)
  • [26] Self-supervised scientific document recommendation based on contrastive learning
    Tan, Shicheng
    Zhang, Tao
    Zhao, Shu
    Zhang, Yanping
    [J]. SCIENTOMETRICS, 2023, 128 (09) : 5027 - 5049
  • [27] A Recommendation Algorithm Based on a Self-supervised Learning Pretrain Transformer
    Xu, Yu-Hao
    Wang, Zhen-Hai
    Wang, Zhi-Ru
    Fan, Rong
    Wang, Xing
    [J]. NEURAL PROCESSING LETTERS, 2023, 55 (04) : 4481 - 4497
  • [28] Self-supervised scientific document recommendation based on contrastive learning
    Shicheng Tan
    Tao Zhang
    Shu Zhao
    Yanping Zhang
    [J]. Scientometrics, 2023, 128 : 5027 - 5049
  • [29] Sequential Adversarial Learning for Self-Supervised Deep Visual Odometry
    Li, Shunkai
    Xue, Fei
    Wang, Xin
    Yan, Zike
    Zha, Hongbin
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 2851 - 2860
  • [30] Self-Supervised Hypergraph Learning for Knowledge-Aware Social Recommendation
    Li, Munan
    Li, Jialong
    Yang, Liping
    Ding, Qi
    [J]. ELECTRONICS, 2024, 13 (07)