Sequential recommendation based on multipair contrastive learning with informative augmentation

被引:0
|
作者
Yin, Pei [1 ,2 ]
Zhao, Jun [1 ]
Ma, Zi-jie [1 ]
Tan, Xiao [1 ]
机构
[1] Univ Shanghai Sci & Technol, Business Sch, Shanghai 200093, Peoples R China
[2] Univ Shanghai Sci & Technol, Sch Intelligent Emergency Management, Shanghai 200093, Peoples R China
来源
NEURAL COMPUTING & APPLICATIONS | 2023年 / 36卷 / 17期
关键词
Sequential recommendation; Data sparsity; Self-attention network; Contrastive learning; Representation learning;
D O I
10.1007/s00521-023-09044-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To solve the recommendation accuracy degradation problem encountered in sequential recommendation cases caused by data sparsity-such as short historical user behaviour sequences and limited information-this paper proposes a sequential recommendation model based on multipair contrastive learning with informative augmentation (IA-MPCL). The model aims to better learn user preference representations. Initially, a self-attention network is utilized to maintain the intrinsic relevance of the original sequences and introduce virtual interaction items for short sequences to achieve informative enhancement. Subsequently, multiple positive samples are generated by data augmentation methods to form multiple pairs of positive and negative samples. A multipair contrastive loss is constructed to eliminate the negative impact of fake positive and negative samples on the training process of the self-attention network. Finally, an adaptive loss weighting mechanism is proposed to dynamically regulate the role of the contrastive loss during multitask training. Through comparison experiments involving baseline methods and experiments conducted on datasets with different sparsity levels, the results show that IA-MPCL achieves significant improvements in terms of both recommendation accuracy and data sparsity resistance.
引用
收藏
页码:9707 / 9721
页数:15
相关论文
共 50 条
  • [1] Learnable Model Augmentation Contrastive Learning for Sequential Recommendation
    Hao, Yongjing
    Zhao, Pengpeng
    Xian, Xuefeng
    Liu, Guanfeng
    Zhao, Lei
    Liu, Yanchi
    Sheng, Victor S.
    Zhou, Xiaofang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (08) : 3963 - 3976
  • [2] Contrastive Learning for Sequential Recommendation
    Xie, Xu
    Sun, Fei
    Liu, Zhaoyang
    Wu, Shiwen
    Gao, Jinyang
    Zhang, Jiandong
    Ding, Bolin
    Cui, Bin
    2022 IEEE 38TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2022), 2022, : 1259 - 1273
  • [3] Multi-pair Contrastive Learning Based on Same-Timestamp Data Augmentation for Sequential Recommendation
    Zheng, Shun
    Wang, Shaoqing
    Zhang, Lijie
    Zhang, Yao
    Sun, Fuzhen
    WEB AND BIG DATA, PT III, APWEB-WAIM 2023, 2024, 14333 : 174 - 187
  • [4] Equivariant Contrastive Learning for Sequential Recommendation
    Zhou, Peilin
    Gao, Jingqi
    Xie, Yueqi
    Ye, Qichen
    Hua, Yining
    Kim, Jaeboum
    Wang, Shoujin
    Kim, Sunghun
    PROCEEDINGS OF THE 17TH ACM CONFERENCE ON RECOMMENDER SYSTEMS, RECSYS 2023, 2023, : 129 - 140
  • [5] Intent Contrastive Learning for Sequential Recommendation
    Chen, Yongjun
    Liu, Zhiwei
    Li, Jia
    McAuley, Julian
    Xiong, Caiming
    PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, : 2172 - 2182
  • [6] Graph Contrastive Learning with Adaptive Augmentation for Recommendation
    Jing, Mengyuan
    Zhu, Yanmin
    Zang, Tianzi
    Yu, Jiadi
    Tang, Feilong
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT I, 2023, 13713 : 590 - 605
  • [7] Item attributes fusion based on contrastive learning for sequential recommendation
    Zhang, Donghao
    Qin, Jiwei
    Ma, Jie
    Yang, Zhibin
    Cui, Daishun
    Ji, Peichen
    MULTIMEDIA SYSTEMS, 2024, 30 (05)
  • [8] Generative Adversarial Networks Based on Contrastive Learning for Sequential Recommendation
    Li Jianhong
    Wang Yue
    Yan Taotao
    Sun Chengyuan
    Li Dequan
    WEB AND BIG DATA, PT II, APWEB-WAIM 2023, 2024, 14332 : 439 - 453
  • [9] Temporal Graph Contrastive Learning for Sequential Recommendation
    Zhang, Shengzhe
    Chen, Liyi
    Wang, Chao
    Li, Shuangli
    Xiong, Hui
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 8, 2024, : 9359 - 9367
  • [10] Contrastive Learning with Bidirectional Transformers for Sequential Recommendation
    Du, Hanwen
    Shi, Hui
    Zhao, Pengpeng
    Wang, Deqing
    Sheng, Victor S.
    Liu, Yanchi
    Liu, Guanfeng
    Zhao, Lei
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 396 - 405