Learnable Model Augmentation Contrastive Learning for Sequential Recommendation

被引:0
|
作者
Hao, Yongjing [1 ]
Zhao, Pengpeng [1 ]
Xian, Xuefeng [2 ]
Liu, Guanfeng [3 ]
Zhao, Lei [1 ]
Liu, Yanchi [4 ]
Sheng, Victor S. [5 ]
Zhou, Xiaofang [6 ]
机构
[1] Soochow Univ, Sch Comp Sci & Technol, Suzhou 215006, Peoples R China
[2] Soochow Vocat Univ, Suzhou 215123, Peoples R China
[3] Macquarie Univ, Sydney, NSW 2109, Australia
[4] Rutgers State Univ, New Brunswick, NJ 08901 USA
[5] Texas Tech Univ, Dept Comp Sci, Lubbock, TX 79409 USA
[6] Hong Kong Univ Sci & Technol, Hong Kong 999077, Peoples R China
关键词
Task analysis; Electronic mail; Data augmentation; Semantics; Markov processes; Data models; Neurons; Contrastive learning; learnable dropout; model augmentation; multi-positive pairs; sequential recommendation;
D O I
10.1109/TKDE.2023.3330426
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sequential Recommendation (SR) methods play a crucial role in recommender systems, which aims to capture users' dynamic interest from their historical interactions. Recently, Contrastive Learning (CL), which has emerged as a successful method for sequential recommendation, utilizes various data augmentations to generate contrastive views to mine supervised signals from data to alleviate data sparsity issues. However, most existing sequential data augmentation methods may destroy semantic sequential interaction characteristics. Meanwhile, they often adopt random operations when generating contrastive views leading to suboptimal performance. To this end, in this paper, we propose a Learnable Model Augmentation Contrastive learning for sequential Recommendation (LMA4Rec). Specifically, LMA4Rec first takes the model-based augmentation method to generate constructive views. Then, LMA4Rec uses Learnable Bernoulli Dropout (LBD) to implement learnable model augmentation operations. Next, contrastive learning is used between the contrastive views to extract supervised signals. Furthermore, a novel multi-positive contrastive learning loss alleviates the supervised sparsity issue. Finally, experiments on public datasets show that our LMA4Rec method effectively improved sequential recommendation performance compared with the state-of-the-art baseline methods.
引用
收藏
页码:3963 / 3976
页数:14
相关论文
共 50 条
  • [1] Sequential recommendation based on multipair contrastive learning with informative augmentation
    Yin, Pei
    Zhao, Jun
    Ma, Zi-jie
    Tan, Xiao
    NEURAL COMPUTING & APPLICATIONS, 2023, 36 (17): : 9707 - 9721
  • [2] Neighbor Contrastive Learning on Learnable Graph Augmentation
    Shen, Xiao
    Sun, Dewang
    Pan, Shirui
    Zhou, Xi
    Yang, Laurence T.
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 8, 2023, : 9782 - 9791
  • [3] Contrastive Learning for Sequential Recommendation
    Xie, Xu
    Sun, Fei
    Liu, Zhaoyang
    Wu, Shiwen
    Gao, Jinyang
    Zhang, Jiandong
    Ding, Bolin
    Cui, Bin
    2022 IEEE 38TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2022), 2022, : 1259 - 1273
  • [4] LMACL: Improving Graph Collaborative Filtering with Learnable Model Augmentation Contrastive Learning
    Liu, Xinru
    Hao, Yongjing
    Zhao, Lei
    Liu, Guanfeng
    Sheng, Victor S.
    Zhao, Pengpeng
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2024, 18 (07)
  • [5] Equivariant Contrastive Learning for Sequential Recommendation
    Zhou, Peilin
    Gao, Jingqi
    Xie, Yueqi
    Ye, Qichen
    Hua, Yining
    Kim, Jaeboum
    Wang, Shoujin
    Kim, Sunghun
    PROCEEDINGS OF THE 17TH ACM CONFERENCE ON RECOMMENDER SYSTEMS, RECSYS 2023, 2023, : 129 - 140
  • [6] Intent Contrastive Learning for Sequential Recommendation
    Chen, Yongjun
    Liu, Zhiwei
    Li, Jia
    McAuley, Julian
    Xiong, Caiming
    PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, : 2172 - 2182
  • [7] Graph Contrastive Learning with Adaptive Augmentation for Recommendation
    Jing, Mengyuan
    Zhu, Yanmin
    Zang, Tianzi
    Yu, Jiadi
    Tang, Feilong
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT I, 2023, 13713 : 590 - 605
  • [8] Temporal Graph Contrastive Learning for Sequential Recommendation
    Zhang, Shengzhe
    Chen, Liyi
    Wang, Chao
    Li, Shuangli
    Xiong, Hui
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 8, 2024, : 9359 - 9367
  • [9] Contrastive Learning with Bidirectional Transformers for Sequential Recommendation
    Du, Hanwen
    Shi, Hui
    Zhao, Pengpeng
    Wang, Deqing
    Sheng, Victor S.
    Liu, Yanchi
    Liu, Guanfeng
    Zhao, Lei
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 396 - 405
  • [10] Simple Debiased Contrastive Learning for Sequential Recommendation
    Xie, Zuxiang
    Li, Junyi
    KNOWLEDGE-BASED SYSTEMS, 2024, 300