Sequential Recommendation Model Based on Temporal Convolution Attention Neural Network

被引:0
|
作者
Du Y. [1 ]
Niu J. [1 ]
Wang L. [2 ]
Yan R. [1 ]
机构
[1] Faculty of Information Technology, Beijing University of Technology, Beijing
[2] State Key Laboratory of Computer Architecture, Institute of Computing Technology, Chinese Academy of Sciences, Beijing
关键词
Long and Short Term Interest; Self-Attention Mechanism; Sequential Recommendation; Temporal Convolution Network;
D O I
10.16451/j.cnki.issn1003-6059.202205008
中图分类号
学科分类号
摘要
Sequential recommendation task aims to dynamically model user interests based on user-item interaction records for item recommendation. In sequential recommendation models, user behaviors are usually modeled as interests. The models only consider the order of user behaviors while ignoring the time interval information between users. In this paper, the time interval information of behavior sequences is taken as an important factor for prediction. A temporal convolution attention neural network model(TCAN) is proposed. In the word embedding layer, the sequential position information and time interval information are introduced, and a temporal convolutional network is designed to model the position information to obtain user's long-term preference features. In addition, the two-layer self-attention mechanism is adopted to model the association between items in the user's short-term behavior sequence, and the time interval information is fused to obtain the user's short-term interest. Finally, the global information of the training data is introduced through pre-training to improve the model recommendation performance. Experiments on three datasets show that the proposed model effectively improves recommendation performance. © 2022, Science Press. All right reserved.
引用
收藏
页码:472 / 480
页数:8
相关论文
共 19 条
  • [1] RENDLE S, FREUDENTHALER C, GANTNER Z, Et al., BPR: Bayesian Personalized Ranking from Implicit Feedback, Proc of the 25th Conference on Uncertainty in Artificial Intelligence, pp. 452-461, (2009)
  • [2] SHANI G, HECKERMAN D, BRAFMAN R I, Et al., An MDP-Based Recommender System, Journal of Machine Learning Research, 6, pp. 1265-1295, (2005)
  • [3] HIDASI B, KARATZOGLOU A., Recurrent Neural Networks with Top-k Gains for Session-Based Recommendations, Proc of the 27th ACM International Conference on Information and Knowledge Management, pp. 843-852, (2018)
  • [4] TANG J X, WANG K., Personalized Top-N Sequential Recommendation via Convolutional Sequence Embedding, Proc of the 11th ACM International Conference on Web Search and Data Mining, pp. 565-573, (2018)
  • [5] YOU J X, WANG Y C, PAL A, Et al., Hierarchical Temporal Convolutional Networks for Dynamic Recommender Systems, Proc of the World Wide Web Conference, pp. 2236-2246, (2019)
  • [6] KANG W C, MCAULEY J., Self-Attentive Sequential Recommendation, Proc of the IEEE International Conference on Data Mining, pp. 197-206, (2018)
  • [7] WANG H W, GUO M Y., Recurrent Memory Networks: Modeling Long Short-Term User Preferences for Session-Based Recommendation, Scientia Sinica(Informationis), 50, 12, pp. 1867-1881, (2020)
  • [8] FENG Y, ZHANG B, QIANG B H, Et al., MN-HDRM: A Novel Hybrid Dynamic Recommendation Model Based on Long-Short-Term Interests Multiple Neural Networks, Chinese Journal of Computers, 42, 1, pp. 16-28, (2019)
  • [9] YAN S H, MA W Z, ZHANG M, Et al., Reinforcement Learning with User Long-Term and Short-Term Preference for Personalized Recommendation, Journal of Chinese Information Processing, 35, 8, pp. 107-116, (2021)
  • [10] WU C Y, AHMED A, BEUTEL A, Et al., Recurrent Recommender Networks, Proc of the 10th ACM International Conference on Web Search and Data Mining, pp. 495-503, (2017)