Multi-Resolution Attention for Personalized Item Search

被引:2
|
作者
Kocayusufoglu, Furkan [1 ]
Wu, Tao [1 ]
Singh, Anima [1 ]
Roumpos, Georgios [1 ]
Cheng, Heng-Tze [1 ]
Jain, Sagar [1 ]
Chi, Ed [1 ]
Singh, Ambuj [1 ]
机构
[1] Google Inc, Mountain View, CA 94043 USA
关键词
item search; personalization; temporal attention; multi-resolution attention; recommender systems;
D O I
10.1145/3488560.3498426
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Personalized item search has become an essential tool for online platforms-where users interact with a large corpus of items (e.g., click, purchase, like) via a search query-to provide their users with a more satisfactory search experience. The record (or history) of users' past interactions serves as a valuable asset to achieve personalization. While user history data can span over a long period of time, only a part of the history is relevant to a user's current search intent. Moreover, since historical interactions take place at aperiodic points in time, modeling their relevance to the current search query entangles complex temporal dependencies. We propose multi-resolution attention to address these challenges for personalized item search. Our approach captures higher-order temporal relations between user queries and their history across several temporal subspaces (i.e., resolutions), each corresponding to distinct temporal ranges with adaptive time boundaries that are also learned directly from data. We achieve this by coupling the conventional multi-head attention module with a differentiable soft-thresholding mechanism, which essentially operates as a masking function in the temporal domain. Comparisons with strong baselines on an open-source benchmark dataset confirm the efficacy of our approach.
引用
收藏
页码:508 / 516
页数:9
相关论文
共 50 条
  • [1] Adaptive Multi-Resolution Attention with Linear Complexity
    Zhang, Yao
    Ma, Yunpu
    Seidl, Thomas
    Tresp, Volker
    [J]. 2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [2] IMAGE SUPER-RESOLUTION USING MULTI-RESOLUTION ATTENTION NETWORK
    Liu, Anqi
    Li, Sumei
    Chang, Yongli
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1610 - 1614
  • [3] MULTI-RESOLUTION MULTI-HEAD ATTENTION IN DEEP SPEAKER EMBEDDING
    Wang, Zhiming
    Yao, Kaisheng
    Li, Xiaolong
    Fang, Shuo
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 6464 - 6468
  • [4] Multi-Resolution and Multi-Bit Representation for Image Similarity Search
    Aysal, Tuncer C.
    Heesch, Daniel C.
    [J]. 2009 11TH IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM 2009), 2009, : 290 - 297
  • [5] Human Pose Estimation Based on Attention Multi-resolution Network
    Zhang, Congcong
    He, Ning
    Sun, Qixiang
    Yin, Xiaojie
    Lu, Ke
    [J]. PROCEEDINGS OF THE 2021 INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL (ICMR '21), 2021, : 682 - 687
  • [6] CAPTURING MULTI-RESOLUTION CONTEXT BY DILATED SELF-ATTENTION
    Moritz, Niko
    Hori, Takaaki
    Le Roux, Jonathan
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 5869 - 5873
  • [7] Full Contextual Attention for Multi-resolution Transformers in Semantic Segmentation
    Themyr, Loic
    Rambour, Clement
    Thome, Nicolas
    Collins, Toby
    Hostettler, Alexandre
    [J]. 2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 3223 - 3232
  • [8] Multi-resolution attention convolutional neural network for crowd counting
    Zhang, Youmei
    Zhou, Chunluan
    Chang, Faliang
    Kot, Alex C.
    [J]. NEUROCOMPUTING, 2019, 329 : 144 - 152
  • [9] Weed Classification Using Explainable Multi-Resolution Slot Attention
    Farkhani, Sadaf
    Skovsen, Soren Kelstrup
    Dyrmann, Mads
    Jorgensen, Rasmus Nyholm
    Karstoft, Henrik
    [J]. SENSORS, 2021, 21 (20)
  • [10] VLSI architecture for multi-resolution three step search algorithm
    Sarma, M
    Samanta, D
    Dhar, AS
    [J]. 2003 5TH INTERNATIONAL CONFERENCE ON ASIC, VOLS 1 AND 2, PROCEEDINGS, 2003, : 918 - 921