A federated recommendation algorithm based on user clustering and meta-learning

被引:3
|
作者
Yu, Enqi [1 ]
Ye, Zhiwei [2 ]
Zhang, Zhiqiang [1 ]
Qian, Ling [2 ]
Xie, Meiyi [1 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan 430074, Hubei, Peoples R China
[2] China Mobile Suzhou Software Technol Co LTD, Suzhou 215000, Jiangsu, Peoples R China
关键词
Clustering; Federated learning; Meta-learning; Recommendation algorithm;
D O I
10.1016/j.asoc.2024.111483
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Federated recommendation is a typical application of federated learning, which can protect the privacy users by exchanging models between users' devices and central servers rather than users' raw data. Recently, although some research in federated recommendation has made remarkable progress, there are still two issues need to be addressed further due to the non -independent and identical distribution (Non-IID) data which is very common in federal recommendation systems. First, the communication load of the user device during training is heavy. Second, the trained local model lacks personalization. Aiming at the above problems, federated recommendation algorithm based on user clustering and meta -learning, ClusterFedMet, is proposed to improve communication efficiency and recommendation personalization simultaneously. In ClusterFedMet, users are clustered into different clusters according to their data distribution, and user sampling are performed based on the clustering result, thus reduce harmful interference among users with different data distribution. The model is trained with meta -learning, which can generate more personalized local models. During learning, a controller which can dynamically tune the hyperparameters for users is designed to achieve performance. According to weights, gradients, and losses of each step, the controller can find a learning suitable for each user's local data and model. We perform evaluations for the proposed algorithm on public datasets, and the results demonstrate that our algorithm outperforms other advanced methods in of recommendation accuracy and communication efficiency.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Clustering Algorithm Recommendation: A Meta-learning Approach
    Ferrari, Daniel G.
    de Castro, Leandro Nunes
    [J]. SWARM, EVOLUTIONARY, AND MEMETIC COMPUTING, (SEMCCO 2012), 2012, 7677 : 143 - 150
  • [2] Unsupervised Meta-Learning for Clustering Algorithm Recommendation
    Pimentel, Bruno Almeida
    de Carvalho, Andre C. P. L. E.
    [J]. 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [3] Meta-learning Based Evolutionary Clustering Algorithm
    Tomp, Dmitry
    Muravyov, Sergey
    Filchenkov, Andrey
    Parfenov, Vladimir
    [J]. INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING - IDEAL 2019, PT I, 2019, 11871 : 502 - 513
  • [4] A Personalized Federated Learning Algorithm Based on Meta-Learning and Knowledge Distillation
    Sun, Yanhua
    Shi, Yahui
    Wang, Zhuwei
    Li, Meng
    Si, Pengbo
    [J]. Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2023, 46 (01): : 12 - 18
  • [5] Isolation forests and landmarking-based representations for clustering algorithm recommendation using meta-learning
    Gabbay, Itay
    Shapira, Bracha
    Rokach, Lior
    [J]. Information Sciences, 2021, 574 : 473 - 489
  • [6] A Survey of Personalized Recommendation Algorithm Selection Based on Meta-learning
    Ren, Yi
    Chi, Cuirong
    Zhang Jintao
    [J]. CYBER SECURITY INTELLIGENCE AND ANALYTICS, 2020, 928 : 1383 - 1388
  • [7] Statistical versus Distance-Based Meta-Features for Clustering Algorithm recommendation Using Meta-Learning
    Pimentel, Bruno Almeida
    de Carvalho, Andre C. P. L. E.
    [J]. 2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018, : 845 - 852
  • [8] Meta-Learning for User Cold-Start Recommendation
    Bharadhwaj, Homanga
    [J]. 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [9] Recommendation method for avionics feature selection algorithm based on meta-learning
    Li, Ruifeng
    Xu, Aiqiang
    Sun, Weichao
    Wang, Shuyou
    [J]. Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2021, 43 (07): : 2011 - 2020
  • [10] Personalized Hashtag Recommendation with User-level Meta-learning
    Tao, Hemeng
    Khan, Latifur
    Thuraisingham, Bhavani
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,