A Federated Meta-Reinforcement Learning Algorithm Based on Gradient Correction

被引:0
|
作者
Qin, Zerui [1 ]
Yue, Sheng [1 ]
机构
[1] Tsinghua Univ, Beijing, Peoples R China
关键词
D O I
10.1145/3674399.3674473
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To meet the requirement of the decision-making capabilities of IoT devices in dynamic environments, Federated Reinforcement Learning (FRL) has attracted increasing attention in recent years. However, Due to the challenges of heterogeneous environments and sampling limitation in the practical scenarios, it is difficult for clients in different environments to jointly train a personalized policy that can quickly adapt to a new environment. In this paper, we propose a federated meta-reinforcement learning algorithm with gradient correction to extract a meta-policy from heterogeneous environments. Further, we analyze the performance of our proposed algorithm in the experiment section.
引用
收藏
页码:220 / 221
页数:2
相关论文
共 50 条
  • [31] Meta-reinforcement learning for edge caching in vehicular networks
    Sakr H.
    Elsabrouty M.
    Journal of Ambient Intelligence and Humanized Computing, 2023, 14 (04) : 4607 - 4619
  • [32] Doubly Robust Augmented Transfer for Meta-Reinforcement Learning
    Jiang, Yuankun
    Kan, Nuowen
    Li, Chenglin
    Dai, Wenrui
    Zou, Junni
    Xiong, Hongkai
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [33] Wireless Power Control via Meta-Reinforcement Learning
    Lu, Ziyang
    Gursoy, M. Cenk
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 1562 - 1567
  • [34] Prioritized Hindsight with Dual Buffer for Meta-Reinforcement Learning
    Beyene, Sofanit Wubeshet
    Han, Ji-Hyeong
    ELECTRONICS, 2022, 11 (24)
  • [35] PAC-Bayesian offline Meta-reinforcement learning
    Sun, Zheng
    Jing, Chenheng
    Guo, Shangqi
    An, Lingling
    APPLIED INTELLIGENCE, 2023, 53 (22) : 27128 - 27147
  • [36] Meta-Reinforcement Learning for Multiple Traffic Signals Control
    Lou, Yican
    Wu, Jia
    Ran, Yunchuan
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 4264 - 4268
  • [37] Dynamic Channel Access via Meta-Reinforcement Learning
    Lu, Ziyang
    Gursoy, M. Cenk
    2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [38] Meta-Reinforcement Learning via Exploratory Task Clustering
    Chu, Zhendong
    Cai, Renqin
    Wang, Hongning
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 10, 2024, : 11633 - 11641
  • [39] PAC-Bayesian offline Meta-reinforcement learning
    Zheng Sun
    Chenheng Jing
    Shangqi Guo
    Lingling An
    Applied Intelligence, 2023, 53 : 27128 - 27147
  • [40] Image-Based Meta-Reinforcement Learning for Autonomous Guidance of an Asteroid Impactor
    Federici, Lorenzo
    Scorsoglio, Andrea
    Ghilardi, Luca
    D'Ambrosio, Andrea
    Benedikter, Boris
    Zavoli, Alessandro
    Furfaro, Roberto
    JOURNAL OF GUIDANCE CONTROL AND DYNAMICS, 2022, 45 (11) : 2013 - 2028