A Federated Meta-Reinforcement Learning Algorithm Based on Gradient Correction

被引:0
|
作者
Qin, Zerui [1 ]
Yue, Sheng [1 ]
机构
[1] Tsinghua Univ, Beijing, Peoples R China
关键词
D O I
10.1145/3674399.3674473
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To meet the requirement of the decision-making capabilities of IoT devices in dynamic environments, Federated Reinforcement Learning (FRL) has attracted increasing attention in recent years. However, Due to the challenges of heterogeneous environments and sampling limitation in the practical scenarios, it is difficult for clients in different environments to jointly train a personalized policy that can quickly adapt to a new environment. In this paper, we propose a federated meta-reinforcement learning algorithm with gradient correction to extract a meta-policy from heterogeneous environments. Further, we analyze the performance of our proposed algorithm in the experiment section.
引用
收藏
页码:220 / 221
页数:2
相关论文
共 50 条
  • [41] Taming MAML: Efficient Unbiased Meta-Reinforcement Learning
    Liu, Hao
    Socher, Richard
    Xiong, Caiming
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [42] Context Shift Reduction for Offline Meta-Reinforcement Learning
    Gao, Yunkai
    Zhang, Rui
    Guo, Jiaming
    Wu, Fan
    Yi, Qi
    Peng, Shaohui
    Lan, Siming
    Chen, Ruizhi
    Du, Zidong
    Hu, Xing
    Guo, Qi
    Li, Ling
    Chen, Yunji
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [43] GlobalLocal Decomposition of Contextual Representations in Meta-Reinforcement Learning
    Ma, Nelson
    Xuan, Junyu
    Zhang, Guangquan
    Lu, Jie
    IEEE TRANSACTIONS ON CYBERNETICS, 2025, 55 (03) : 1277 - 1287
  • [44] A multi-robot path-planning algorithm for autonomous navigation using meta-reinforcement learning based on transfer learning
    Wen, Shuhuan
    Wen, Zeteng
    Zhang, Di
    Zhang, Hong
    Wang, Tao
    APPLIED SOFT COMPUTING, 2021, 110 (110)
  • [45] Industrial Insert Robotic Assembly Based on Model-based Meta-Reinforcement Learning
    Liu, Dong
    Zhang, Xiamin
    Du, Yu
    Gao, Dan
    Wang, Minghao
    Cong, Ming
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (IEEE-ROBIO 2021), 2021, : 1508 - 1512
  • [46] A context-based meta-reinforcement learning approach to efficient hyperparameter optimization
    Liu, Xiyuan
    Wu, Jia
    Chen, Senpeng
    NEUROCOMPUTING, 2022, 478 : 89 - 103
  • [47] Meta-Reinforcement Learning-Based Transferable Scheduling Strategy for Energy Management
    Xiong, Luolin
    Tang, Yang
    Liu, Chensheng
    Mao, Shuai
    Meng, Ke
    Dong, Zhaoyang
    Qian, Feng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2023, 70 (04) : 1685 - 1695
  • [48] MetaLight: Value-Based Meta-Reinforcement Learning for Traffic Signal Control
    Zang, Xinshi
    Yao, Huaxiu
    Zheng, Guanjie
    Xu, Nan
    Xu, Kai
    Li, Zhenhui
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 1153 - 1160
  • [49] Autonomous Obstacle Avoidance and Target Tracking of UAV Based on Meta-Reinforcement Learning
    Jiang W.
    Wu J.
    Wang Y.
    Hunan Daxue Xuebao/Journal of Hunan University Natural Sciences, 2022, 49 (06): : 101 - 109
  • [50] Harnessing Meta-Reinforcement Learning for Enhanced Tracking in Geofencing Systems
    Famili, Alireza
    Sun, Shihua
    Atalay, Tolga
    Stavrou, Angelos
    IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2025, 6 : 944 - 960