Federated Learning for Online Resource Allocation in Mobile Edge Computing: A Deep Reinforcement Learning Approach

被引:7
|
作者
Zheng, Jingjing [1 ]
Li, Kai [1 ]
Mhaisen, Naram [2 ]
Ni, Wei [3 ]
Tovar, Eduardo [1 ]
Guizani, Mohsen [4 ]
机构
[1] CISTER Res Ctr, Porto, Portugal
[2] Delft Univ Technol, Delft, Netherlands
[3] CSIRO, Sydney, NSW, Australia
[4] MBZUAI, Abu Dhabi, U Arab Emirates
关键词
Federated learning; mobile edge computing; online resource allocation; deep reinforcement learning;
D O I
10.1109/WCNC55385.2023.10118940
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning (FL) is increasingly considered to circumvent the disclosure of private data in mobile edge computing (MEC) systems. Training with large data can enhance FL learning accuracy, which is associated with non-negligible energy use. Scheduled edge devices with small data save energy but decrease FL learning accuracy due to a reduction in energy consumption. A trade-off between the energy consumption of edge devices and the learning accuracy of FL is formulated in this proposed work. The FL-enabled twin-delayed deep deterministic policy gradient (FL-TD3) framework is proposed as a solution to the formulated problem because its state and action spaces are large in a continuous domain. This framework provides the maximum accuracy ratio of FL divided by the device's energy consumption. A comparison of the numerical results with the state-of-the-art demonstrates that the ratio has been improved significantly.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Smart Resource Allocation for Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Wang, Jiadai
    Zhao, Lei
    Liu, Jiajia
    Kato, Nei
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2021, 9 (03) : 1529 - 1541
  • [2] Smart Resource Allocation for Mobile Edge Computing: A Deep Reinforcement Learning Approach
    [J]. Liu, Jiajia (liujiajia@nwpu.edu.cn), 1600, IEEE Computer Society (09):
  • [3] Federated deep reinforcement learning-based online task offloading and resource allocation in harsh mobile edge computing environment
    Xiang, Hui
    Zhang, Meiyu
    Jian, Chengfeng
    [J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2024, 27 (03): : 3323 - 3339
  • [4] User Allocation in Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Panda, Subrat Prasad
    Banerjee, Ansuman
    Bhattacharya, Arani
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON WEB SERVICES, ICWS 2021, 2021, : 447 - 458
  • [5] Adaptive Resource Allocation for Mobile Edge Computing in Internet of Vehicles: A Deep Reinforcement Learning Approach
    Zhao, Junhui
    Quan, Haoyu
    Xia, Minghua
    Wang, Dongming
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (04) : 5834 - 5848
  • [6] Task and Resource Allocation in Mobile Edge Computing: An Improved Reinforcement Learning Approach
    Wang, Sihua
    Chen, Mingzhe
    Liu, Xuanlin
    Yin, Changchuan
    [J]. 2019 IEEE GLOBECOM WORKSHOPS (GC WKSHPS), 2019,
  • [7] Deep Reinforcement Learning Based Approach for Online Service Placement and Computation Resource Allocation in Edge Computing
    Liu, Tong
    Ni, Shenggang
    Li, Xiaoqiang
    Zhu, Yanmin
    Kong, Linghe
    Yang, Yuanyuan
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (07) : 3870 - 3881
  • [8] Offloading and Resource Allocation With General Task Graph in Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Yan, Jia
    Bi, Suzhi
    Zhang, Ying-Jun Angela
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (08) : 5404 - 5419
  • [9] Federated deep reinforcement learning for task offloading and resource allocation in mobile edge computing-assisted vehicular networks
    Zhao, Xu
    Wu, Yichuan
    Zhao, Tianhao
    Wang, Feiyu
    Li, Maozhen
    [J]. JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2024, 229
  • [10] Joint Offloading and Resource Allocation Using Deep Reinforcement Learning in Mobile Edge Computing
    Zhang, Xinjie
    Zhang, Xinglin
    Yang, Wentao
    [J]. IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (05): : 3454 - 3466