Federated Learning for Online Resource Allocation in Mobile Edge Computing: A Deep Reinforcement Learning Approach

被引:7
|
作者
Zheng, Jingjing [1 ]
Li, Kai [1 ]
Mhaisen, Naram [2 ]
Ni, Wei [3 ]
Tovar, Eduardo [1 ]
Guizani, Mohsen [4 ]
机构
[1] CISTER Res Ctr, Porto, Portugal
[2] Delft Univ Technol, Delft, Netherlands
[3] CSIRO, Sydney, NSW, Australia
[4] MBZUAI, Abu Dhabi, U Arab Emirates
关键词
Federated learning; mobile edge computing; online resource allocation; deep reinforcement learning;
D O I
10.1109/WCNC55385.2023.10118940
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning (FL) is increasingly considered to circumvent the disclosure of private data in mobile edge computing (MEC) systems. Training with large data can enhance FL learning accuracy, which is associated with non-negligible energy use. Scheduled edge devices with small data save energy but decrease FL learning accuracy due to a reduction in energy consumption. A trade-off between the energy consumption of edge devices and the learning accuracy of FL is formulated in this proposed work. The FL-enabled twin-delayed deep deterministic policy gradient (FL-TD3) framework is proposed as a solution to the formulated problem because its state and action spaces are large in a continuous domain. This framework provides the maximum accuracy ratio of FL divided by the device's energy consumption. A comparison of the numerical results with the state-of-the-art demonstrates that the ratio has been improved significantly.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] Computing resource allocation scheme of IOV using deep reinforcement learning in edge computing environment
    Zhang, Yiwei
    Zhang, Min
    Fan, Caixia
    Li, Fuqiang
    Li, Baofang
    [J]. EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2021, 2021 (01)
  • [42] Collaborative Caching in Edge Computing via Federated Learning and Deep Reinforcement Learning
    Wang, Yali
    Chen, Jiachao
    [J]. WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [43] "DRL plus FL": An intelligent resource allocation model based on deep reinforcement learning for Mobile Edge Computing
    Shan, Nanliang
    Cui, Xiaolong
    Gao, Zhiqiang
    [J]. COMPUTER COMMUNICATIONS, 2020, 160 : 14 - 24
  • [44] Quantum Deep Reinforcement Learning for Dynamic Resource Allocation in Mobile Edge Computing-Based IoT Systems
    Ansere, James Adu
    Gyamfi, Eric
    Sharma, Vishal
    Shin, Hyundong
    Dobre, Octavia A.
    Duong, Trung Q.
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (06) : 6221 - 6233
  • [45] Adaptive User Scheduling and Resource Allocation in Wireless Federated Learning Networks : A Deep Reinforcement Learning Approach
    Wu, Changxiang
    Ren, Yijing
    So, Daniel K. C.
    [J]. ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 1219 - 1225
  • [46] Joint UAV Deployment and Resource Allocation: A Personalized Federated Deep Reinforcement Learning Approach
    Xu, Xinyi
    Feng, Gang
    Qin, Shuang
    Liu, Yijing
    Sun, Yao
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (03) : 4005 - 4018
  • [47] Novel Resource Allocation Algorithm of Edge Computing Based on Deep Reinforcement Learning Mechanism
    Zhang, Degan
    Fan, Hongrui
    Zhang, Jie
    [J]. 19TH IEEE INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED PROCESSING WITH APPLICATIONS (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2021), 2021, : 437 - 444
  • [48] Deep Reinforcement Learning for Task Allocation in UAV-enabled Mobile Edge Computing
    Yu, Changliang
    Du, Wei
    Ren, Fan
    Zhao, Nan
    [J]. ADVANCES IN INTELLIGENT NETWORKING AND COLLABORATIVE SYSTEMS (INCOS-2021), 2022, 312 : 225 - 232
  • [49] A Deep Reinforcement Learning Approach Towards Computation Offloading for Mobile Edge Computing
    Wang, Qing
    Tan, Wenan
    Qin, Xiaofan
    [J]. HUMAN CENTERED COMPUTING, 2019, 11956 : 419 - 430
  • [50] Edge intelligence computing for mobile augmented reality with deep reinforcement learning approach
    Chen, Miaojiang
    Liu, Wei
    Wang, Tian
    Liu, Anfeng
    Zeng, Zhiwen
    [J]. COMPUTER NETWORKS, 2021, 195