Node Selection Algorithm for Federated Learning Based on Deep Reinforcement Learning for Edge Computing in IoT

被引:2
|
作者
Yan, Shuai [1 ,2 ]
Zhang, Peiying [3 ,4 ]
Huang, Siyu [5 ]
Wang, Jian [6 ]
Sun, Hao [3 ]
Zhang, Yi [3 ]
Tolba, Amr [7 ]
机构
[1] Xian Res Inst Hitech, Xian 710025, Peoples R China
[2] Natl Univ Def Technol, Coll Informat & Commun, Wuhan 430000, Peoples R China
[3] China Univ Petr East China, Qingdao Inst Software, Coll Comp Sci & Technol, Qingdao 266580, Peoples R China
[4] Xidian Univ, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[5] Chinese Acad Sci, Xiongan Inst Innovat, Baoding 071702, Peoples R China
[6] China Univ Petr East China, Coll Sci, Qingdao 266580, Peoples R China
[7] King Saud Univ, Community Coll, Dept Comp Sci, Riyadh 11437, Saudi Arabia
关键词
IoT; edge computing; federated learning; node selection; reinforcement learning; RESOURCE-ALLOCATION; CHALLENGES; INTERNET;
D O I
10.3390/electronics12112478
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The Internet of Things (IoT) and edge computing technologies have been rapidly developing in recent years, leading to the emergence of new challenges in privacy and security. Personal privacy and data leakage have become major concerns in IoT edge computing environments. Federated learning has been proposed as a solution to address these privacy issues, but the heterogeneity of devices in IoT edge computing environments poses a significant challenge to the implementation of federated learning. To overcome this challenge, this paper proposes a novel node selection strategy based on deep reinforcement learning to optimize federated learning in heterogeneous device IoT environments. Additionally, a metric model for IoT devices is proposed to evaluate the performance of different devices. The experimental results demonstrate that the proposed method can improve training accuracy by 30% in a heterogeneous device IoT environment.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Node selection method in federated learning based on deep reinforcement learning
    He, Wenchen
    Guo, Shaoyong
    Qiu, Xuesong
    Chen, Liandong
    Zhang, Suxiang
    [J]. Tongxin Xuebao/Journal on Communications, 2021, 42 (06): : 62 - 71
  • [2] Client Selection for Federated Learning in Vehicular Edge Computing: A Deep Reinforcement Learning Approach
    Moon, Sungwon
    Lim, Yujin
    [J]. IEEE ACCESS, 2024, 12 : 131337 - 131348
  • [3] Edge-Based Federated Deep Reinforcement Learning for IoT Traffic Management
    Jarwan, Abdallah
    Ibnkahla, Mohamed
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (05) : 3799 - 3813
  • [4] Resource Allocation Based on Deep Reinforcement Learning in IoT Edge Computing
    Xiong, Xiong
    Zheng, Kan
    Lei, Lei
    Hou, Lu
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2020, 38 (06) : 1133 - 1146
  • [5] Edge Computing Resource Allocation Algorithm for NB-IoT Based on Deep Reinforcement Learning
    Chu, Jiawen
    Pan, Chunyun
    Wang, Yafei
    Yun, Xiang
    LI, Xuehua
    [J]. IEICE TRANSACTIONS ON COMMUNICATIONS, 2023, E106B (05) : 439 - 447
  • [6] Collaborative Caching in Edge Computing via Federated Learning and Deep Reinforcement Learning
    Wang, Yali
    Chen, Jiachao
    [J]. WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [7] Node selection for model quality optimization in hierarchical federated learning based on deep reinforcement learning
    Li, Zhuo
    Dang, Yashi
    Chen, Xin
    [J]. PEER-TO-PEER NETWORKING AND APPLICATIONS, 2024, 17 (03) : 1720 - 1731
  • [8] Deep reinforcement learning-based edge computing offloading algorithm for software-defined IoT
    Zhu, Xiaojuan
    Zhang, Tianhao
    Zhang, Jinwei
    Zhao, Bao
    Zhang, Shunxiang
    Wu, Cai
    [J]. COMPUTER NETWORKS, 2023, 235
  • [9] Deep Reinforcement Learning-Based Task Scheduling in IoT Edge Computing
    Sheng, Shuran
    Chen, Peng
    Chen, Zhimin
    Wu, Lenan
    Yao, Yuxuan
    [J]. SENSORS, 2021, 21 (05) : 1 - 19
  • [10] Distributed Edge Computing Offloading Algorithm Based on Deep Reinforcement Learning
    Li, Yunzhao
    Qi, Feng
    Wang, Zhili
    Yu, Xiuming
    Shao, Sujie
    [J]. IEEE ACCESS, 2020, 8 : 85204 - 85215