Efficient Federated Learning using Random Pruning in Resource-Constrained Edge Intelligence Networks

被引:0
|
作者
Chen, Chao [1 ]
Jiang, Bohang [1 ]
Liu, Shengli [2 ]
Li, Chuanhuang [1 ]
Wu, Celimuge [3 ]
Yin, Rui [2 ]
机构
[1] Zhejiang Gongshang Univ, Sch Informat & Elect Engn, Hangzhou, Peoples R China
[2] Hangzhou City Univ, Sch Informat & Elect Engn, Hangzhou, Peoples R China
[3] Univ Elect Commun, Grad Sch Informat & Engn, Tokyo, Japan
基金
中国国家自然科学基金;
关键词
Federated learning; random pruning; device selection; resource allocation;
D O I
10.1109/GLOBECOM54140.2023.10437051
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We study efficient federated learning (FL) using random pruning in resource-constrained edge intelligence networks. We propose an edge device selection strategy to identify appropriate edge devices for participating in FL at the beginning of each training iteration. We then formulate an optimization problem that jointly optimizes the pruning ratio, CPU frequency, uplink power, and bandwidth allocation for the selected edge devices. Since the optimization problem is non-convex and challenging to solve directly, we decompose it into three subproblems and propose efficient algorithms or closed-form solutions for each subproblem. Based on the solutions to the subproblems, an alternating optimization algorithm is constructed to solve the original problem. Simulation results demonstrate that our scheme outperforms baseline schemes in terms of both learning accuracy and energy consumption.
引用
收藏
页码:5244 / 5249
页数:6
相关论文
共 50 条
  • [31] Automatic Distributed Deep Learning Using Resource-Constrained Edge Devices
    Gutierrez-Torre, Alberto
    Bahadori, Kiyana
    Baig, Shuja-ur-Rehman
    Iqbal, Waheed
    Vardanega, Tullio
    Berral, Josep Lluis
    Carrera, David
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (16) : 15018 - 15029
  • [32] AdaptiveMesh: Adaptive Federated Learning for Resource-Constrained Wireless Environments
    Shkurti, Lamir
    Selimi, Mennan
    INTERNATIONAL JOURNAL OF ONLINE AND BIOMEDICAL ENGINEERING, 2024, 20 (14) : 22 - 37
  • [33] Blockchain at the Edge: Performance of Resource-Constrained IoT Networks
    Misra, Sudip
    Mukherjee, Anandarup
    Roy, Arijit
    Saurabh, Nishant
    Rahulamathavan, Yogachandran
    Rajarajan, Muttukrishnan
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2021, 32 (01) : 174 - 183
  • [34] Implementation of Federated Learning on Resource-constrained devices: Lessons learned
    Tsouparopoulos, Thomas
    Koutsopoulos, Iordanis
    2022 IFIP NETWORKING CONFERENCE (IFIP NETWORKING), 2022,
  • [35] FedDCT: Federated Learning of Large Convolutional Neural Networks on Resource-Constrained Devices Using Divide and Collaborative Training
    Nguyen, Quan
    Pham, Hieu H.
    Wong, Kok-Seng
    Nguyen, Phi Le
    Nguyen, Truong Thao
    Do, Minh N.
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2024, 21 (01): : 418 - 436
  • [36] EFFICIENT MOVING TARGET DETECTION USING RESOURCE-CONSTRAINED NEURAL NETWORKS
    Milioris, Dimitris
    2023 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING WORKSHOPS, ICASSPW, 2023,
  • [37] A Design Strategy for the Efficient Implementation of Random Basis Neural Networks on Resource-Constrained Devices
    Edoardo Ragusa
    Christian Gianoglio
    Rodolfo Zunino
    Paolo Gastaldo
    Neural Processing Letters, 2020, 51 : 1611 - 1629
  • [38] A Design Strategy for the Efficient Implementation of Random Basis Neural Networks on Resource-Constrained Devices
    Ragusa, Edoardo
    Gianoglio, Christian
    Zunino, Rodolfo
    Gastaldo, Paolo
    NEURAL PROCESSING LETTERS, 2020, 51 (02) : 1611 - 1629
  • [39] Model Pruning Enables Efficient Federated Learning on Edge Devices
    Jiang, Yuang
    Wang, Shiqiang
    Valls, Victor
    Ko, Bong Jun
    Lee, Wei-Han
    Leung, Kin K.
    Tassiulas, Leandros
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (12) : 10374 - 10386
  • [40] An Efficient Federated Learning Framework Deployed in Resource-Constrained IoV: User Selection and Learning Time Optimization Schemes
    Qiang Wang
    Shaoyi Xu
    Rongtao Xu
    Dongji Li
    China Communications, 2023, 20 (12) : 111 - 130