Fine-Grained Data Selection for Improved Energy Efficiency of Federated Edge Learning

被引:27
|
作者
Albaseer, Abdullatif [1 ]
Abdallah, Mohamed [1 ]
Al-Fuqaha, Ala [1 ]
Erbad, Aiman [1 ]
机构
[1] Hamad Bin Khlifa Univ, Coll Sci & Engn, Div Informat & Comp Technol, Doha 5825, Qatar
关键词
Servers; Energy consumption; Training; Data models; Computational modeling; Resource management; Performance evaluation; Federated Edge Learning (FEEL); Edge Intelligence; Data selection; Learning Algorithm; Convergence rate; Resource allocation; COMMUNICATION;
D O I
10.1109/TNSE.2021.3100805
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In Federated edge learning (FEEL), energy-constrained devices at the network edge consume significant energy when training and uploading their local machine learning models, leading to a decrease in their lifetime. This work proposes novel solutions for energy-efficient FEEL by jointly considering local training data, available computation, and communications resources, and deadline constraints of FEEL rounds to reduce energy consumption. This paper considers a system model where the edge server is equipped with multiple antennas employing beamforming techniques to communicate with the local users through orthogonal channels. Specifically, we consider a problem that aims to find the optimal user's resources, including the fine-grained selection of relevant training samples, bandwidth, transmission power, beamforming weights, and processing speed with the goal of minimizing the total energy consumption given a deadline constraint on the communication rounds of FEEL. Then, we devise tractable solutions by first proposing a novel fine-grained training algorithm that excludes less relevant training samples and effectively chooses only the samples that improve the model's performance. After that, we derive closed-form solutions, followed by a Golden-Section-based iterative algorithm to find the optimal computation and communication resources that minimize energy consumption. Experiments using MNIST and CIFAR-10 datasets demonstrate that our proposed algorithms considerably outperform the state-of-the-art solutions as energy consumption decreases by 79% for MNIST and 73% for CIFAR-10 datasets.
引用
收藏
页码:3258 / 3271
页数:14
相关论文
共 50 条
  • [11] Efficient Asynchronous Federated Learning with Prospective Momentum Aggregation and Fine-Grained Correction
    Zang, Yu
    Xue, Zhe
    Ou, Shilong
    Chu, Lingyang
    Du, Junping
    Long, Yunfei
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 15, 2024, : 16642 - 16650
  • [12] A Fine-Grained Differentially Private Federated Learning Against Leakage From Gradients
    Zhu, Linghui
    Liu, Xinyi
    Li, Yiming
    Yang, Xue
    Xia, Shu-Tao
    Lu, Rongxing
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (13) : 11500 - 11512
  • [13] Energy-efficient client selection in federated learning with heterogeneous data on edge
    Jianxin Zhao
    Yanhao Feng
    Xinyu Chang
    Chi Harold Liu
    [J]. Peer-to-Peer Networking and Applications, 2022, 15 : 1139 - 1151
  • [14] Energy-efficient client selection in federated learning with heterogeneous data on edge
    Zhao, Jianxin
    Feng, Yanhao
    Chang, Xinyu
    Liu, Chi Harold
    [J]. PEER-TO-PEER NETWORKING AND APPLICATIONS, 2022, 15 (02) : 1139 - 1151
  • [15] A federated approach for fine-grained classification of fashion apparel
    Mallavarapu, Tejaswini
    Cranfill, Luke
    Kim, Eun Hye
    Parizi, Reza M.
    Morris, John
    Son, Junggab
    [J]. MACHINE LEARNING WITH APPLICATIONS, 2021, 6
  • [16] FGFL: Fine-Grained Federated Learning Based on Neural Architecture Search for Heterogeneous Clients
    Ying, Weiqin
    Wang, Chixin
    Wu, Yu
    Luo, Xuan
    Wen, Zhe
    Zhang, Han
    [J]. ADVANCES IN SWARM INTELLIGENCE, PT II, ICSI 2024, 2024, 14789 : 99 - 111
  • [17] Fine-Grained Preference-Aware Personalized Federated POI Recommendation with Data Sparsity
    Zhang, Xiao
    Ye, Ziming
    Lu, Jianfeng
    Zhuang, Fuzhen
    Zheng, Yanwei
    Yu, Dongxiao
    [J]. PROCEEDINGS OF THE 46TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2023, 2023, : 413 - 422
  • [18] FADES: Fine-Grained Edge Offloading with Unikernels
    Cozzolino, Vittorio
    Ding, Aaron Yi
    Ott, Joerg
    [J]. PROCEEDINGS OF THE 2017 WORKSHOP ON HOT TOPICS IN CONTAINER NETWORKING AND NETWORKED SYSTEMS (HOTCONNET 17), 2017, : 36 - 41
  • [19] Towards Fine-Grained Recognition: Joint Learning for Object Detection and Fine-Grained Classification
    Wang, Qiaosong
    Rasmussen, Christopher
    [J]. ADVANCES IN VISUAL COMPUTING, ISVC 2019, PT II, 2019, 11845 : 332 - 344
  • [20] Learning to Navigate for Fine-Grained Classification
    Yang, Ze
    Luo, Tiange
    Wang, Dong
    Hu, Zhiqiang
    Gao, Jun
    Wang, Liwei
    [J]. COMPUTER VISION - ECCV 2018, PT XIV, 2018, 11218 : 438 - 454