Fine-Grained Data Selection for Improved Energy Efficiency of Federated Edge Learning

被引:27
|
作者
Albaseer, Abdullatif [1 ]
Abdallah, Mohamed [1 ]
Al-Fuqaha, Ala [1 ]
Erbad, Aiman [1 ]
机构
[1] Hamad Bin Khlifa Univ, Coll Sci & Engn, Div Informat & Comp Technol, Doha 5825, Qatar
关键词
Servers; Energy consumption; Training; Data models; Computational modeling; Resource management; Performance evaluation; Federated Edge Learning (FEEL); Edge Intelligence; Data selection; Learning Algorithm; Convergence rate; Resource allocation; COMMUNICATION;
D O I
10.1109/TNSE.2021.3100805
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In Federated edge learning (FEEL), energy-constrained devices at the network edge consume significant energy when training and uploading their local machine learning models, leading to a decrease in their lifetime. This work proposes novel solutions for energy-efficient FEEL by jointly considering local training data, available computation, and communications resources, and deadline constraints of FEEL rounds to reduce energy consumption. This paper considers a system model where the edge server is equipped with multiple antennas employing beamforming techniques to communicate with the local users through orthogonal channels. Specifically, we consider a problem that aims to find the optimal user's resources, including the fine-grained selection of relevant training samples, bandwidth, transmission power, beamforming weights, and processing speed with the goal of minimizing the total energy consumption given a deadline constraint on the communication rounds of FEEL. Then, we devise tractable solutions by first proposing a novel fine-grained training algorithm that excludes less relevant training samples and effectively chooses only the samples that improve the model's performance. After that, we derive closed-form solutions, followed by a Golden-Section-based iterative algorithm to find the optimal computation and communication resources that minimize energy consumption. Experiments using MNIST and CIFAR-10 datasets demonstrate that our proposed algorithms considerably outperform the state-of-the-art solutions as energy consumption decreases by 79% for MNIST and 73% for CIFAR-10 datasets.
引用
收藏
页码:3258 / 3271
页数:14
相关论文
共 50 条
  • [31] Robust learning from noisy web data for fine-Grained recognition
    Cai, Zhenhuang
    Xie, Guo-Sen
    Huang, Xingguo
    Huang, Dan
    Yao, Yazhou
    Tang, Zhenmin
    [J]. PATTERN RECOGNITION, 2023, 134
  • [32] Microlearner: A fine-grained Learning Optimizer for Big Data Workloads at Microsoft
    Jindal, Alekh
    Qiao, Shi
    Sen, Rathijit
    Patel, Hiren
    [J]. 2021 IEEE 37TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2021), 2021, : 2423 - 2434
  • [33] Fine-Grained Object Detection Using Transfer Learning and Data Augmentation
    Dalal, Rahul
    Moh, Teng-Sheng
    [J]. 2018 IEEE/ACM INTERNATIONAL CONFERENCE ON ADVANCES IN SOCIAL NETWORKS ANALYSIS AND MINING (ASONAM), 2018, : 893 - 896
  • [34] Construct Fine-grained Energy Big Data Using NILM Technology
    Liu, Yan
    Yuan, Ruiming
    Yang, Xiaokun
    Liu, Bo
    Zhang, Ruiqi
    [J]. 2021 3RD ASIA ENERGY AND ELECTRICAL ENGINEERING SYMPOSIUM (AEEES 2021), 2021, : 1160 - 1164
  • [35] Stochastic Edge Detection for Fine-Grained Progressive Precision
    Lee, Youngwook
    Kim, Kyung-Ki
    Kim, Yong-Bin
    Choi, Minsu
    [J]. 18TH INTERNATIONAL SOC DESIGN CONFERENCE 2021 (ISOCC 2021), 2021, : 119 - 120
  • [36] Multi-Grained Selection and Fusion for Fine-Grained Image Representation
    Jiang, Jianrong
    Wang, Hongxing
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [37] Lightweight and Fine-Grained Privacy-Preserving Data Aggregation Scheme in Edge Computing
    Li, Hongyang
    Cheng, Qingfeng
    Li, Xinghua
    Ma, Siqi
    Ma, Jianfeng
    [J]. IEEE SYSTEMS JOURNAL, 2022, 16 (02): : 1832 - 1841
  • [38] Fine-Grained Theoretical Analysis of Federated Zeroth-Order Optimization
    Chen, Jun
    Chen, Hong
    Gu, Bin
    Deng, Hao
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [39] Representation Learning for Fine-Grained Change Detection
    O'Mahony, Niall
    Campbell, Sean
    Krpalkova, Lenka
    Carvalho, Anderson
    Walsh, Joseph
    Riordan, Daniel
    [J]. SENSORS, 2021, 21 (13)
  • [40] GRAPH FINE-GRAINED CONTRASTIVE REPRESENTATION LEARNING
    Tang, Hui
    Liang, Xun
    Guo, Yuhui
    Zheng, Xiangping
    Wu, Bo
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 3478 - 3482