Resource-Aware Split Federated Learning for Edge Intelligence

被引:0
|
作者
Arouj, Amna [1 ]
Abdelmoniem, Ahmed M. [1 ]
Alhilal, Ahmad [2 ]
You, Linlin [3 ]
Wang, Chen [4 ]
机构
[1] Queen Mary Univ London, London, England
[2] Hong Kong Univ Sci & Tech, Hong Kong, Peoples R China
[3] Sun Yat Sen Univ, Guangzhou, Peoples R China
[4] Huazhong Univ Sci & Technol, Wuhan, Peoples R China
关键词
Federated Learning; Heterogeneity; Resource-Aware; Offloading;
D O I
10.1109/SenSys-ML62579.2024.00008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This research investigates Federated Learning (FL) systems, wherein multiple edge devices cooperate to train a collective machine learning model using their locally distributed data. The focus is on addressing energy consumption challenges in battery-constrained devices and mitigating the negative impact of intensive on-device computations during the training phase. In the widespread adoption of FL, variations in clients' computational capabilities and battery levels lead to system stragglers/dropouts, causing a decline in training quality. To enhance FL's energy efficiency, we propose EAFL+, a pioneering cloud-edge-terminal collaborative approach. EAFL+ introduces a novel architectural design aimed at achieving power-aware FL training by capitalizing on resource diversity and computation offloading. It facilitates the efficient selection of an approximately-optimal offloading target from Cloud-tier, Edge-tier, and Terminal-tier resources, optimizing the cost-quality tradeoff for participating client devices in the FL process. The presented algorithm minimizes the dropouts during training, enhancing participation rates and amplifying clients' contributions, resulting in better accuracy and convergence. Through experiments conducted on FL datasets and traces within a simulated FL environment, we find EAFL+ eradicates client drop-outs and enhances accuracy by up to 24% compared to state-of-the-art methods.
引用
收藏
页码:15 / 20
页数:6
相关论文
共 50 条
  • [31] An Overview of Federated Learning in Edge Intelligence
    Zhang X.
    Liu Y.
    Liu J.
    Han Y.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2023, 60 (06): : 1276 - 1295
  • [32] Decentralized Edge Intelligence: A Dynamic Resource Allocation Framework for Hierarchical Federated Learning
    Lim, Wei Yang Bryan
    Ng, Jer Shyuan
    Xiong, Zehui
    Jin, Jiangming
    Zhang, Yang
    Niyato, Dusit
    Leung, Cyril
    Miao, Chunyan
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (03) : 536 - 550
  • [33] Resource-aware policies
    Bottoni, Paolo
    Fish, Andrew
    Heussner, Alexander
    Presicce, Francesco Parisi
    JOURNAL OF VISUAL LANGUAGES AND COMPUTING, 2017, 38 : 84 - 96
  • [34] Resource-aware metacomputing
    Acharya, A
    Ranganathan, M
    Saltz, J
    CONCURRENCY-PRACTICE AND EXPERIENCE, 1997, 9 (06): : 649 - 674
  • [35] DISTREAL: Distributed Resource-Aware Learning in Heterogeneous Systems
    Rapp, Martin
    Khalili, Ramin
    Pfeiffer, Kilian
    Henkel, Joerg
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 8062 - 8071
  • [36] Straggler-aware Federated Learning based on Adaptive Clustering to Support Edge Intelligence
    Liu, Yi-Jing
    Feng, Gang
    Du, Hongyang
    Qin, Zheng
    Sun, Yao
    Kang, Jiawen
    Niyato, Dusit
    ICC 2024 - IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2024, : 1867 - 1872
  • [37] Importance-aware data selection and resource allocation for hierarchical federated edge learning
    Qiang, Xianke
    Hu, Yun
    Chang, Zheng
    Hamalainen, Timo
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 154 : 35 - 44
  • [38] Importance-Aware Data Selection and Resource Allocation in Federated Edge Learning System
    He, Yinghui
    Ren, Jinke
    Yu, Guanding
    Yuan, Jiantao
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (11) : 13593 - 13605
  • [39] Towards Resource-aware DNN Partitioning for Edge Devices with Heterogeneous Resources
    Zawish, Muhammad
    Abraham, Lizy
    Dev, Kapal
    Davy, Steven
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 5649 - 5655
  • [40] Cognitive resource-aware unobtrusive service provisioning in ambient intelligence environments
    Jimenez-Molina, Angel
    Ko, In-Young
    JOURNAL OF AMBIENT INTELLIGENCE AND SMART ENVIRONMENTS, 2015, 7 (01) : 37 - 57