Joint Optimization for Federated Learning Over the Air

被引:0
|
作者
Fan, Xin [1 ]
Wang, Yue [2 ]
Huo, Yan [1 ]
Tian, Zhi [2 ]
机构
[1] Beijing Jiaotong Univ, Sch Elect & Informat Engn, Beijing, Peoples R China
[2] George Mason Univ, Dept Elect & Comp Engn, Fairfax, VA USA
基金
美国国家科学基金会; 北京市自然科学基金; 中国国家自然科学基金;
关键词
Federated learning; analog aggregation; convergence analysis; joint optimization; worker scheduling; power scaling;
D O I
10.1109/ICC45855.2022.9838269
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
In this paper, we focus on federated learning (FL) over the air based on analog aggregation transmission in realistic wireless networks. We first derive a closed-form expression for the expected convergence rate of FL over the air, which theoretically quantifies the impact of analog aggregation on FL. Based on that, we further develop a joint optimization model for accurate FL implementation, which allows a parameter server to select a subset of edge devices and determine an appropriate power scaling factor. Such a joint optimization of device selection and power control for FL over the air is then formulated as an mixed integer programming problem. Finally, we efficiently solve this problem via a simple finite-set search method. Simulation results show that the proposed solutions developed for wireless channels outperform a benchmark method, and could achieve comparable performance of the ideal case where FL is implemented over reliable and error-free wireless channels.
引用
收藏
页码:2798 / 2803
页数:6
相关论文
共 50 条
  • [41] Joint Optimization of Energy Consumption and Completion Time in Federated Learning
    Zhou, Xinyu
    Zhao, Jun
    Han, Huimei
    Guet, Claude
    2022 IEEE 42ND INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS 2022), 2022, : 1005 - 1017
  • [42] Decentralized Federated Learning via MIMO Over-the-Air Computation: Consensus Analysis and Performance Optimization
    Zhai, Zhiyuan
    Yuan, Xiaojun
    Wang, Xin
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (09) : 11847 - 11862
  • [43] On-Device Federated Learning via Second-Order Optimization with Over-the-Air Computation
    Hua, Sheng
    Yang, Kai
    Shi, Yuanming
    2019 IEEE 90TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2019-FALL), 2019,
  • [44] Federated Edge Learning With Misaligned Over-the-Air Computation
    Shao, Yulin
    Gunduz, Deniz
    Liew, Soung Chang
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (06) : 3951 - 3964
  • [45] Over-the-Air Federated Learning Exploiting Channel Perturbation
    Hamidi, Shayan Mohajer
    Mehrabi, Mohammad
    Khandani, Amir K.
    Gunduz, Deniz
    2022 IEEE 23RD INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATION (SPAWC), 2022,
  • [46] Over-the-Air Federated Learning via Weighted Aggregation
    Azimi-Abarghouyi, Seyed Mohammad
    Tassiulas, Leandros
    IEEE Transactions on Wireless Communications, 2024, 23 (12) : 18240 - 18253
  • [47] Joint Resource Allocation and Learning Optimization for UAV-Assisted Federated Learning
    Liu, Chaoyi
    Zhu, Qi
    APPLIED SCIENCES-BASEL, 2023, 13 (06):
  • [48] Federated Edge Learning with Misaligned Over-The-Air Computation
    Shao, Yulin
    Gunduz, Deniz
    Liew, Soung Chang
    SPAWC 2021: 2021 IEEE 22ND INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (IEEE SPAWC 2021), 2020, : 236 - 240
  • [49] Asynchronous Federated Learning via Over-the-air Computation
    Zheng, Zijian
    Deng, Yansha
    Liu, Xiaonan
    Nallanathan, Arumugam
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 1345 - 1350
  • [50] Over-the-Air Federated Learning from Heterogeneous Data
    Sery, Tomer
    Shlezinger, Nir
    Cohen, Kobi
    Eldar, Yonina
    IEEE Transactions on Signal Processing, 2021, 69 : 3796 - 3811