Joint Optimization for Federated Learning Over the Air

被引:0
|
作者
Fan, Xin [1 ]
Wang, Yue [2 ]
Huo, Yan [1 ]
Tian, Zhi [2 ]
机构
[1] Beijing Jiaotong Univ, Sch Elect & Informat Engn, Beijing, Peoples R China
[2] George Mason Univ, Dept Elect & Comp Engn, Fairfax, VA USA
基金
美国国家科学基金会; 北京市自然科学基金; 中国国家自然科学基金;
关键词
Federated learning; analog aggregation; convergence analysis; joint optimization; worker scheduling; power scaling;
D O I
10.1109/ICC45855.2022.9838269
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
In this paper, we focus on federated learning (FL) over the air based on analog aggregation transmission in realistic wireless networks. We first derive a closed-form expression for the expected convergence rate of FL over the air, which theoretically quantifies the impact of analog aggregation on FL. Based on that, we further develop a joint optimization model for accurate FL implementation, which allows a parameter server to select a subset of edge devices and determine an appropriate power scaling factor. Such a joint optimization of device selection and power control for FL over the air is then formulated as an mixed integer programming problem. Finally, we efficiently solve this problem via a simple finite-set search method. Simulation results show that the proposed solutions developed for wireless channels outperform a benchmark method, and could achieve comparable performance of the ideal case where FL is implemented over reliable and error-free wireless channels.
引用
收藏
页码:2798 / 2803
页数:6
相关论文
共 50 条
  • [31] Inverse Feasibility in Over-the-Air Federated Learning
    Piotrowski, Tomasz
    Ismayilov, Rafail
    Frey, Matthias
    Cavalcante, Renato L. G.
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 1434 - 1438
  • [32] Hierarchical Over-the-Air Federated Edge Learning
    Aygun, Ozan
    Kazemi, Mohammad
    Gunduz, Deniz
    Duman, Tolga M.
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 3376 - 3381
  • [33] COTAF: Convergent Over-the-Air Federated Learning
    Sery, Tomer
    Shlezinger, Nir
    Cohen, Kobi
    Eldar, Yonina C.
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [34] Over-the-Air Computation for Vertical Federated Learning
    Zeng, Xiangyu
    Xia, Shuhao
    Yang, Kai
    Wu, Youlong
    Shi, Yuanming
    2022 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2022, : 788 - 793
  • [35] A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks
    Chen, Mingzhe
    Yang, Zhaohui
    Saad, Walid
    Yin, Changchuan
    Poor, H. Vincent
    Cui, Shuguang
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (01) : 269 - 283
  • [36] Joint learning and optimization for Federated Learning in NOMA-based networks
    Mrad, Ilyes
    Hamila, Ridha
    Erbad, Aiman
    Gabbouj, Moncef
    PERVASIVE AND MOBILE COMPUTING, 2023, 89
  • [37] Performance Optimization of Federated Learning over Wireless Networks
    Chen, Mingzhe
    Yang, Zhaohui
    Saad, Walid
    Yin, Changchuan
    Poor, H. Vincent
    Cui, Shuguang
    2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [38] Joint Energy and Latency Optimization in Federated Learning over Cell-Free Massive MIMO Networks
    Mahmoudi, Afsaneh
    Zaher, Mahmoud
    Bjornson, Emil
    2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,
  • [39] Distributed Joint Resource Optimization for Federated Learning Task Distribution
    Zhang, Chaofeng
    Dong, Mianxiong
    Ota, Kaoru
    IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2023, 7 (03): : 1457 - 1471
  • [40] Efficient Federated Learning via Joint Communication and Computation Optimization
    Wang, Gang
    Zhao, Chenguang
    Qi, Qi
    Han, Rui
    Bai, Lin
    Choi, Jinho
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (08) : 11580 - 11592