Wireless Federated Learning over Resource-Constrained Networks: Digital versus Analog Transmissions

被引:0
|
作者
Yao J. [1 ]
Xu W. [1 ]
Yang Z. [2 ]
You X. [1 ]
Bennis M. [3 ]
Poor H.V. [4 ]
机构
[1] National Mobile Communications Research Laboratory (NCRL), Southeast University, Nanjing
[2] Zhejiang Lab, Hangzhou
[3] Center for Wireless Communications, Oulu University, Oulu
[4] Department of Electrical and Computer Engineering, Princeton University, NJ
基金
欧盟地平线“2020”; 美国国家科学基金会;
关键词
Computational modeling; Convergence; convergence analysis; digital communication; Federated learning (FL); Optimization; over-the-air computation (AirComp); Task analysis; Training; Uplink; Wireless networks;
D O I
10.1109/TWC.2024.3407822
中图分类号
学科分类号
摘要
To enable wireless federated learning (FL) in communication resource-constrained networks, two communication schemes, i.e., digital and analog ones, are effective solutions. In this paper, we quantitatively compare these two techniques, highlighting their essential differences as well as respectively suitable scenarios. We first examine both digital and analog transmission schemes, together with a unified and fair comparison framework under imbalanced device sampling, strict latency targets, and transmit power constraints. A universal convergence analysis under various imperfections is established for evaluating the performance of FL over wireless networks. These analytical results reveal that the fundamental difference between the digital and analog communications lies in whether communication and computation are jointly designed or not. The digital scheme decouples the communication design from FL computing tasks, making it difficult to support uplink transmission from massive devices with limited bandwidth and hence the performance is mainly communication-limited. In contrast, the analog communication allows over-the-air computation (AirComp) and achieves better spectrum utilization. However, the computation-oriented analog transmission reduces power efficiency, and its performance is sensitive to computation errors from imperfect channel state information (CSI). Furthermore, device sampling for both schemes are optimized and differences in sampling optimization are analyzed. Numerical results verify the theoretical analysis and affirm the superior performance of the sampling optimization. IEEE
引用
收藏
页码:1 / 1
相关论文
共 50 条
  • [31] Resource Allocation for Time-triggered Federated Learning over Wireless Networks
    Zhou, Xiaokang
    Deng, Yansha
    Xia, Huiyun
    Wu, Shaochuan
    Bennis, Mehdi
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 2810 - 2815
  • [32] Joint User Scheduling and Resource Allocation for Federated Learning over Wireless Networks
    Yin, Benshun
    Chen, Zhiyong
    Tao, Meixia
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [33] Resource Management and Model Personalization for Federated Learning over Wireless Edge Networks
    Balakrishnan, Ravikumar
    Akdeniz, Mustafa
    Dhakal, Sagar
    Anand, Arjun
    Zeira, Ariela
    Himayat, Nageen
    JOURNAL OF SENSOR AND ACTUATOR NETWORKS, 2021, 10 (01)
  • [34] A Federated Learning Framework for Resource Constrained Fog Networks
    Lalouani, Wassila
    Younis, Mohamed
    2022 27TH IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATIONS (IEEE ISCC 2022), 2022,
  • [35] Protocol-Agnostic Compression for Resource-Constrained Wireless Networks
    Massey, Travis L.
    Mehta, Ankur
    Watteyne, Thomas
    Pister, Kristofer S. J.
    2010 IEEE GLOBAL TELECOMMUNICATIONS CONFERENCE GLOBECOM 2010, 2010,
  • [36] Enabling Machine Learning on Resource-constrained Tactical Networks
    Perazzone, Jake
    Dwyer, Matthew
    Chan, Kevin
    Anderson, Cleon
    Brown, Scott
    2022 IEEE MILITARY COMMUNICATIONS CONFERENCE (MILCOM), 2022,
  • [37] RIS-Based Over-the-Air Channel Equalization in Resource-Constrained Wireless Networks
    Prod'homme, Hugo
    Imani, Mohammadreza F.
    Abadal, Sergi
    del Hougne, Philipp
    2024 18TH EUROPEAN CONFERENCE ON ANTENNAS AND PROPAGATION, EUCAP, 2024,
  • [38] Reinforcement Learning for Real-Time Federated Learning for Resource-Constrained Edge Cluster
    Rajashekar, Kolichala
    Paul, Souradyuti
    Karmakar, Sushanta
    Sidhanta, Subhajit
    JOURNAL OF NETWORK AND SYSTEMS MANAGEMENT, 2024, 32 (04)
  • [39] Efficient federated learning on resource-constrained edge devices based on model pruning
    Wu, Tingting
    Song, Chunhe
    Zeng, Peng
    COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (06) : 6999 - 7013
  • [40] Unleashing Edgeless Federated Learning With Analog Transmissions
    Yang, Howard H.
    Chen, Zihan
    Quek, Tony Q. S.
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2024, 72 : 774 - 791