Latency-Efficient Wireless Federated Learning With Quantization and Scheduling

被引:8
|
作者
Yan, Zhigang [1 ]
Li, Dong [1 ]
Yu, Xianhua [1 ]
Zhang, Zhichao [2 ,3 ]
机构
[1] Macau Univ Sci & Technol, Sch Comp Sci & Engn, Macau, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Math & Stat, Nanjing 210044, Peoples R China
[3] Macau Univ Sci & Technol, Sch Comp Sci & Engn, Macau, Peoples R China
关键词
Quantization (signal); Upper bound; Training; Optimal scheduling; Bandwidth; Resource management; Mathematical models; Federated learning; quantization; scheduling; channel and power allocation; convergence analysis; RESOURCE-ALLOCATION;
D O I
10.1109/LCOMM.2022.3199490
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Federated learning (FL) protects data privacy through local training and parameter aggregation. However, there is no need that all users are required to train their local models, and the parameter needs to be quantized via wireless channels in practice. In this letter, we investigate and analyze how to improve the model prediction accuracy with the system latency guarantee. Specifically, our goal is to minimize the loss function under the latency constraint by taking the parameter quantization, user scheduling, and channel bandwidth and transmit power into account. To make the optimization problem tractable, we first derive an upper bound on the loss function with joint quantization and scheduling and an upper bound on the number of bits for parameter aggregation, and then solve the reformulated problem based on the derived upper bounds to obtain closed-form expressions for the quantization level, the scheduling number, the optimized bandwidth and power allocation. Simulation results confirm the convergence and the effectiveness of the proposed algorithm.
引用
收藏
页码:2621 / 2625
页数:5
相关论文
共 50 条
  • [1] Latency-efficient Data Collection Scheduling in Battery-free Wireless Sensor Networks
    Zhu, Tongxin
    Li, Jianzhong
    Gao, Hong
    Li, Yingshu
    ACM TRANSACTIONS ON SENSOR NETWORKS, 2020, 16 (03)
  • [2] Joint Device Scheduling and Resource Allocation for Latency Constrained Wireless Federated Learning
    Shi, Wenqi
    Zhou, Sheng
    Niu, Zhisheng
    Jiang, Miao
    Geng, Lu
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (01) : 453 - 467
  • [3] On Latency-Efficient Transmission Scheduling for In-Network Data Aggregation in Duty-Cycled Wireless Sensor Networks
    Sun Chengting
    Wang Zhen
    INTERNATIONAL JOURNAL OF FUTURE GENERATION COMMUNICATION AND NETWORKING, 2016, 9 (05): : 83 - 97
  • [4] RIS-Aided Latency-Efficient MEC HetNet With Wireless Backhaul
    Wang, Yiyao
    Niu, Jinping
    Chen, Gaojie
    Zhou, Xiangwei
    Li, Yanyan
    Liu, Shiwei
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (06) : 8705 - 8719
  • [5] FEDERATED-LEARNING-BASED CLIENT SCHEDULING FOR LOW-LATENCY WIRELESS COMMUNICATIONS
    Xia, Wenchao
    Wen, Wanli
    Wong, Kai-Kit
    Quek, Tony Q. S.
    Zhang, Jun
    Zhu, Hongbo
    IEEE WIRELESS COMMUNICATIONS, 2021, 28 (02) : 32 - 38
  • [6] Quantization Bits Allocation for Wireless Federated Learning
    Lan, Muhang
    Ling, Qing
    Xiao, Song
    Zhang, Wenyi
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (11) : 8336 - 8351
  • [7] PrimCast: A Latency-Efficient Atomic Multicast
    Pacheco, Leandro
    Coelho, Paulo
    Pedone, Fernando
    PROCEEDINGS OF THE 24TH ACM/IFIP INTERNATIONAL MIDDLEWARE CONFERENCE, MIDDLEWARE 2023, 2023, : 124 - 136
  • [8] Efficient asynchronous federated learning with sparsification and quantization
    Jia, Juncheng
    Liu, Ji
    Zhou, Chendi
    Tian, Hao
    Dong, Mianxiong
    Dou, Dejing
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2024, 36 (09):
  • [9] Clustered Scheduling and Communication Pipelining for Efficient Resource Management of Wireless Federated Learning
    Kececi, Cihat
    Shaqfeh, Mohammad
    Al-Qahtani, Fawaz
    Ismail, Muhammad
    Serpedin, Erchin
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (15) : 13303 - 13316
  • [10] Wireless Federated Learning With Dynamic Quantization and Bandwidth Adaptation
    Feng, Wenjun
    Zhang, Xian
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2022, 11 (11) : 2335 - 2339