Communication-efficient Distributed Learning in V2X Networks: Parameter Selection and Quantization

被引:1
|
作者
Barbieri, Luca [1 ]
Savazzi, Stefano [2 ]
Nicoli, Monica [1 ]
机构
[1] Politecn Milan, Milan, Italy
[2] CNR, Milan, Italy
关键词
Federated Learning; Connected automated driving; V2X; Artificial Intelligence; Distributed processing; BLOCKCHAIN; INTERNET;
D O I
10.1109/GLOBECOM48099.2022.10001364
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, automotive systems have been integrating Federated Learning (FL) tools to provide enhanced driving functionalities, exploiting sensor data at connected vehicles to cooperatively learn assistance information for safety and maneuvering systems. Conventional FL policies require a central coordinator, namely a Parameter Server (PS), to orchestrate the learning process which limits the scalability and robustness of the training platform. Consensus-driven FL methods, on the other hand, enable fully decentralized learning implementations where vehicles mutually share the Machine Learning (ML) model parameters, possibly via Vehicle-to-Everything (V2X) networking, at the expense of larger communication resource consumption compared to vanilla FL approaches. This paper proposes a communication-efficient consensus-driven FL design tailored for the training of Deep Neural Networks (DNN) in vehicular networks. The vehicles taking part in the FL process independently select a pre-determined percentage of model parameters to be quantized and exchanged on each training round. The proposed technique is validated on a cooperative sensing use case where vehicles rely on Lidar point clouds to detect possible road objects/users in their surroundings via DNN. The validation considers latency, accuracy and communication efficiency trade-offs. Experimental results highlight the impact of parameter selection and quantization on the communication overhead in varying settings.
引用
收藏
页码:603 / 608
页数:6
相关论文
共 50 条
  • [1] An Efficient Deep Reinforcement Learning Based Distributed Channel Multiplexing Framework for V2X Communication Networks
    Hu, Run
    Wang, Xinguo
    Su, Yuyuan
    Yang, Bin
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS AND COMPUTER ENGINEERING (ICCECE), 2021, : 154 - 160
  • [2] Communication-Efficient Multi-Agent Actor-Critic Framework For Distributed Optimization Of Resource Allocation in V2X Networks
    Hammami, Nessrine
    Kim Khoa Nguyen
    [J]. ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 3066 - 3071
  • [3] Double Quantization for Communication-Efficient Distributed Optimization
    Yu, Yue
    Wu, Jiaxiang
    Huang, Longbo
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [4] Double Quantization for Communication-Efficient Distributed Optimization
    Huang, Longbo
    [J]. PROCEEDINGS OF THE 13TH EAI INTERNATIONAL CONFERENCE ON PERFORMANCE EVALUATION METHODOLOGIES AND TOOLS ( VALUETOOLS 2020), 2020, : 2 - 2
  • [5] Guest Editorial Communication-Efficient Distributed Learning Over Networks
    Cao, Xuanyu
    Basar, Tamer
    Diggavi, Suhas
    Eldar, Yonina C.
    Letaief, Khaled B.
    Poor, H. Vincent
    Zhang, Junshan
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (04) : 845 - 850
  • [6] DQ-SGD: Dynamic Quantization in SGD for Communication-Efficient Distributed Learning
    Yan, Guangfeng
    Huang, Shao-Lun
    Lan, Tian
    Song, Linqi
    [J]. 2021 IEEE 18TH INTERNATIONAL CONFERENCE ON MOBILE AD HOC AND SMART SYSTEMS (MASS 2021), 2021, : 136 - 144
  • [7] Communication-Efficient Federated Learning with Adaptive Quantization
    Mao, Yuzhu
    Zhao, Zihao
    Yan, Guangfeng
    Liu, Yang
    Lan, Tian
    Song, Linqi
    Ding, Wenbo
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2022, 13 (04)
  • [8] Learning-based Adaptive Quantization for Communication-efficient Distributed Optimization with ADMM
    Nghiem, Truong X.
    Duarte, Aldo
    Wei, Shuangqing
    [J]. 2020 54TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2020, : 37 - 41
  • [9] Localization in V2X Communication Networks
    Ghods, Alireza
    Severi, Stefano
    Abreu, Giuseppe
    [J]. 2016 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2016, : 5 - 9
  • [10] Communication-Efficient Distributed Learning: An Overview
    Cao, Xuanyu
    Basar, Tamer
    Diggavi, Suhas
    Eldar, Yonina C.
    Letaief, Khaled B.
    Poor, H. Vincent
    Zhang, Junshan
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (04) : 851 - 873