FedHD: Federated Learning with Hyperdimensional Computing

被引:5
|
作者
Zhao, Quanling [1 ]
Lee, Kai [1 ]
Liu, Jeffrey [1 ]
Huzaifa, Muhammad [1 ]
Yu, Xiaofan [1 ]
Rosing, Tajana [1 ]
机构
[1] Univ Calif San Diego, Dept Comp Sci & Engn, La Jolla, CA 92093 USA
基金
美国国家科学基金会;
关键词
D O I
10.1145/3495243.3558757
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Federated Learning (FL) is a widely adopted distributed learning paradigm for to its privacy-preserving and collaborative nature. In FL, each client trains and sends a local model to the central cloud for aggregation. However, FL systems using neural network (NN) models are expensive to deploy on constrained edge devices regarding computation and communication. In this demo, we present FedHD, a FL system using Hyperdimensional Computing (HDC). In contrast to NN, HDC is a brain-inspired and lightweight computing paradigm using high-dimensional vectors and associative memory. Our measurements indicate that FedHD is 3.2x, 3.2x, 5x better on performance, energy and communication efficiency respectively compared to NN-based FL systems whilst maintaining similar accuracy to the state of the art. Our code is available on GitHub(1).
引用
收藏
页码:791 / 793
页数:3
相关论文
共 50 条
  • [1] HyperFeel: An Efficient Federated Learning Framework Using Hyperdimensional Computing
    Li, Haomin
    Liu, Fangxin
    Chen, Yichi
    Jiang, Li
    [J]. 29TH ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE, ASP-DAC 2024, 2024, : 716 - 721
  • [2] On Hyperdimensional Computing-based Federated Learning: A Case Study
    Zhang, Sizhe
    Ma, Dongning
    Bian, Song
    Yang, Lei
    Jiao, Xun
    [J]. 2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [3] HDFL: Private and Robust Federated Learning using Hyperdimensional Computing
    Kasyap, Harsh
    Tripathy, Somanath
    Conti, Mauro
    [J]. 2023 IEEE 22ND INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS, TRUSTCOM, BIGDATASE, CSE, EUC, ISCI 2023, 2024, : 214 - 221
  • [4] FL-HDC: Hyperdimensional Computing Design for the Application of Federated Learning
    Hsieh, Cheng-Yen
    Chuang, Yu-Chuan
    Wu, An-Yeu Andy
    [J]. 2021 IEEE 3RD INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS), 2021,
  • [5] Few-shot Federated Learning in Randomized Neural Networks via Hyperdimensional Computing
    Rosato, Antonello
    Panella, Massimo
    Osipov, Evgeny
    Kleyko, Denis
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [6] FedHD: Communication-efficient federated learning from hybrid data
    Gao, Haiqing
    Ge, Songyang
    Chang, Tsung-Hui
    [J]. JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2023, 360 (12): : 8416 - 8454
  • [7] Symbolic Representation and Learning With Hyperdimensional Computing
    Mitrokhin, Anton
    Sutor, Peter
    Summers-Stay, Douglas
    Fermueller, Cornelia
    Aloimonos, Yiannis
    [J]. FRONTIERS IN ROBOTICS AND AI, 2020, 7
  • [8] A Binary Learning Framework for Hyperdimensional Computing
    Imani, Mohsen
    Messerly, John
    Wu, Fan
    Pi, Wang
    Rosing, Tajana
    [J]. 2019 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE), 2019, : 126 - 131
  • [9] Invited Paper: Hyperdimensional Computing for Resilient Edge Learning
    Barkam, Hamza Errahmouni
    Jeon, SungHeon Eavn
    Yun, Sanggeon
    Yeung, Calvin
    Zou, Zhuowen
    Jiao, Xun
    Srinivasa, Narayan
    Imani, Mohsen
    [J]. 2023 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED DESIGN, ICCAD, 2023,
  • [10] LeHDC: Learning-Based Hyperdimensional Computing Classifier
    Duan, Shijin
    Liu, Yejia
    Ren, Shaolei
    Xu, Xiaolin
    [J]. PROCEEDINGS OF THE 59TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC 2022, 2022, : 1111 - 1116