Efficient asynchronous federated neuromorphic learning of spiking neural networks

被引:2
|
作者
Wang, Yuan [1 ]
Duan, Shukai [1 ]
Chen, Feng [1 ]
机构
[1] Southwest Univ, Coll Artificial Intelligence, Chongqing 400715, Peoples R China
关键词
Asynchronous federated learning; Spiking Neural Network; Average spike rate; Model stalenss; POWER;
D O I
10.1016/j.neucom.2023.126686
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Spiking Neural Networks (SNNs) can be trained on resource-constrained devices at low computational costs. There has been little attention to training them on a large-scale distributed system like federated learning. Federated Learning (FL) can be exploited to perform collaborative training for higher accuracy, involving multiple resource-constrained devices. In this paper, we introduce SNNs into asynchronous federated learning (AFL), which adapts to the statistical heterogeneity of users and complex communication environments. A novel fusion weight based on information age and average spike rate is designed, which aims to reduce the impact of model staleness. Numerical experiments validate SNNs on federated learning with MNIST, FashionMNIST, CIFAR10 and SVHN benchmarks, achieving better accuracy and desirable convergence under Non-IID settings.
引用
收藏
页数:8
相关论文
共 50 条
  • [21] A Survey of Neuromorphic Computing Based on Spiking Neural Networks
    ZHANG Ming
    GU Zonghua
    PAN Gang
    ChineseJournalofElectronics, 2018, 27 (04) : 667 - 674
  • [22] Evolving Ensembles of Spiking Neural Networks for Neuromorphic Systems
    Elbrecht, Daniel
    Kulkarni, Shruti R.
    Parsa, Maryam
    Mitchell, J. Parker
    Schuman, Catherine D.
    2020 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2020, : 1989 - 1994
  • [23] Advancements in Algorithms and Neuromorphic Hardware for Spiking Neural Networks
    Javanshir, Amirhossein
    Thanh Thi Nguyen
    Mahmud, M. A. Parvez
    Kouzani, Abbas Z.
    NEURAL COMPUTATION, 2022, 34 (06) : 1289 - 1328
  • [24] A Survey of Neuromorphic Computing Based on Spiking Neural Networks
    Zhang Ming
    Gu Zonghua
    Pan Gang
    CHINESE JOURNAL OF ELECTRONICS, 2018, 27 (04) : 667 - 674
  • [25] Benchmarking Deep Spiking Neural Networks on Neuromorphic Hardware
    Ostrau, Christoph
    Homburg, Jonas
    Klarhorst, Christian
    Thies, Michael
    Rueckert, Ulrich
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2020, PT II, 2020, 12397 : 610 - 621
  • [26] Resilience and Robustness of Spiking Neural Networks for Neuromorphic Systems
    Schuman, Catherine D.
    Mitchell, J. Parker
    Johnston, J. Travis
    Parsa, Maryam
    Kay, Bill
    Date, Prasanna
    Patton, Robert M.
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [27] A Bibliometric Review of Neuromorphic Computing and Spiking Neural Networks
    Pritchard, Nicholas J.
    Wicenec, Andreas
    Bennamoun, Mohammed
    Dodson, Richard
    arXiv, 2023,
  • [28] Community detection with spiking neural networks for neuromorphic hardware
    Hamilton, Kathleen E.
    Imam, Neena
    Humble, Travis S.
    PROCEEDINGS OF NEUROMORPHIC COMPUTING SYMPOSIUM (NCS 2017), 2017,
  • [29] Autonomous driving controllers with neuromorphic spiking neural networks
    Halaly, Raz
    Tsur, Elishai Ezra
    FRONTIERS IN NEUROROBOTICS, 2023, 17
  • [30] Reinforcement co-Learning of Deep and Spiking Neural Networks for Energy-Efficient Mapless Navigation with Neuromorphic Hardware
    Tang, Guangzhi
    Kumar, Neelesh
    Michmizos, Konstantinos P.
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 6090 - 6097