SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligence

被引:45
|
作者
Fang, Wei [1 ,2 ,3 ]
Chen, Yanqi [1 ,2 ]
Ding, Jianhao [1 ]
Yu, Zhaofei [4 ]
Masquelier, Timothee [5 ]
Chen, Ding [2 ,6 ]
Huang, Liwei [1 ,2 ]
Zhou, Huihui [2 ]
Li, Guoqi [7 ,8 ]
Tian, Yonghong [1 ,2 ,3 ]
机构
[1] Peking Univ, Sch Comp Sci, Beijing, Peoples R China
[2] Peng Cheng Lab, Shenzhen, Peoples R China
[3] Peking Univ, Sch Elect & Comp Engn, Shenzhen Grad Sch, Beijing, Peoples R China
[4] Peking Univ, Inst Artificial Intelligence, Beijing, Peoples R China
[5] Univ Toulouse 3, Ctr Rech Cerveau & Cognit CERCO, CNRS, UMR5549, Toulouse, France
[6] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai, Peoples R China
[7] Chinese Acad Sci, Inst Automation, Beijing, Peoples R China
[8] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China
来源
SCIENCE ADVANCES | 2023年 / 9卷 / 40期
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
DEEP NEURAL-NETWORKS; CLASSIFICATION; BACKPROPAGATION; ACCURATE; NEURONS;
D O I
10.1126/sciadv.adi1480
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Spiking neural networks (SNNs) aim to realize brain-inspired intelligence on neuromorphic chips with high energy efficiency by introducing neural dynamics and spike properties. As the emerging spiking deep learning paradigm attracts increasing interest, traditional programming frameworks cannot meet the demands of the automatic differentiation, parallel computation acceleration, and high integration of processing neuromorphic datasets and deployment. In this work, we present the SpikingJelly framework to address the aforementioned dilemma. We contribute a full-stack toolkit for preprocessing neuromorphic datasets, building deep SNNs, optimizing their parameters, and deploying SNNs on neuromorphic chips. Compared to existing methods, the training of deep SNNs can be accelerated 11x, and the superior extensibility and flexibility of SpikingJelly enable users to accelerate custom models at low costs through multilevel inheritance and semiautomatic code generation. SpikingJelly paves the way for synthesizing truly energy-efficient SNN-based machine intelligence systems, which will enrich the ecology of neuromorphic computing.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] pyStudio: An Open-Source Machine Learning Platform
    Gomicia-Murcia, Enrique
    Bordel Sanchez, Borja
    Souissi, Riad
    AL-Qurishi, Muhammad
    [J]. PROCEEDINGS OF THE 2023 IEEE/ACM INTERNATIONAL CONFERENCE ON ADVANCES IN SOCIAL NETWORKS ANALYSIS AND MINING, ASONAM 2023, 2023, : 436 - 440
  • [2] pyNAVIS: An open-source cross-platform software for spike-based neuromorphic audio information processing
    Dominguez-Morales, Juan P.
    Gutierrez-Galan, D.
    Rios-Navarro, A.
    Duran-Lopez, L.
    Dominguez-Morales, M.
    Jimenez-Fernandez, A.
    [J]. NEUROCOMPUTING, 2021, 449 : 172 - 175
  • [3] Towards spike-based machine intelligence with neuromorphic computing
    Kaushik Roy
    Akhilesh Jaiswal
    Priyadarshini Panda
    [J]. Nature, 2019, 575 : 607 - 617
  • [4] Towards spike-based machine intelligence with neuromorphic computing
    Roy, Kaushik
    Jaiswal, Akhilesh
    Panda, Priyadarshini
    [J]. NATURE, 2019, 575 (7784) : 607 - 617
  • [5] Easy and efficient spike-based Machine Learning with mlGeNN
    Knight, James C.
    Nowotny, Thomas
    [J]. PROCEEDINGS OF THE 2023 ANNUAL NEURO-INSPIRED COMPUTATIONAL ELEMENTS CONFERENCE, NICE 2023, 2023, : 115 - 120
  • [6] Inquiry-Based Learning With RoboGen: An Open-Source Software and Hardware Platform for Robotics and Artificial Intelligence
    Auerbach, Joshua E.
    Concordel, Alice
    Kornatowski, Przemyslaw M.
    Floreano, Dario
    [J]. IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, 2019, 12 (03): : 356 - 369
  • [7] Qsun: an open-source platform towards practical quantum machine learning applications
    Quoc Chuong Nguyen
    Le Bin Ho
    Lan Nguyen Tran
    Nguyen, Hung Q.
    [J]. MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2022, 3 (01):
  • [8] An Open-source Based ITS Platform
    Andersen, Ove
    Krogh, Benjamin B.
    Torp, Kristian
    [J]. 2013 IEEE 14TH INTERNATIONAL CONFERENCE ON MOBILE DATA MANAGEMENT (MDM 2013), VOL 2, 2013, : 27 - 32
  • [9] SIBoLS: Robust and Energy-Efficient Learning for Spike-Based Machine Intelligence in Information Bottleneck Framework
    Yang, Shuangming
    Wang, Haowen
    Chen, Badong
    [J]. IEEE Transactions on Cognitive and Developmental Systems, 2024, 16 (05) : 1664 - 1676
  • [10] Effective Surrogate Gradient Learning With High-Order Information Bottleneck for Spike-Based Machine Intelligence
    Yang, Shuangming
    Chen, Badong
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, : 1 - 15