Stochastic memristive devices for low cost learning of spatiotemporal signals in spiking neural networks

被引:0
|
作者
Fida, Aabid Amin [1 ]
Mittal, Sparsh [1 ]
机构
[1] Electronics and Communication Engineering, Indian Institute of Technology, Uttrakhand, Roorkee, India
来源
Engineering Research Express | 2024年 / 6卷 / 04期
关键词
Computer circuits - Intelligent systems - Memristors - Neurons - Random access storage - Recurrent neural networks;
D O I
10.1088/2631-8695/ad9a3e
中图分类号
学科分类号
摘要
Resistive switching devices are an excellent candidate for dedicated neural network hardware. They offer extremely low-power in-memory computing substrates for edge computing tasks like health monitoring. But, the imprecise and random conductance changes in these devices make deploying neural networks on such hardware significantly challenging. In this regard, biological random networks, known as liquid state machines (LSM), can be helpful. Using them as inspiration we can utilize the imprecise nature of the switching process for a low-cost training approach to learning in spiking recurrent neural networks. We rely on the inherent non-determinism associated with the conductance states in memristive devices to initialize the random weight matrices within a memristive LSM. We also utilize the randomness of the resistive states to introduce heterogeneity in the neuron parameters. The significance of the proposed approach is evaluated using arrhythmia and seizure detection edge computing tasks. For classification tasks using two datasets, our approach reduces the number of computational operations in the backward pass by factors of up to 66 × for the MIT-BIH arrhythmia dataset and 74 × for the CHB-MIT epileptic seizure dataset. The heterogeneity improves the network performance. We also show that our approach is resilient to write noise in memristive devices. © 2024 IOP Publishing Ltd. All rights, including for text and data mining, AI training, and similar technologies, are reserved.
引用
收藏
相关论文
共 50 条
  • [31] Artificial neural networks based on memristive devices
    Vignesh Ravichandran
    Can Li
    Ali Banagozar
    J. Joshua Yang
    Qiangfei Xia
    Science China Information Sciences, 2018, 61
  • [32] Artificial neural networks based on memristive devices
    Ravichandran, Vignesh
    Li, Can
    Banagozar, Ali
    Yang, J. Joshua
    Xia, Qiangfei
    SCIENCE CHINA-INFORMATION SCIENCES, 2018, 61 (06)
  • [33] A progressive surrogate gradient learning for memristive spiking neural network
    王姝
    陈涛
    龚钰
    孙帆
    申思远
    段书凯
    王丽丹
    Chinese Physics B, 2023, (06) : 794 - 802
  • [34] A progressive surrogate gradient learning for memristive spiking neural network
    Wang, Shu
    Chen, Tao
    Gong, Yu
    Sun, Fan
    Shen, Si-Yuan
    Duan, Shu-Kai
    Wang, Li-Dan
    CHINESE PHYSICS B, 2023, 32 (06)
  • [35] Fast Spiking Neural Network architecture for low-cost FPGA devices
    Iakymchuk, Taras
    Rosado, Alfredo
    Frances, Jose V.
    Bataller, Manuel
    2012 7TH INTERNATIONAL WORKSHOP ON RECONFIGURABLE AND COMMUNICATION-CENTRIC SYSTEMS-ON-CHIP (RECOSOC), 2012,
  • [36] Analog Memristive Synapse in Spiking Networks Implementing Unsupervised Learning
    Covi, Erika
    Brivio, Stefano
    Serb, Alexander
    Prodromakis, Themis
    Fanciulli, Marco
    Spiga, Sabina
    FRONTIERS IN NEUROSCIENCE, 2016, 10
  • [37] Evolution of Plastic Learning in Spiking Networks via Memristive Connections
    Howard, Gerard
    Gale, Ella
    Bull, Larry
    Costello, Ben de Lacy
    Adamatzky, Andy
    IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2012, 16 (05) : 711 - 729
  • [38] Spatiotemporal coding in the cortex:: Information flow-based learning in spiking neural networks
    Deco, G
    Schürmann, B
    NEURAL COMPUTATION, 1999, 11 (04) : 919 - 934
  • [39] Learning delays through gradients and structure: emergence of spatiotemporal patterns in spiking neural networks
    Mészáros, Balázs
    Knight, James C.
    Nowotny, Thomas
    Frontiers in Computational Neuroscience, 2024, 18
  • [40] HARDWARE IMPLEMENTATION OF STOCHASTIC SPIKING NEURAL NETWORKS
    Rossello, Josep L.
    Canals, Vincent
    Morro, Antoni
    Oliver, Antoni
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2012, 22 (04)