Stochastic memristive devices for low cost learning of spatiotemporal signals in spiking neural networks

被引:0
|
作者
Fida, Aabid Amin [1 ]
Mittal, Sparsh [1 ]
机构
[1] Electronics and Communication Engineering, Indian Institute of Technology, Uttrakhand, Roorkee, India
来源
Engineering Research Express | 2024年 / 6卷 / 04期
关键词
Computer circuits - Intelligent systems - Memristors - Neurons - Random access storage - Recurrent neural networks;
D O I
10.1088/2631-8695/ad9a3e
中图分类号
学科分类号
摘要
Resistive switching devices are an excellent candidate for dedicated neural network hardware. They offer extremely low-power in-memory computing substrates for edge computing tasks like health monitoring. But, the imprecise and random conductance changes in these devices make deploying neural networks on such hardware significantly challenging. In this regard, biological random networks, known as liquid state machines (LSM), can be helpful. Using them as inspiration we can utilize the imprecise nature of the switching process for a low-cost training approach to learning in spiking recurrent neural networks. We rely on the inherent non-determinism associated with the conductance states in memristive devices to initialize the random weight matrices within a memristive LSM. We also utilize the randomness of the resistive states to introduce heterogeneity in the neuron parameters. The significance of the proposed approach is evaluated using arrhythmia and seizure detection edge computing tasks. For classification tasks using two datasets, our approach reduces the number of computational operations in the backward pass by factors of up to 66 × for the MIT-BIH arrhythmia dataset and 74 × for the CHB-MIT epileptic seizure dataset. The heterogeneity improves the network performance. We also show that our approach is resilient to write noise in memristive devices. © 2024 IOP Publishing Ltd. All rights, including for text and data mining, AI training, and similar technologies, are reserved.
引用
收藏
相关论文
共 50 条
  • [21] Low Cost Interconnected Architecture for the Hardware Spiking Neural Networks
    Luo, Yuling
    Wan, Lei
    Liu, Junxiu
    Harkin, Jim
    McDaid, Liam
    Cao, Yi
    Ding, Xuemei
    FRONTIERS IN NEUROSCIENCE, 2018, 12
  • [22] Stochastic Deep Learning in Memristive Networks
    Babu, Anakha V.
    Rajendran, Bipin
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONICS, CIRCUITS AND SYSTEMS (ICECS), 2017, : 214 - 217
  • [23] Skeleton-supported stochastic networks of organic memristive devices: Adaptations and learning
    Erokhina, Svetlana
    Sorokin, Vladimir
    Erokhin, Victor
    AIP ADVANCES, 2015, 5 (02):
  • [24] Bioplausible Unsupervised Delay Learning for Extracting Spatiotemporal Features in Spiking Neural Networks
    Nadafian, Alireza
    Ganjtabesh, Mohammad
    NEURAL COMPUTATION, 2024, 36 (07) : 1332 - 1352
  • [25] Simulation of Bayesian Learning and Inference on Distributed Stochastic Spiking Neural Networks
    Ahmed, Khadeer
    Shrestha, Amar
    Qiu, Qinru
    2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 1044 - 1051
  • [26] Imitation learning with spiking neural networks and real-world devices
    Burgsteiner, Harald
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2006, 19 (07) : 741 - 752
  • [27] Analog memristive devices based on La2NiO4+ δ as synapses for spiking neural networks
    Khuu, Thoai-Khanh
    Koroleva, Aleksandra
    Degreze, Arnaud
    Vatajelu, Elena-Ioana
    Lefevre, Gauthier
    Jimenez, Carmen
    Blonkowski, Serge
    Jalaguier, Eric
    Bsiesy, Ahmad
    Burriel, Monica
    JOURNAL OF PHYSICS D-APPLIED PHYSICS, 2024, 57 (10)
  • [28] Accelerating Spiking Neural Networks using Memristive Crossbar Arrays
    Bohnstingl, Thomas
    Pantazi, Angeliki
    Eleftheriou, Evangelos
    2020 27TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONICS, CIRCUITS AND SYSTEMS (ICECS), 2020,
  • [29] Non-linear Memristive Synaptic Dynamics for Efficient Unsupervised Learning in Spiking Neural Networks
    Brivio, Stefano
    Ly, Denys R. B.
    Vianello, Elisa
    Spiga, Sabina
    FRONTIERS IN NEUROSCIENCE, 2021, 15
  • [30] Artificial neural networks based on memristive devices
    Vignesh RAVICHANDRAN
    Can LI
    Ali BANAGOZAR
    J.Joshua YANG
    Qiangfei XIA
    Science China(Information Sciences), 2018, 61 (06) : 145 - 158