Stochastic memristive devices for low cost learning of spatiotemporal signals in spiking neural networks

被引:0
|
作者
Fida, Aabid Amin [1 ]
Mittal, Sparsh [1 ]
机构
[1] Electronics and Communication Engineering, Indian Institute of Technology, Uttrakhand, Roorkee, India
来源
Engineering Research Express | 2024年 / 6卷 / 04期
关键词
Computer circuits - Intelligent systems - Memristors - Neurons - Random access storage - Recurrent neural networks;
D O I
10.1088/2631-8695/ad9a3e
中图分类号
学科分类号
摘要
Resistive switching devices are an excellent candidate for dedicated neural network hardware. They offer extremely low-power in-memory computing substrates for edge computing tasks like health monitoring. But, the imprecise and random conductance changes in these devices make deploying neural networks on such hardware significantly challenging. In this regard, biological random networks, known as liquid state machines (LSM), can be helpful. Using them as inspiration we can utilize the imprecise nature of the switching process for a low-cost training approach to learning in spiking recurrent neural networks. We rely on the inherent non-determinism associated with the conductance states in memristive devices to initialize the random weight matrices within a memristive LSM. We also utilize the randomness of the resistive states to introduce heterogeneity in the neuron parameters. The significance of the proposed approach is evaluated using arrhythmia and seizure detection edge computing tasks. For classification tasks using two datasets, our approach reduces the number of computational operations in the backward pass by factors of up to 66 × for the MIT-BIH arrhythmia dataset and 74 × for the CHB-MIT epileptic seizure dataset. The heterogeneity improves the network performance. We also show that our approach is resilient to write noise in memristive devices. © 2024 IOP Publishing Ltd. All rights, including for text and data mining, AI training, and similar technologies, are reserved.
引用
收藏
相关论文
共 50 条
  • [41] STOCHASTIC SPIKING NEURAL NETWORKS AT THE EDGE OF CHAOS
    Rossello, J. L.
    Canals, V.
    Oliver, A.
    Morro, A.
    PROCEEDINGS OF THE 2014 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2014, : 2399 - 2406
  • [42] Analog synaptic devices applied to spiking neural networks for reinforcement learning applications
    Kim, Jangsaeng
    Lee, Soochang
    Kim, Chul-Heung
    Park, Byung-Gook
    Lee, Jong-Ho
    SEMICONDUCTOR SCIENCE AND TECHNOLOGY, 2022, 37 (07)
  • [43] On-Chip Error-Triggered Learning of Multi-Layer Memristive Spiking Neural Networks
    Payvand, Melika
    Fouda, Mohammed E.
    Kurdahi, Fadi
    Eltawil, Ahmed M.
    Neftci, Emre O.
    IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2020, 10 (04) : 522 - 535
  • [44] Exploiting memristive autapse and temporal distillation for training spiking neural networks
    Chen, Tao
    Duan, Shukai
    Wang, Lidan
    Knowledge-Based Systems, 2024, 305
  • [45] Design of NbOx memristive neuron and its application in spiking neural networks
    Gu Ya-Na
    Liang Yan
    Wang Guang-Yi
    Xia Chen-Yang
    ACTA PHYSICA SINICA, 2022, 71 (11)
  • [46] Learning algorithm for spiking neural networks
    Amin, HH
    Fujii, RH
    ADVANCES IN NATURAL COMPUTATION, PT 1, PROCEEDINGS, 2005, 3610 : 456 - 465
  • [47] Deep learning in spiking neural networks
    Tavanaei, Amirhossein
    Ghodrati, Masoud
    Kheradpisheh, Saeed Reza
    Masquelier, Timothee
    Maida, Anthony
    NEURAL NETWORKS, 2019, 111 : 47 - 63
  • [48] Spatiotemporal dynamics in spiking recurrent neural networks using modified-full-FORCE on EEG signals
    Georgios Ioannides
    Ioannis Kourouklides
    Alessandro Astolfi
    Scientific Reports, 12
  • [49] Supervised learning with spiking neural networks
    Xin, JG
    Embrechts, MJ
    IJCNN'01: INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2001, : 1772 - 1777
  • [50] Federated Learning With Spiking Neural Networks
    Venkatesha, Yeshwanth
    Kim, Youngeun
    Tassiulas, Leandros
    Panda, Priyadarshini
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2021, 69 : 6183 - 6194