Stochastic memristive devices for low cost learning of spatiotemporal signals in spiking neural networks

被引:0
|
作者
Fida, Aabid Amin [1 ]
Mittal, Sparsh [1 ]
机构
[1] Electronics and Communication Engineering, Indian Institute of Technology, Uttrakhand, Roorkee, India
来源
Engineering Research Express | 2024年 / 6卷 / 04期
关键词
Computer circuits - Intelligent systems - Memristors - Neurons - Random access storage - Recurrent neural networks;
D O I
10.1088/2631-8695/ad9a3e
中图分类号
学科分类号
摘要
Resistive switching devices are an excellent candidate for dedicated neural network hardware. They offer extremely low-power in-memory computing substrates for edge computing tasks like health monitoring. But, the imprecise and random conductance changes in these devices make deploying neural networks on such hardware significantly challenging. In this regard, biological random networks, known as liquid state machines (LSM), can be helpful. Using them as inspiration we can utilize the imprecise nature of the switching process for a low-cost training approach to learning in spiking recurrent neural networks. We rely on the inherent non-determinism associated with the conductance states in memristive devices to initialize the random weight matrices within a memristive LSM. We also utilize the randomness of the resistive states to introduce heterogeneity in the neuron parameters. The significance of the proposed approach is evaluated using arrhythmia and seizure detection edge computing tasks. For classification tasks using two datasets, our approach reduces the number of computational operations in the backward pass by factors of up to 66 × for the MIT-BIH arrhythmia dataset and 74 × for the CHB-MIT epileptic seizure dataset. The heterogeneity improves the network performance. We also show that our approach is resilient to write noise in memristive devices. © 2024 IOP Publishing Ltd. All rights, including for text and data mining, AI training, and similar technologies, are reserved.
引用
收藏
相关论文
共 50 条
  • [1] Plasticity in memristive devices for spiking neural networks
    Saighi, Sylvain
    Mayr, Christian G.
    Serrano-Gotarredona, Teresa
    Schmidt, Heidemarie
    Lecerf, Gwendal
    Tomas, Jean
    Grollier, Julie
    Boyn, Soeren
    Vincent, Adrien F.
    Querlioz, Damien
    La Barbera, Selina
    Alibart, Fabien
    Vuillaume, Dominique
    Bichler, Olivier
    Gamrat, Christian
    Linares-Barranco, Bernabe
    FRONTIERS IN NEUROSCIENCE, 2015, 9
  • [2] Toward Reflective Spiking Neural Networks Exploiting Memristive Devices
    Makarov, Valeri A.
    Lobov, Sergey A.
    Shchanikov, Sergey
    Mikhaylov, Alexey
    Kazantsev, Viktor B.
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2022, 16
  • [3] On the learning of stochastic networks of organic memristive devices
    Erokhin, V. (victor.erokhin@fis.unipr.it), 1600, Old City Publishing (09): : 3 - 4
  • [5] Spiking neurons with spatiotemporal dynamics and gain modulation for monolithically integrated memristive neural networks
    Duan, Qingxi
    Jing, Zhaokun
    Zou, Xiaolong
    Wang, Yanghao
    Yang, Ke
    Zhang, Teng
    Wu, Si
    Huang, Ru
    Yang, Yuchao
    NATURE COMMUNICATIONS, 2020, 11 (01)
  • [6] Spiking neurons with spatiotemporal dynamics and gain modulation for monolithically integrated memristive neural networks
    Qingxi Duan
    Zhaokun Jing
    Xiaolong Zou
    Yanghao Wang
    Ke Yang
    Teng Zhang
    Si Wu
    Ru Huang
    Yuchao Yang
    Nature Communications, 11
  • [7] Effects of memristive synapse radiation interactions on learning in spiking neural networks
    Sumedha Gandharava Dahl
    Robert C. Ivans
    Kurtis D. Cantley
    SN Applied Sciences, 2021, 3
  • [8] Effects of memristive synapse radiation interactions on learning in spiking neural networks
    Dahl, Sumedha Gandharava
    Ivans, Robert C.
    Cantley, Kurtis D.
    SN APPLIED SCIENCES, 2021, 3 (05):
  • [9] Reinforcement Learning in Memristive Spiking Neural Networks through Modulation of ReSuMe
    Ji, Xun
    Zhang, Yaozhong
    Li, Chuxi
    Wu, Tanghong
    Hu, Xiaofang
    ADVANCES IN MATERIALS, MACHINERY, ELECTRONICS III, 2019, 2073
  • [10] Sneak Paths Effects in CBRAM Memristive Devices Arrays for Spiking Neural Networks
    Roclin, David
    Bichler, Olivier
    Gamrat, Christian
    Klein, Jacques-Olivier
    2014 IEEE/ACM INTERNATIONAL SYMPOSIUM ON NANOSCALE ARCHITECTURES (NANOARCH), 2014, : 13 - 18