Equilibrium Propagation and (Memristor-based) Oscillatory Neural Networks

被引:4
|
作者
Zoppo, Gianluca [1 ]
Marrone, Francesco [1 ]
Bonnin, Michele [1 ]
Corinto, Fernando [1 ]
机构
[1] Politecn Torino, Dept Elect & Telecommun, Turin, Italy
关键词
Associative Memory; Equilibrium Propagation; Kuramoto; Memristor; Oscillatory Neural Networks;
D O I
10.1109/ISCAS48785.2022.9937762
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Weakly Connected Oscillatory Networks (WCONs) are bio-inspired models which exhibit associative memory properties and can be exploited for information processing. It has been shown that the nonlinear dynamics of WCONs can be reduced to equations for the phase variable if oscillators admit stable limit cycles with nearly identical periods. Moreover, if connections are symmetric, the phase deviation equation admits a gradient formulation establishing a one-to-one correspondence between phase equilibria, limit cycle of the WCON and minima of the system's potential function. The overall objective of this work is to provide a simulated WCON based on memristive connections and Van der Pol oscillators that exploits the device mem-conductance programmability to implement a novel local supervised learning algorithm for gradient models: Equilibrium Propagation (EP). Simulations of the phase dynamics of the WCON system trained with EP show that the retrieval accuracy of the proposed novel design outperforms the current state-of-the-art performance obtained with the Hebbian learning.
引用
收藏
页码:639 / 643
页数:5
相关论文
共 50 条
  • [1] Equilibrium Propagation for Memristor-Based Recurrent Neural Networks
    Zoppo, Gianluca
    Marrone, Francesco
    Corinto, Fernando
    [J]. FRONTIERS IN NEUROSCIENCE, 2020, 14
  • [2] Memristor-based neural networks
    Thomas, Andy
    [J]. JOURNAL OF PHYSICS D-APPLIED PHYSICS, 2013, 46 (09)
  • [3] Advances in Memristor-Based Neural Networks
    Xu, Weilin
    Wang, Jingjuan
    Yan, Xiaobing
    [J]. FRONTIERS IN NANOTECHNOLOGY, 2021, 3
  • [4] Memristor-Based Binarized Spiking Neural Networks
    Eshraghian, Jason K.
    Wang, Xinxin
    Lu, Wei D.
    [J]. IEEE NANOTECHNOLOGY MAGAZINE, 2022, 16 (02) : 14 - 23
  • [5] Offline Training for Memristor-based Neural Networks
    Boquet, Guillem
    Macias, Edwar
    Morell, Antoni
    Serrano, Javier
    Miranda, Enrique
    Lopez Vicario, Jose
    [J]. 28TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2020), 2021, : 1547 - 1551
  • [6] Improved Vertex Coloring With NbOx Memristor-Based Oscillatory Networks
    Weiher, Martin
    Herzig, Melanie
    Tetzlaff, Ronald
    Ascoli, Alon
    Mikolajick, Thomas
    Slesazeck, Stefan
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2021, 68 (05) : 2082 - 2095
  • [7] Memristor-based Neuromorphic Implementations for Artificial Neural Networks
    Zhao, Chun
    Zhou, Guang You
    Zhao, Ce Zhou
    Yang, Li
    Man, Ka Lok
    Lim, Eng Gee
    [J]. 2018 INTERNATIONAL SOC DESIGN CONFERENCE (ISOCC), 2018, : 174 - 175
  • [8] Multisynchronization of a class of delayed memristor-based neural networks
    Lin, Ya-Qi
    Ge, Ming-Feng
    Ding, Teng-Fei
    Zhu, Ziqi
    He, Juanjuan
    [J]. PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 5509 - 5513
  • [9] Hardware implementation of memristor-based artificial neural networks
    Aguirre, Fernando
    Sebastian, Abu
    Le Gallo, Manuel
    Song, Wenhao
    Wang, Tong
    Yang, J. Joshua
    Lu, Wei
    Chang, Meng-Fan
    Ielmini, Daniele
    Yang, Yuchao
    Mehonic, Adnan
    Kenyon, Anthony
    Villena, Marco A.
    Roldan, Juan B.
    Wu, Yuting
    Hsu, Hung-Hsi
    Raghavan, Nagarajan
    Sune, Jordi
    Miranda, Enrique
    Eltawil, Ahmed
    Setti, Gianluca
    Smagulova, Kamilya
    Salama, Khaled N.
    Krestinskaya, Olga
    Yan, Xiaobing
    Ang, Kah-Wee
    Jain, Samarth
    Li, Sifan
    Alharbi, Osamah
    Pazos, Sebastian
    Lanza, Mario
    [J]. NATURE COMMUNICATIONS, 2024, 15 (01)
  • [10] Memristor-based chaotic neural networks for associative memory
    Shukai Duan
    Yi Zhang
    Xiaofang Hu
    Lidan Wang
    Chuandong Li
    [J]. Neural Computing and Applications, 2014, 25 : 1437 - 1445