Digital Implementation of On-Chip Hebbian Learning for Oscillatory Neural Network

被引:0
|
作者
Luhulima, Edgar [1 ]
Abernot, Madeleine [2 ]
Corradi, Federico [1 ]
Todri-Sanial, Aida [1 ,2 ]
机构
[1] Eindhoven Univ Technol, Eindhoven, Netherlands
[2] Univ Montpellier, CNRS, LIRMM, Montpellier, France
关键词
Artificial intelligence; auto-associative memory; pattern recognition; oscillatory neural network; FPGA implementation; Hebbian learning;
D O I
10.1109/ISLPED58423.2023.10244501
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This work proposes a digital implementation of an Oscillatory Neural Network (ONN) in a Field-Programmable Gate Array (FPGA), demonstrating excellent associative memory capabilities. This work goes beyond previous implementations by enabling on-chip learning directly in the FPGA. More specifically, we implement on-chip Hebbian learning, and we compare three different design strategies. The first strategy takes advantage of a System-on-Chip (SoC) composed of a Processing System (PS) and Programmable Logic resources (PL) to integrate Hebbian learning in PS. The two other strategies implement the Hebbian learning directly in PL. We compare the three different design strategies on a digit recognition task in terms of accuracy, utilization, execution time, and maximum frequency. We show that implementing Hebbian learning in PL gives more advantages in terms of resource utilization and latency than implementing Hebbian in PS with several orders of magnitude because the weight matrix computation is performed in hardware. Moreover, we develop an application interface to demonstrate the pattern learning and recognition capabilities of our digital ONN implementation.
引用
收藏
页数:6
相关论文
共 50 条
  • [31] Analog VLSI Implementation of Artificial Neural Networks with Supervised On-Chip Learning
    Maurizio Valle
    Analog Integrated Circuits and Signal Processing, 2002, 33 : 263 - 287
  • [32] Analog VLSI implementation of artificial neural networks with supervised on-chip learning
    Valle, M
    ANALOG INTEGRATED CIRCUITS AND SIGNAL PROCESSING, 2002, 33 (03) : 263 - 287
  • [33] Oscillatory Hebbian Rule (OHR): An adaption of the Hebbian rule to Oscillatory Neural Networks
    Shamsi, Jafar
    Jose Avedillo, Maria
    Linares-Barranco, Bernabe
    Serrano-Gotarredona, Teresa
    2020 XXXV CONFERENCE ON DESIGN OF CIRCUITS AND INTEGRATED SYSTEMS (DCIS), 2020,
  • [34] Implementation and evaluation of on-chip network architectures
    Gratz, Paul
    Kim, Changkyu
    McDonald, Rober
    Keckler, Stephen W.
    Burger, Doug
    PROCEEDINGS 2006 INTERNATIONAL CONFERENCE ON COMPUTER DESIGN, 2007, : 477 - +
  • [35] Design and implementation of the Quarc Network on-Chip
    Moadeli, M.
    Maji, P. P.
    Vanderbauwhede, W.
    2009 IEEE INTERNATIONAL SYMPOSIUM ON PARALLEL & DISTRIBUTED PROCESSING, VOLS 1-5, 2009, : 2882 - +
  • [36] Implementation of a neuro-fuzzy network with on-chip learning and its applications
    Lin, Cheng-Jian
    Lee, Chi-Yung
    EXPERT SYSTEMS WITH APPLICATIONS, 2011, 38 (01) : 673 - 681
  • [37] Continuous neural network with windowed Hebbian learning
    M. Fotouhi
    M. Heidari
    M. Sharifitabar
    Biological Cybernetics, 2015, 109 : 321 - 332
  • [38] Continuous neural network with windowed Hebbian learning
    Fotouhi, M.
    Heidari, M.
    Sharifitabar, M.
    BIOLOGICAL CYBERNETICS, 2015, 109 (03) : 321 - 332
  • [39] A CMOS feedforward neural-network chip with on-chip parallel learning for oscillation cancellation
    Liu, J
    Brooke, MA
    Hirotsu, K
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13 (05): : 1178 - 1186
  • [40] Mapping Hebbian Learning Rules to Coupling Resistances for Oscillatory Neural Networks
    Delacour, Corentin
    Todri-Sanial, Aida
    FRONTIERS IN NEUROSCIENCE, 2021, 15