An instruction systolic array architecture for neural networks

被引:3
|
作者
Kane, AJ
Evans, DJ
机构
[1] Parallel Algorithms Research Centre, Loughborough Univ. of Technology, Leicestershire
关键词
instruction systolic array; neural net; backpropagation;
D O I
10.1080/00207169608804500
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Modern electronic systems especially sensor and imaging systems, are beginning to incorporate their own neural network sub-systems. In order for these neural systems to learn in real-time they must be implemented using VLSI technology, with as much of the learning processes incorporated on-chip as is possible. Most VLSI implementations literally implement a series of neural processing cells, which can be connected together in an arbitrary fashion. The work presented here utilises two-dimensional instruction systolic arrays in an attempt to define a general neural architecture which is closer to the biological basis of neural networks-it is the synapses themselves, rather than the neurons, that have dedicated processing units. The architecture has been defined, along with a limited instruction set, and has been shown to operate correctly under simulation for the backpropagation training algorithm.
引用
收藏
页码:63 / 89
页数:27
相关论文
共 50 条
  • [1] THE INSTRUCTION SYSTOLIC ARRAY - A PARALLEL ARCHITECTURE FOR VLSI
    LANG, HW
    [J]. INTEGRATION-THE VLSI JOURNAL, 1986, 4 (01) : 65 - 74
  • [2] SaARSP: An Architecture for Systolic-Array Acceleration of Recurrent Spiking Neural Networks
    Lee, Jeong-Jun
    Zhang, Wenrui
    Xie, Yuan
    Li, Peng
    [J]. ACM JOURNAL ON EMERGING TECHNOLOGIES IN COMPUTING SYSTEMS, 2022, 18 (04)
  • [3] Configurable Multi-directional Systolic Array Architecture for Convolutional Neural Networks
    Xu, Rui
    Ma, Sheng
    Wang, Yaohua
    Chen, Xinhai
    Guo, Yang
    [J]. ACM TRANSACTIONS ON ARCHITECTURE AND CODE OPTIMIZATION, 2021, 18 (04)
  • [4] A systolic architecture for Hopfield neural networks
    Asgari, Hajar
    Kavian, Yousef S.
    Mahani, Ali
    [J]. CONFERENCE ON ELECTRONICS, TELECOMMUNICATIONS AND COMPUTERS - CETC 2013, 2014, 17 : 736 - 741
  • [5] A SYSTOLIC ARCHITECTURE DEDICATED TO NEURAL NETWORKS
    BLAYO, F
    HURAT, P
    [J]. NEURAL NETWORKS FROM MODELS TO APPLICATIONS, 1989, : 701 - 709
  • [6] SYSTOLIC ARRAY IMPLEMENTATION OF ARTIFICIAL NEURAL NETWORKS
    ASARI, KV
    ESWARAN, C
    [J]. MICROPROCESSORS AND MICROSYSTEMS, 1994, 18 (08) : 481 - 488
  • [7] A UNIFIED SYSTOLIC ARCHITECTURE FOR ARTIFICIAL NEURAL NETWORKS
    KUNG, SY
    HWANG, JN
    [J]. JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 1989, 6 (02) : 358 - 387
  • [8] Systolic architecture for higher order neural networks
    Bilski, J
    Smolag, J
    [J]. NEURAL NETWORKS AND SOFT COMPUTING, 2003, : 796 - 801
  • [9] Cambricon: An Instruction Set Architecture for Neural Networks
    Liu, Shaoli
    Du, Zidong
    Tao, Jinhua
    Han, Dong
    Luo, Tao
    Xie, Yuan
    Chent, Yunji
    Chent, Tianshi
    [J]. 2016 ACM/IEEE 43RD ANNUAL INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE (ISCA), 2016, : 393 - 405
  • [10] COSY: An Energy-Efficient Hardware Architecture for Deep Convolutional Neural Networks based on Systolic Array
    Yin, Chen
    Chen, Qiang
    Tian, Miren
    Ji, Mohan
    Zou, Chenglong
    Wang, Yin'an
    Wang, Bo
    [J]. 2017 IEEE 23RD INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS), 2017, : 180 - 189