Towards Current-Mode Analog Implementation of Deep Neural Network Functions

被引:1
|
作者
Wang, Shihao [1 ]
AL-Tamimi, Karama M. [1 ]
Hammad, Issam [1 ]
El-Sankary, Kamal [1 ]
机构
[1] Dalhousie Univ, Elect & Comp Engn, Halifax, NS, Canada
关键词
Current-mode; Deep Neural Network(DNN); ReLU; Softmax; Weight multiplier; LOW-POWER;
D O I
10.1109/NEWCAS52662.2022.9842017
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a current-mode analog circuit design that operates in the subthreshold region to implement various Deep Neural Network (DNN) functions. The implemented circuit blocks include binary weight multiplier layer, Rectified Linear Unit (ReLU), and approximate Softmax layer. The proposed designs were implemented using 180nm CMOS technology with a 1.5V power supply. Furthermore, the impact of the proposed design on accuracy was simulated using the MNIST dataset. Using a four layers Convolutional Neural Network (CNN) with an 8 bits resolution, the design achieved an accuracy of 99.02% with 68.21uW power consumption, which is 35.65% lower than the existing analog DNN design.
引用
收藏
页码:322 / 326
页数:5
相关论文
共 50 条
  • [1] PROGRAMMABLE CURRENT-MODE NEURAL NETWORK FOR IMPLEMENTATION IN ANALOG MOS-VLSI
    BORGSTROM, TH
    ISMAIL, M
    BIBYK, SB
    [J]. IEE PROCEEDINGS-G CIRCUITS DEVICES AND SYSTEMS, 1990, 137 (02): : 175 - 184
  • [2] A CURRENT-MODE CELLULAR NEURAL-NETWORK IMPLEMENTATION
    VARRIENTOS, JE
    SANCHEZSINENCIO, E
    RAMIREZANGULO, J
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 1993, 40 (03) : 147 - 155
  • [3] A current-mode approach to CMOS neural network implementation
    Watanabe, K
    Wang, L
    Cha, HW
    Ogawa, S
    [J]. ICA(3)PP 97 - 1997 3RD INTERNATIONAL CONFERENCE ON ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, 1997, : 625 - 637
  • [4] New design of current-mode neural network
    [J]. 2000, Hunan University, China (27):
  • [5] An analog current-mode 2-D DCT implementation
    Pänkäälä, M
    Poikonen, J
    Vesalainen, L
    Paasio, A
    [J]. 22ND NORCHIP CONFERENCE, PROCEEDINGS, 2004, : 245 - 248
  • [6] CURRENT-MODE ANALOG DEFUZZIFIER
    PELAYO, FJ
    ROJAS, I
    ORTEGA, J
    PRIETO, A
    [J]. ELECTRONICS LETTERS, 1993, 29 (09) : 743 - 744
  • [7] A current-mode analog VLSI implementation of a fly elementary motion detector
    Harrison, RR
    Koch, C
    [J]. PROCEEDINGS OF THE 4TH JOINT SYMPOSIUM ON NEURAL COMPUTATION, VOL 7, 1997, : 108 - 114
  • [8] CMOS Current-Mode Implementation of Fractional-Power Functions
    Lin, Kuo-Jen
    Cheng, Chih-Jen
    Chiu, Shun-Feng
    Su, Hsin-Cheng
    [J]. CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2012, 31 (01) : 61 - 75
  • [9] Current mode analog Kohonen neural network
    Talaska, T.
    Dlugosz, R.
    Wojtyna, R.
    [J]. MIXDES 2007: PROCEEDINGS OF THE 14TH INTERNATIONAL CONFERENCE ON MIXED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS:, 2007, : 250 - 255
  • [10] CMOS Current-Mode Implementation of Fractional-Power Functions
    Kuo-Jen Lin
    Chih-Jen Cheng
    Shun-Feng Chiu
    Hsin-Cheng Su
    [J]. Circuits, Systems, and Signal Processing, 2012, 31 : 61 - 75