TAIM: Ternary Activation In-Memory Computing Hardware with 6T SRAM Array

被引:1
|
作者
Kang, Nameun [1 ]
Kim, Hyungjun [1 ,2 ]
Oh, Hyunmyung [1 ]
Kim, Jae-Joon [3 ]
机构
[1] POSTECH, Pohang, South Korea
[2] SqueezeBits Inc, Seoul, South Korea
[3] Seoul Natl Univ, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
Deep Neural Network; In-Memory Computing; Ternary Activation;
D O I
10.1145/3489517.3530574
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, various in-memory computing accelerators for low precision neural networks have been proposed. While in-memory Binary Neural Network (BNN) accelerators achieved significant energy efficiency, BNNs show severe accuracy degradation compared to their full precision counterpart models. To mitigate the problem, we propose TAIM, an in-memory computing hardware that can support ternary activation with negligible hardware overhead. In TAIM, a 6T SRAM cell can compute the multiplication between ternary activation and binary weight. Since the 6T SRAM cell consumes no energy when the input activation is 0, the proposed TAIM hardware can achieve even higher energy efficiency compared to BNN case by exploiting input 0's. We fabricated the proposed TAIM hardware in 28nm CMOS process and evaluated the energy efficiency on various image classification benchmarks. The experimental results show that the proposed TAIM hardware can achieve 3.61x higher energy efficiency on average
引用
收藏
页码:1081 / 1086
页数:6
相关论文
共 50 条
  • [1] In-Memory Computing with 6T SRAM for Multi-operator Logic Design
    Dhakad, Narendra Singh
    Chittora, Eshika
    Raut, Gopal
    Sharma, Vishal
    Vishvakarma, Santosh Kumar
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2024, 43 (01) : 646 - 660
  • [2] In-Memory Computing with 6T SRAM for Multi-operator Logic Design
    Narendra Singh Dhakad
    Eshika Chittora
    Gopal Raut
    Vishal Sharma
    Santosh Kumar Vishvakarma
    Circuits, Systems, and Signal Processing, 2024, 43 : 646 - 660
  • [3] Area-Efficient and Variation-Tolerant In-Memory BNN Computing using 6T SRAM Array
    Kim, Jinseok
    Koo, Jongeun
    Kim, Taesu
    Kim, Yulhwa
    Kim, Hyungjun
    Yoo, Seunghyun
    Kim, Jae-Joon
    2019 SYMPOSIUM ON VLSI CIRCUITS, 2019, : C118 - C119
  • [4] Bit Parallel 6T SRAM In-memory Computing with Reconfigurable Bit-Precision
    Lee, Kyeongho
    Jeong, Jinho
    Cheon, Sungsoo
    Choi, Woong
    Park, Jongsun
    PROCEEDINGS OF THE 2020 57TH ACM/EDAC/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2020,
  • [5] A Low-Leakage 6T SRAM Cell for In-Memory Computing with High Stability
    Najafi, Deniz
    Ebrahimi, Behzad
    2021 29TH IRANIAN CONFERENCE ON ELECTRICAL ENGINEERING (ICEE), 2021, : 98 - 102
  • [6] IMAC: In-Memory Multi-Bit Multiplication and ACcumulation in 6T SRAM Array
    Ali, Mustafa
    Jaiswal, Akhilesh
    Kodge, Sangamesh
    Agrawal, Amogh
    Chakraborty, Indranil
    Roy, Kaushik
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2020, 67 (08) : 2521 - 2531
  • [7] In-Memory Computation of a Machine-Learning Classifier in a Standard 6T SRAM Array
    Zhang, Jintao
    Wang, Zhuo
    Verma, Naveen
    IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2017, 52 (04) : 915 - 924
  • [8] A Multi-Functional In-Memory Inference Processor Using a Standard 6T SRAM Array
    Kang, Mingu
    Gonugondla, Sujan K.
    Patil, Ameya
    Shanbhag, Naresh R.
    IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2018, 53 (02) : 642 - 655
  • [9] Low Power Ternary XNOR using 10T SRAM for In-Memory Computing
    Lee, Sanghyun
    Kim, Youngmin
    2022 19TH INTERNATIONAL SOC DESIGN CONFERENCE (ISOCC), 2022, : 352 - 353
  • [10] A 19.4 nJ/decision 364K decisions/s In-memory Random Forest Classifier in 6T SRAM Array
    Kang, Mingu
    Gonugondla, Sujan K.
    Shanbhag, Naresh R.
    ESSCIRC 2017 - 43RD IEEE EUROPEAN SOLID STATE CIRCUITS CONFERENCE, 2017, : 263 - 266