TAIM: Ternary Activation In-Memory Computing Hardware with 6T SRAM Array

被引:1
|
作者
Kang, Nameun [1 ]
Kim, Hyungjun [1 ,2 ]
Oh, Hyunmyung [1 ]
Kim, Jae-Joon [3 ]
机构
[1] POSTECH, Pohang, South Korea
[2] SqueezeBits Inc, Seoul, South Korea
[3] Seoul Natl Univ, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
Deep Neural Network; In-Memory Computing; Ternary Activation;
D O I
10.1145/3489517.3530574
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, various in-memory computing accelerators for low precision neural networks have been proposed. While in-memory Binary Neural Network (BNN) accelerators achieved significant energy efficiency, BNNs show severe accuracy degradation compared to their full precision counterpart models. To mitigate the problem, we propose TAIM, an in-memory computing hardware that can support ternary activation with negligible hardware overhead. In TAIM, a 6T SRAM cell can compute the multiplication between ternary activation and binary weight. Since the 6T SRAM cell consumes no energy when the input activation is 0, the proposed TAIM hardware can achieve even higher energy efficiency compared to BNN case by exploiting input 0's. We fabricated the proposed TAIM hardware in 28nm CMOS process and evaluated the energy efficiency on various image classification benchmarks. The experimental results show that the proposed TAIM hardware can achieve 3.61x higher energy efficiency on average
引用
收藏
页码:1081 / 1086
页数:6
相关论文
共 50 条
  • [31] The rise of memtransistors for neuromorphic hardware and In-memory computing
    Bae, Jihong
    Won, Jongbum
    Shim, Wooyoung
    NANO ENERGY, 2024, 126
  • [32] In-Memory Computing Architecture for Efficient Hardware Security
    Ajmi, Hala
    Zayer, Fakhreddine
    Belgacem, Hamdi
    arXiv,
  • [33] Stability Analysis of 6T SRAM at Deep Cryogenic Temperature for Quantum Computing Applications
    Kim, Seong-Beom
    Mani, Aarthy
    Xu, Leong
    Victor, Heng
    Zheng, Yuanjin
    Anh Tuan Do
    2023 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS, 2023,
  • [34] A 12T SRAM in-Memory Computing differential current architecture for CNN implementations
    Domenech-Asensi, Gines
    Ruiz-Merino, Ramon
    Zapata-Perez, Juan
    Diaz-Madrid, Jose A.
    2023 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS, 2023,
  • [35] Robust and High-Performance 12-T Interlocked SRAM for In-Memory Computing
    Surana, Neelam
    Lavania, Mili
    Barma, Abhishek
    Mekie, Joycee
    PROCEEDINGS OF THE 2020 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2020), 2020, : 1323 - 1326
  • [36] Preliminary Defect Analysis of 8T SRAM Cells for In-Memory Computing Architectures
    Ammoura, L.
    Flottes, M. L.
    Girard, P.
    Virazel, A.
    2021 16TH INTERNATIONAL CONFERENCE ON DESIGN & TECHNOLOGY OF INTEGRATED SYSTEMS IN NANOSCALE ERA (DTIS 2021), 2021,
  • [37] An In-Memory Computing SRAM Macro for Memory-Augmented Neural Network
    Kim, Sunghoon
    Lee, Wonjae
    Kim, Sundo
    Park, Sungjin
    Jeon, Dongsuk
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2022, 69 (03) : 1687 - 1691
  • [38] Memory Sizing of a Scalable SRAM In-Memory Computing Tile Based Architecture
    Gauchi, R.
    Kooli, M.
    Vivet, P.
    Noel, J. -P.
    Beigne, E.
    Mitra, S.
    Charles, H. -P.
    2019 IFIP/IEEE 27TH INTERNATIONAL CONFERENCE ON VERY LARGE SCALE INTEGRATION (VLSI-SOC), 2019, : 166 - 171
  • [39] PVC-RAM:Process Variation Aware Charge Domain In-Memory Computing 6T-SRAM for DNNs
    Shubham, Sai
    Pandit, Shubham
    Prasad, Kailash
    Mekie, Joycee
    2023 60TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC, 2023,
  • [40] A crossbar array of magnetoresistive memory devices for in-memory computing
    Seungchul Jung
    Hyungwoo Lee
    Sungmeen Myung
    Hyunsoo Kim
    Seung Keun Yoon
    Soon-Wan Kwon
    Yongmin Ju
    Minje Kim
    Wooseok Yi
    Shinhee Han
    Baeseong Kwon
    Boyoung Seo
    Kilho Lee
    Gwan-Hyeob Koh
    Kangho Lee
    Yoonjong Song
    Changkyu Choi
    Donhee Ham
    Sang Joon Kim
    Nature, 2022, 601 : 211 - 216