HNMC: Hybrid Near-Memory Computing Circuit for Neural Network Acceleration

被引:0
|
作者
Liu, Xiyan [1 ]
Liu, Qiang [1 ]
机构
[1] Tianjin Univ, Sch Microelect, Tianjin Key Lab Imaging & Sensing Microelect Techn, Tianjin 300072, Peoples R China
基金
中国国家自然科学基金;
关键词
Circuits; Table lookup; Delays; Random access memory; Optimization; Xenon; Neural networks; Near-memory computing; SRAM; look-up table; multiplier; neural networks; MULTIPLICATION;
D O I
10.1109/TCSII.2024.3403830
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The state-of-the-art lookup table (LUT)-based solution usually requires large-size memory which hampers the implementation of a high speed and small area computing scheme. To minimize the area while achieving a fast speed, this brief presents a hybrid near-memory computing (HNMC) circuit with a new LUT reduction technique to accelerate the LUT-based multiplication in neural network. Experimental results show that compared to the 4-bit multipliers based on pure LUT, pure logic and near-memory computing (NMC) circuits, the multiplier based on HNMC reduces up to 75% delay, 81% area and 80% power consumption; the 8-bit convolution engine based on HNMC increases throughput by 2x and reduces area up to 77% and power consumption up to 40% compared to the state-of-the-art NMC convolution engine.
引用
收藏
页码:4763 / 4767
页数:5
相关论文
共 50 条
  • [1] Near-Memory Acceleration for Radio Astronomy
    Fiorin, Leandro
    Jongerius, Rik
    Vermij, Erik
    van Lunteren, Jan
    Hagleitner, Christoph
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2018, 29 (01) : 115 - 128
  • [2] HeNCoG: A Heterogeneous Near-memory Computing Architecture for Energy Efficient GCN Acceleration
    Hwang, Seung-Eon
    Song, Duyeong
    Park, Jongsun
    2024 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS 2024, 2024,
  • [3] Exploiting Near-Memory Processing Architectures for Bayesian Neural Networks Acceleration
    Zhao, Yinglin
    Yang, Jianlei
    Jia, Xiaotao
    Wang, Xueyan
    Wang, Zhaohao
    Kang, Wang
    Zhang, Youguang
    Zhao, Weisheng
    2019 IEEE COMPUTER SOCIETY ANNUAL SYMPOSIUM ON VLSI (ISVLSI 2019), 2019, : 204 - 207
  • [4] Ultra Efficient Acceleration for De Novo Genome Assembly via Near-Memory Computing
    Zhou, Minxuan
    Wu, Lingxi
    Li, Muzhou
    Moshiri, Niema
    Skadron, Kevin
    Rosing, Tajana
    30TH INTERNATIONAL CONFERENCE ON PARALLEL ARCHITECTURES AND COMPILATION TECHNIQUES (PACT 2021), 2021, : 199 - 212
  • [5] RV-GEMM: Neural Network Inference Acceleration with Near-Memory GEMM Instructions on RISC-V
    Wang, Xingbo
    Feng, Chenxi
    Chen, Bingzhen
    Wang, Qi
    Huang, Yucong
    Ye, Terry Tao
    PROCEEDINGS OF THE 21ST ACM INTERNATIONAL CONFERENCE ON COMPUTING FRONTIERS 2024, CF 2024, 2024, : 302 - 305
  • [6] Challenges and Opportunities: From Near-memory Computing to In-memory Computing
    Khoram, Soroosh
    Zha, Yue
    Zhang, Jialiang
    Li, Jing
    ISPD'17: PROCEEDINGS OF THE 2017 ACM INTERNATIONAL SYMPOSIUM ON PHYSICAL DESIGN, 2017, : 43 - 46
  • [7] NMPO: Near-Memory Computing Profiling and Offloading
    Corda, Stefano
    Kumaraswamy, Madhurya
    Awan, Ahsan Javed
    Jordans, Roel
    Kumar, Akash
    Corporaal, Henk
    2021 24TH EUROMICRO CONFERENCE ON DIGITAL SYSTEM DESIGN (DSD 2021), 2021, : 259 - 267
  • [8] Near-memory computing: Past, present, and future
    Singh, Gagandeep
    Chelini, Lorenzo
    Corda, Stefano
    Awan, Ahsan Javed
    Stuijk, Sander
    Jordans, Roel
    Corporaal, Henk
    Boonstra, Albert-Jan
    MICROPROCESSORS AND MICROSYSTEMS, 2019, 71
  • [9] Concurrent Data Structures for Near-Memory Computing
    Liu, Zhiyu
    Calciu, Irina
    Herlihy, Maurice
    Mutlu, Onur
    PROCEEDINGS OF THE 29TH ACM SYMPOSIUM ON PARALLELISM IN ALGORITHMS AND ARCHITECTURES (SPAA'17), 2017, : 235 - 245
  • [10] Near-Memory and In-Storage FPGA Acceleration for Emerging Cognitive Computing Workloads (Invited Paper)
    Dhar, Ashutosh
    Huang, Sitao
    Xiong, Jinjun
    Jamsek, Damir
    Mesnet, Bruno
    Huang, Jian
    Kim, Nam Sung
    Hwu, Wen-mei
    Chen, Deming
    2019 IEEE COMPUTER SOCIETY ANNUAL SYMPOSIUM ON VLSI (ISVLSI 2019), 2019, : 68 - 75