Energy-Efficient Bayesian Inference Using Near-Memory Computation with Memristors

被引:0
|
作者
Turck, C. [1 ]
Harabi, K. -E. [1 ]
Hirtzlin, T. [2 ]
Vianello, E. [2 ]
Laurent, R. [3 ]
Droulez, J. [3 ]
Bessiere, P. [4 ]
Bocquet, M. [5 ]
Portal, J. -M. [5 ]
Querlioz, D. [1 ]
机构
[1] Univ Paris Saclay, CNRS, C2N, Palaiseau, France
[2] CEA, LETI, Grenoble, France
[3] Hawai Tech, Grenoble, France
[4] Sorbonne Univ, CNRS, ISIR, Paris, France
[5] Aix Marseille Univ, CNRS, IM2NP, Marseille, France
基金
欧洲研究理事会;
关键词
memristor; ASIC; Bayesian inference;
D O I
10.23919/DATE56975.2023.10137312
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Bayesian reasoning is a machine learning approach that provides explainable outputs and excels in small-data situations with high uncertainty. However, it requires intensive memory access and computation and is, therefore, too energy-intensive for extreme edge contexts. Near-memory computation with memristors (or RRAM) can greatly improve the energy efficiency of its computations. Here, we report two fabricated integrated circuits in a hybrid CMOS-memristor process, featuring each sixteen tiny memristor arrays and the associated near-memory logic for Bayesian inference. One circuit performs Bayesian inference using stochastic computing, and the other uses logarithmic computation; these two paradigms fit the area constraints of near-memory computing well. On-chip measurements show the viability of both approaches with respect to memristor imperfections. The two Bayesian machines also operated well at low supply voltages. We also designed scaled-up versions of the machines. Both scaled-up designs can perform a gesture recognition task using orders of magnitude less energy than a microcontroller unit. We also see that if an accuracy lower than 86.9% is sufficient for this sample task, stochastic computing consumes less energy than logarithmic computing; for higher accuracies, logarithmic computation is more energy-efficient. These results highlight the potential of memristor-based near-memory Bayesian computing, providing both accuracy and energy efficiency.
引用
收藏
页数:2
相关论文
共 50 条
  • [41] Energy-efficient acceleration of convolutional neural networks using computation reuse
    Ghanbari, Azam
    Modarressi, Mehdi
    JOURNAL OF SYSTEMS ARCHITECTURE, 2022, 126
  • [42] Energy-Efficient Approximate Edge Inference Systems
    Ghosh, Soumendu Kumar
    Raha, Arnab
    Raghunathan, Vijay
    ACM TRANSACTIONS ON EMBEDDED COMPUTING SYSTEMS, 2023, 22 (04)
  • [43] ALAMNI: Adaptive LookAside Memory Based Near-Memory Inference Engine for Eliminating Multiplications in Real-Time
    Das, Palash
    Sharma, Shashank
    Kapoor, Hemangee K.
    IEEE TRANSACTIONS ON COMPUTERS, 2023, 72 (03) : 693 - 706
  • [44] Energy-Efficient Computation Offloading in Cellular Networks
    Geng, Yeli
    Hu, Wenjie
    Yang, Yi
    Gao, Wei
    Cao, Guohong
    2015 IEEE 23RD INTERNATIONAL CONFERENCE ON NETWORK PROTOCOLS (ICNP), 2015, : 145 - 155
  • [45] Energy-Efficient Streaming Using Non-volatile Memory
    Mohammed G. Khatib
    Pieter H. Hartel
    Hylke W. van Dijk
    Journal of Signal Processing Systems, 2010, 60 : 149 - 168
  • [46] NEMO-CNN: An Efficient Near-Memory Accelerator for Convolutional Neural Networks
    Brown, Grant
    Tenace, Valerio
    Gaillardon, Pierre-Emmanuel
    2021 IEEE 32ND INTERNATIONAL CONFERENCE ON APPLICATION-SPECIFIC SYSTEMS, ARCHITECTURES AND PROCESSORS (ASAP 2021), 2021, : 57 - 60
  • [47] Energy-Efficient Computation Models for Distributed Systems
    Aikebaier, Ailixier
    Yang, Yan
    Enokido, Tomoya
    Takizawa, Makoto
    2009 INTERNATIONAL CONFERENCE ON NETWORK-BASED INFORMATION SYSTEMS, 2009, : 424 - +
  • [48] Energy-Efficient Streaming Using Non-volatile Memory
    Khatib, Mohammed G.
    Hartel, Pieter H.
    van Dijk, Hylke W.
    JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2010, 60 (02): : 149 - 168
  • [49] Energy-Efficient Organic Ferroelectric Tunnel Junction Memristors for Neuromorphic Computing
    Majumdar, Sayani
    Tan, Hongwei
    Qin, Qi Hang
    van Dijken, Sebastiaan
    ADVANCED ELECTRONIC MATERIALS, 2019, 5 (03):
  • [50] Work-in-Progress: Efficient Low-latency Near-Memory Addition
    Reaugh, Alexander
    Salehi, Sayed Ahmad
    2022 INTERNATIONAL CONFERENCE ON COMPILERS, ARCHITECTURE, AND SYNTHESIS FOR EMBEDDED SYSTEMS (CASES 2022), 2022, : 33 - 34