Dynamic Hyperdimensional Computing for Improving Accuracy-Energy Efficiency Trade-offs

被引:7
|
作者
Chuang, Yu-Chuan [1 ]
Chang, Cheng-Yang [1 ]
Wu, An-Yeu Andy [1 ]
机构
[1] Natl Taiwan Univ, Grad Inst Elect Engn, Taipei, Taiwan
关键词
Brain-inspired computing; hyperdimensional computing; dynamic model; energy efficiency;
D O I
10.1109/sips50750.2020.9195216
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Brain-inspired Hyperdimensional (HD) computing is an emerging technique that computes with either binary or integer HD vectors. However, both vector representations confront an extreme trade-off between accuracy and energy efficiency. This issue limits the generalizability of HD computing for many applications. In this paper, we propose a threshold-based dynamic HD computing framework (TD-HDC) to improve the accuracy-energy efficiency trade-offs. Standard HD computing always executes the same processing flow regardless of input data. On the contrary, TD-HDC dynamically selects the execution path between the binary and integer HD models based on the classification difficulty of input data. In other words, TD-HDC utilizes both HD models and manages to efficiently allocate their computational resources. On the MNIST dataset, we demonstrate that our proposed framework is flexible and can reduce energy consumption and execution time by 51.3% and 15%, respectively, under the same accuracy level.
引用
收藏
页码:7 / 11
页数:5
相关论文
共 50 条
  • [1] Efficiency and accuracy trade-offs in process detection
    Giani, A
    [J]. SENSORS, AND COMMAND, CONTROL, COMMUNICATIONS, AND INTELLIGENCE(C31) TECHNOLOGIES FOR HOMELAND SECURITY AND HOMELAND DEFENSE III, PTS 1 AND 2, 2004, 5403 : 113 - 123
  • [2] Energy-Accuracy Trade-Offs for Resistive In-Memory Computing Architectures
    Roy, Saion K.
    Shanbhag, Naresh R.
    [J]. IEEE JOURNAL ON EXPLORATORY SOLID-STATE COMPUTATIONAL DEVICES AND CIRCUITS, 2024, 10 : 22 - 30
  • [3] Towards Approximate Computing for Achieving Energy vs. Accuracy Trade-offs
    Ometov, Aleksandr
    Nurmi, Jan
    [J]. PROCEEDINGS OF THE 2022 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2022), 2022, : 632 - 635
  • [4] Security and Efficiency Trade-offs for Cloud Computing and Storage
    Li, Jian
    Zhou, Kai
    Ren, Jian
    [J]. 2015 RESILIENCE WEEK (RSW), 2015, : 148 - 153
  • [5] Thermodynamics of accuracy in kinetic proofreading: dissipation and efficiency trade-offs
    Rao, Riccardo
    Peliti, Luca
    [J]. JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT, 2015,
  • [6] Accuracy vs efficiency trade-offs in optical flow algorithms
    Liu, HC
    Hong, TH
    Herman, M
    Camus, T
    Chellappa, R
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 1998, 72 (03) : 271 - 286
  • [7] Accuracy vs. efficiency trade-offs in probabilistic diagnosis
    Rish, I
    Brodie, M
    Ma, S
    [J]. EIGHTEENTH NATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE (AAAI-02)/FOURTEENTH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE (IAAI-02), PROCEEDINGS, 2002, : 560 - 566
  • [8] Spectral and Energy Efficiency Trade-offs in Cellular Networks
    Tsilimantos, Dimitrios
    Gorce, Jean-Marie
    Jaffres-Runser, Katia
    Poor, H. Vincent
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2016, 15 (01) : 54 - 66
  • [9] Supported-BinaryNet: Bitcell Array-based Weight Supportsfor Dynamic Accuracy-Energy Trade-offs in SRAM-based Binarized Neural Network
    Nasrin, Shamma
    Ramakrishna, Srikanth
    Tulabandhula, Theja
    Trivedi, Amit Ranjan
    [J]. 2020 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2020,
  • [10] Dynamic Deep Neural Networks: Optimizing Accuracy-Efficiency Trade-Offs by Selective Execution
    Liu, Lanlan
    Deng, Jia
    [J]. THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 3675 - 3682