Assessing Robustness of Hyperdimensional Computing Against Errors in Associative Memory

被引:10
|
作者
Zhang, Sizhe [1 ]
Wang, Ruixuan [1 ]
Zhang, Jeff Jun [2 ]
Rahimi, Abbas [3 ]
Jiao, Xun [1 ]
机构
[1] Villanova Univ, Villanova, PA 19085 USA
[2] Harvard Univ, Cambridge, MA 02138 USA
[3] IBM Res Zurich, Zurich, Switzerland
关键词
VOLTAGE;
D O I
10.1109/ASAP52443.2021.00039
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Brain-inspired hyperdimensional computing (HDC) is an emerging computational paradigm that has achieved success in various domains. HDC mimics brain cognition and lever-ages hyperdimensional vectors with fully distributed holographic representation and (pseudo)randomness. Compared to the traditional machine learning methods, HDC offers several critical advantages, including smaller model size, less computation cost, and one-shot learning capability, making it a promising candidate in low-power platforms. Despite the growing popularity of HDC, the robustness of HDC models has not been systematically explored. This paper presents a study on the robustness of HDC to errors in associative memory-the key component storing the class representations in HDC. We perform extensive error injection experiments to the associative memory in a number of HDC models (and datasets), sweeping the error rates and varying HDC configurations (i.e., dimension and data width). Empirically, we observe that HDC is considerably robust to errors in the associative memory, opening up opportunities for further optimizations. Further, results show that HDC robustness varies significantly with different HDC configurations such as data width. Moreover, we explore a low-cost error masking mechanism in the associative memory to enhance its robustness.
引用
收藏
页码:211 / 217
页数:7
相关论文
共 50 条
  • [1] Exploring Hyperdimensional Associative Memory
    Imani, Mohsen
    Rahimi, Abbas
    Kong, Deqian
    Rosing, Tajana
    Rabaey, Jan M.
    [J]. 2017 23RD IEEE INTERNATIONAL SYMPOSIUM ON HIGH PERFORMANCE COMPUTER ARCHITECTURE (HPCA), 2017, : 445 - 456
  • [2] Evolvable Hyperdimensional Computing: Unsupervised Regeneration of Associative Memory to Recover Faulty Components
    Hersche, Michael
    Sangalli, Sara
    Benini, Luca
    Rahimi, Abbas
    [J]. 2020 2ND IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS 2020), 2020, : 281 - 285
  • [3] Robust Hyperdimensional Computing Against Cyber Attacks and Hardware Errors: A Survey
    Ma, Dongning
    Zhang, Sizhe
    Jiao, Xun
    [J]. 2023 28TH ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE, ASP-DAC, 2023, : 598 - 605
  • [4] In-memory hyperdimensional computing
    Karunaratne, Geethan
    Le Gallo, Manuel
    Cherubini, Giovanni
    Benini, Luca
    Rahimi, Abbas
    Sebastian, Abu
    [J]. NATURE ELECTRONICS, 2020, 3 (06) : 327 - +
  • [5] In-memory hyperdimensional computing
    Geethan Karunaratne
    Manuel Le Gallo
    Giovanni Cherubini
    Luca Benini
    Abbas Rahimi
    Abu Sebastian
    [J]. Nature Electronics, 2020, 3 : 327 - 337
  • [6] Testing and Enhancing Adversarial Robustness of Hyperdimensional Computing
    Ma, Dongning
    Rosing, Tajana Simunic
    Jiao, Xun
    [J]. IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2023, 42 (11) : 4052 - 4064
  • [7] Comprehensive analysis on error-robustness of FeFET computation-in-memory for hyperdimensional computing
    Matsui, Chihiro
    Kobayashi, Eitaro
    Misawa, Naoko
    Takeuchi, Ken
    [J]. JAPANESE JOURNAL OF APPLIED PHYSICS, 2023, 62 (SC)
  • [8] Evaluating the Adversarial Robustness of Text Classifiers in Hyperdimensional Computing
    Moraliyage, Harsha
    Kahawala, Sachin
    De Silva, Daswin
    Alahakoon, Damminda
    [J]. 2022 15TH INTERNATIONAL CONFERENCE ON HUMAN SYSTEM INTERACTION (HSI), 2022,
  • [9] Hardware Optimizations of Dense Binary Hyperdimensional Computing: Rematerialization of Hypervectors, Binarized Bundling, and Combinational Associative Memory
    Schmuck, Manuel
    Benini, Luca
    Rahimi, Abbas
    [J]. ACM JOURNAL ON EMERGING TECHNOLOGIES IN COMPUTING SYSTEMS, 2019, 15 (04)
  • [10] Efficient Associative Search in Brain-Inspired Hyperdimensional Computing
    Imani, Mohsen
    Morris, Justin
    Shu, Helen
    Li, Shou
    Rosing, Tajana
    [J]. IEEE DESIGN & TEST, 2020, 37 (01) : 28 - 35