Assessing Robustness of Hyperdimensional Computing Against Errors in Associative Memory

被引:10
|
作者
Zhang, Sizhe [1 ]
Wang, Ruixuan [1 ]
Zhang, Jeff Jun [2 ]
Rahimi, Abbas [3 ]
Jiao, Xun [1 ]
机构
[1] Villanova Univ, Villanova, PA 19085 USA
[2] Harvard Univ, Cambridge, MA 02138 USA
[3] IBM Res Zurich, Zurich, Switzerland
关键词
VOLTAGE;
D O I
10.1109/ASAP52443.2021.00039
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Brain-inspired hyperdimensional computing (HDC) is an emerging computational paradigm that has achieved success in various domains. HDC mimics brain cognition and lever-ages hyperdimensional vectors with fully distributed holographic representation and (pseudo)randomness. Compared to the traditional machine learning methods, HDC offers several critical advantages, including smaller model size, less computation cost, and one-shot learning capability, making it a promising candidate in low-power platforms. Despite the growing popularity of HDC, the robustness of HDC models has not been systematically explored. This paper presents a study on the robustness of HDC to errors in associative memory-the key component storing the class representations in HDC. We perform extensive error injection experiments to the associative memory in a number of HDC models (and datasets), sweeping the error rates and varying HDC configurations (i.e., dimension and data width). Empirically, we observe that HDC is considerably robust to errors in the associative memory, opening up opportunities for further optimizations. Further, results show that HDC robustness varies significantly with different HDC configurations such as data width. Moreover, we explore a low-cost error masking mechanism in the associative memory to enhance its robustness.
引用
收藏
页码:211 / 217
页数:7
相关论文
共 50 条
  • [41] Robustness of quantum algorithms against coherent control errors
    Berberich, Julian
    Fink, Daniel
    Holm, Christian
    [J]. PHYSICAL REVIEW A, 2024, 109 (01)
  • [42] REPETITION OF ERRORS IN LEARNING AND MEMORY AS A FUNCTION OF THEIR PRIOR ASSOCIATIVE STRENGTH
    MARX, MH
    MARX, K
    [J]. BULLETIN OF THE PSYCHONOMIC SOCIETY, 1980, 16 (06) : 435 - 438
  • [43] Adaptive wideband beamforming with robustness against presteering errors
    El-Keyi, Amr
    Kirubarajan, Thia
    Gershman, Alex. B.
    [J]. 2006 IEEE SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING WORKSHOP PROCEEDINGS, VOLS 1 AND 2, 2006, : 11 - +
  • [44] Retrieval induced forgetting: Assessing associative memory in schizophrenia
    Allen, CG
    Nestor, PG
    McCarley, RW
    Shenton, AE
    [J]. SCHIZOPHRENIA RESEARCH, 2003, 60 (01) : 121 - 121
  • [45] HDLock: Exploiting Privileged Encoding to Protect Hyperdimensional Computing Models against IP Stealing
    Duan, Shijin
    Ren, Shaolei
    Xu, Xiaolin
    [J]. PROCEEDINGS OF THE 59TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC 2022, 2022, : 679 - 684
  • [46] Feature Selection using Associative Memory Paradigm and Parallel Computing
    Aldape-Perez, Mario
    Yanez-Marquez, Cornelio
    Camacho-Nieto, Oscar
    Ferreira-Santiago, Angel
    [J]. COMPUTACION Y SISTEMAS, 2013, 17 (01): : 41 - 52
  • [47] Hybrid Approximate Computing Approach for Associative In-Memory Processors
    Yantir, Hasan Erdem
    Eltawil, Ahmed M.
    Kurdahi, Fadi J.
    [J]. IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2018, 8 (04) : 758 - 769
  • [48] A morphological auto-associative memory based on dendritic computing
    Ritter, GX
    Iancu, L
    [J]. 2004 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2004, : 915 - 920
  • [49] MIMHD: Accurate and Efficient Hyperdimensional Inference Using Multi-Bit In-Memory Computing
    Kazemi, Arman
    Sharifi, Mohammad Mehdi
    Zou, Zhuowen
    Niemier, Michael
    Hu, X. Sharon
    Imani, Mohsen
    [J]. 2021 IEEE/ACM INTERNATIONAL SYMPOSIUM ON LOW POWER ELECTRONICS AND DESIGN (ISLPED), 2021,
  • [50] Notes on the Robustness of Regression Trees Against Skewed and Contaminated Errors
    Galimberti, Giuliano
    Pillati, Marilena
    Soffritti, Gabriele
    [J]. NEW PERSPECTIVES IN STATISTICAL MODELING AND DATA ANALYSIS, 2011, : 255 - 263