Assessing Robustness of Hyperdimensional Computing Against Errors in Associative Memory

被引:10
|
作者
Zhang, Sizhe [1 ]
Wang, Ruixuan [1 ]
Zhang, Jeff Jun [2 ]
Rahimi, Abbas [3 ]
Jiao, Xun [1 ]
机构
[1] Villanova Univ, Villanova, PA 19085 USA
[2] Harvard Univ, Cambridge, MA 02138 USA
[3] IBM Res Zurich, Zurich, Switzerland
关键词
VOLTAGE;
D O I
10.1109/ASAP52443.2021.00039
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Brain-inspired hyperdimensional computing (HDC) is an emerging computational paradigm that has achieved success in various domains. HDC mimics brain cognition and lever-ages hyperdimensional vectors with fully distributed holographic representation and (pseudo)randomness. Compared to the traditional machine learning methods, HDC offers several critical advantages, including smaller model size, less computation cost, and one-shot learning capability, making it a promising candidate in low-power platforms. Despite the growing popularity of HDC, the robustness of HDC models has not been systematically explored. This paper presents a study on the robustness of HDC to errors in associative memory-the key component storing the class representations in HDC. We perform extensive error injection experiments to the associative memory in a number of HDC models (and datasets), sweeping the error rates and varying HDC configurations (i.e., dimension and data width). Empirically, we observe that HDC is considerably robust to errors in the associative memory, opening up opportunities for further optimizations. Further, results show that HDC robustness varies significantly with different HDC configurations such as data width. Moreover, we explore a low-cost error masking mechanism in the associative memory to enhance its robustness.
引用
收藏
页码:211 / 217
页数:7
相关论文
共 50 条
  • [21] Wireless On-Chip Communications for Scalable In-memory Hyperdimensional Computing
    Guirado, Robert
    Rahimi, Abbas
    Karunaratne, Geethan
    Alarcon, Eduard
    Abu Sebastian
    Abadal, Sergi
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [22] No Two Brains Are Alike: Cloning a Hyperdimensional Associative Memory Using Cellular Automata Computations
    Kleyko, Denis
    Osipov, Evgeny
    [J]. BIOLOGICALLY INSPIRED COGNITIVE ARCHITECTURES (BICA) FOR YOUNG SCIENTISTS, 2018, 636 : 91 - 100
  • [23] A Computing-in-Memory-Based One-Class Hyperdimensional Computing Model for Outlier Detection
    Wang, Ruixuan
    Moon, Sabrina Hassan
    Hu, Xiaobo Sharon
    Jiao, Xun
    Reis, Dayane
    [J]. IEEE TRANSACTIONS ON COMPUTERS, 2024, 73 (06) : 1559 - 1574
  • [24] Resistive Configurable Associative Memory for Approximate Computing
    Imani, Mohsen
    Rahimi, Abbas
    Rosing, Tajana S.
    [J]. PROCEEDINGS OF THE 2016 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE), 2016, : 1327 - 1332
  • [25] Associative Memristive Memory for Approximate Computing in GPUs
    Ghofrani, Amirali
    Rahimi, Abbas
    Lastras-Montano, Miguel A.
    Benini, Luca
    Gupta, Rajesh K.
    Cheng, Kwang-Ting
    [J]. IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2016, 6 (02) : 222 - 234
  • [26] On the Robustness of Language Encoders against Grammatical Errors
    Yin, Fan
    Long, Quanyu
    Meng, Tao
    Chang, Kai-Wei
    [J]. 58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020), 2020, : 3386 - 3403
  • [27] HDC-IM: Hyperdimensional Computing In-Memory Architecture based on RRAM
    Liu, Jialong
    Ma, Mingyuan
    Zhu, Zhenhua
    Wang, Yu
    Yang, Huazhong
    [J]. 2019 26TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONICS, CIRCUITS AND SYSTEMS (ICECS), 2019, : 450 - 453
  • [28] Memristor-Based Approximate Query Architecture for In-Memory Hyperdimensional Computing
    Yu, Tianyang
    Wu, Bi
    Chen, Ke
    Zhang, Gong
    Liu, Weiqiang
    [J]. IEEE Transactions on Computers, 2024, 73 (11) : 2605 - 2618
  • [29] 3D Parallel ReRAM Computation-in-Memory for Hyperdimensional Computing
    Kihara, Fuyuki
    Matsui, Chihiro
    Takeuchi, Ken
    [J]. IEICE TRANSACTIONS ON ELECTRONICS, 2024, E107C (10) : 436 - 439
  • [30] Achieving software-equivalent accuracy for hyperdimensional computing with ferroelectric-based in-memory computing
    Arman Kazemi
    Franz Müller
    Mohammad Mehdi Sharifi
    Hamza Errahmouni
    Gerald Gerlach
    Thomas Kämpfe
    Mohsen Imani
    Xiaobo Sharon Hu
    Michael Niemier
    [J]. Scientific Reports, 12