WESCO: Weight-encoded Reliability and Security Co-design for In-memory Computing Systems

被引:3
|
作者
Zhang, Jiangwei [1 ]
Wang, Chong [1 ]
Cai, Yi [1 ]
Zhu, Zhenhua [1 ]
Kline, Donald, Jr. [2 ]
Yang, Huazhong [1 ]
Wang, Yu [1 ]
机构
[1] Tsinghua Univ, Dept Elect Engn, Beijing, Peoples R China
[2] Intel Corp, Hillsboro, OR USA
来源
2022 IEEE COMPUTER SOCIETY ANNUAL SYMPOSIUM ON VLSI (ISVLSI 2022) | 2022年
基金
中国国家自然科学基金;
关键词
DNN; Non-volatile memory (NVM); In-memory computing; Reliability; Security; Fault-Tolerance;
D O I
10.1109/ISVLSI54635.2022.00065
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Non-volatile memory (NVM) based in-memory computing (IMC) systems can avoid expensive data movement by implementing matrix-vector-multiplication calculations in memory, significantly reducing the power consumption and memory bandwidth requirements of deep neural networks (DNNs). Due to the non-volatility and the limited endurance of NVM devices, the system is ideal for low-power and retrain-free applications. However, NVM devices have reliability problems caused by device faults and data security risks due to non-volatility, making the system unreliable and unsecure. We observe that the impact of high-bit faults (HBFs) of quantized weights is far greater than low-bit faults (LBFs) on the classification accuracy of DNNs. Leveraging this observation, this paper proposes a lightweight and efficient co-design of reliability and security for retrain-free IMC systems, called WESCO, that can simultaneously tolerate faults and obfuscate the network. The weight matrices are encoded in row level by swapping the HBFs into LBFs to reduce the impact of faults on network accuracy without retraining; meanwhile, the implementation of our HBF and LBF swapping simultaneously obfuscates the network, so that the models cannot be accurately extracted from the stolen weights. The experimental results demonstrate WESCO can restore the classification accuracy of the DNN models to the baseline level at high fault rate of 5E-3 with a low area overhead of 1.17%, and limit the possibility of attackers stealing the model to infeasible brute force attacks.
引用
收藏
页码:296 / 301
页数:6
相关论文
共 50 条
  • [21] Algorithm-Hardware Co-Design in Computing Systems: From Embedded Systems to the Cloud
    Guan, Wenkai
    Ababei, Cristinel
    2020 11TH INTERNATIONAL GREEN AND SUSTAINABLE COMPUTING WORKSHOPS (IGSC), 2020,
  • [22] Compute in-Memory with Non-Volatile Elements for Neural Networks: A Review from a Co-Design Perspective
    Haensch, Wilfried
    Raghunathan, Anand
    Roy, Kaushik
    Chakrabarti, Bhaswar
    Phatak, Charudatta M. M.
    Wang, Cheng
    Guha, Supratik
    ADVANCED MATERIALS, 2023, 35 (37)
  • [23] IMCS2: Novel Device-to-Architecture Co-Design for Low-Power In-Memory Computing Platform Using Coterminous Spin Switch
    Parveen, Farhana
    Angizi, Shaahin
    He, Zhezhi
    Fan, Deliang
    IEEE TRANSACTIONS ON MAGNETICS, 2018, 54 (07)
  • [24] Fault tolerant memory design for HW/SW co-reliability in massively parallel computing systems
    Choi, M
    Park, NJ
    George, KM
    Jin, B
    Park, N
    Kim, YB
    Lombardi, F
    SECOND IEEE INTERNATIONAL SYMPOSIUM ON NETWORK COMPUTING AND APPLICATIONS, PROCEEDINGS, 2003, : 341 - 348
  • [25] Co-Design of Watermarking and Robust Control for Security in Cyber-Physical Systems
    Goyal, Raman
    Somarakis, Christoforos
    Noorani, Erfaun
    Rane, Shantanu
    2022 IEEE 61ST CONFERENCE ON DECISION AND CONTROL (CDC), 2022, : 4821 - 4826
  • [26] Lifetime Reliability Aware Distributed Estimation and Communication Co-Design for IIoT Systems
    Li, Peizhe
    Ren, Cheng
    Chen, Cailian
    Zhu, Shanying
    Ma, Yehan
    Guan, Xinping
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (12) : 14042 - 14052
  • [27] Co-design of Real-time Embedded Systems under Reliability Constraints
    Zorin, Daniil A.
    Kostenko, Valery A.
    11TH IFAC/IEEE INTERNATIONAL CONFERENCE ON PROGRAMMABLE DEVICES AND EMBEDDED SYSTEMS (PDES 2012), 2012,
  • [28] Adaptive Quantization as a Device-Algorithm Co-Design Approach to Improve the Performance of In-Memory Unsupervised Learning With SNNs
    Shi, Yuhan
    Huang, Zhisheng
    Oh, Sangheon
    Kaslan, Nathan
    Song, Jungwoo
    Kuzum, Duygu
    IEEE TRANSACTIONS ON ELECTRON DEVICES, 2019, 66 (04) : 1722 - 1728
  • [29] Hardware-software co-exploration with racetrack memory based in-memory computing for CNN inference in embedded systems
    Choong, Benjamin Chen Ming
    Luo, Tao
    Liu, Cheng
    He, Bingsheng
    Zhang, Wei
    Zhou, Joey Tianyi
    JOURNAL OF SYSTEMS ARCHITECTURE, 2022, 128
  • [30] FPGA Implementation of a Hardware XTEA Light Encryption Engine in Co-Design Computing systems
    AlMeer, Mohamed H.
    2017 SEVENTH INTERNATIONAL CONFERENCE ON INNOVATIVE COMPUTING TECHNOLOGY (INTECH 2017), 2017, : 26 - 30