On-line Functional Testing of Memristor-mapped Deep Neural Networks using Backdoored Checksums

被引:2
|
作者
Chen, Ching-Yuan [1 ]
Chakrabarty, Krishnendu [1 ]
机构
[1] Duke Univ, Dept Elect & Comp Engn, Durham, NC 27708 USA
关键词
D O I
10.1109/ITC50571.2021.00016
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Deep learning (DL) applications are becoming increasingly ubiquitous. However, recent research has highlighted a number of reliability concerns associated with deep neural networks (DNNs) used for DL. In particular, hardware-level reliability of DNNs is of concern when DL models are mapped to specialized neuromorphic hardware such as memristor-based crossbars. Faults in the crossbars can deviate the corresponding DNN model weights from their trained values. It is therefore desirable to have an on-device "checksum" function to indicate if model weights are deviated. We present a backdooring technique that fine-tunes DNN weights to implement the checksum function. The backdoored checksum function is triggered only when inferencing is carried out using a special set of data points with watermarks. We show that backdooring, i.e., fine-tuning of DNN weights, has no impact on the inferencing accuracy of the original DNN model. Moreover, the implemented checksum functions for AlexNet and VGG-16 remarkably outperform baseline approaches. Based on the proposed on-line functional testing solution, we present a computing framework that can efficiently recover the inferencing accuracy of a memristor-mapped DNN from weight deviations. Compared to related recent work, the proposed framework achieves 5.6x speed-up in time-to-recovery and reduces the on-chip test data volume by 99.99%.
引用
收藏
页码:83 / 92
页数:10
相关论文
共 50 条
  • [1] Mitigating Slow-to-Write Errors in Memristor-Mapped Graph Neural Networks Induced by Adversarial Attacks
    Chen, Ching-Yuan
    Joardar, Biresh Kumar
    Doppa, Janardhan Rao
    Pande, Partha Pratim
    Chakrabarty, Krishnendu
    [J]. IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2024, 43 (08) : 2411 - 2425
  • [2] On-line testing in digital neural networks
    Demidenko, S
    Piuri, V
    [J]. PROCEEDINGS OF THE FIFTH ASIAN TEST SYMPOSIUM (ATS '96), 1996, : 295 - 300
  • [3] On-line wear estimation using neural networks
    Ghasempoor, A
    Moore, TN
    Jeswiet, J
    [J]. PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART B-JOURNAL OF ENGINEERING MANUFACTURE, 1998, 212 (02) : 105 - 112
  • [4] Learning-based on-line testing in feedforward neural networks
    Kamiura, N
    Yamato, K
    Isokawa, T
    Matsui, N
    [J]. PROCEEDINGS OF THE EIGHTH IEEE INTERNATIONAL ON-LINE TESTING WORKSHOP, 2002, : 180 - 182
  • [5] Optimal video handling in on-line hand gesture recognition using Deep Neural Networks
    Makrygiannis, Dimitrios
    Papaioannidis, Christos
    Mademlis, Ioannis
    Pitas, Ioannis
    [J]. 2021 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2021), 2021,
  • [6] Robust Fault-Tolerant Design Based on Checksum and On-Line Testing for Memristor Neural Network
    Shintani, Michihiro
    Ishizaka, Mamoru
    Inoue, Michiko
    [J]. 2021 IEEE 30TH ASIAN TEST SYMPOSIUM (ATS 2021), 2021, : 25 - 30
  • [7] On-line monitoring of laser welding using neural networks
    Ghasempoor, A
    Auger, M
    Wild, P
    [J]. Materials in the Automotive Industry, 2001, : 163 - 174
  • [8] On-line estimation of quantities using artificial neural networks
    Zilková, Jaroslava
    Timko, Jaroslav
    [J]. Acta Technica CSAV (Ceskoslovensk Akademie Ved), 2002, 47 (03): : 305 - 315
  • [9] On-line system identification using Chebyshev neural networks
    Purwar, S
    Kar, IN
    Jha, AN
    [J]. IEEE TENCON 2003: CONFERENCE ON CONVERGENT TECHNOLOGIES FOR THE ASIA-PACIFIC REGION, VOLS 1-4, 2003, : 1115 - 1119
  • [10] On-line continuous weld monitoring using Neural Networks
    Millan, RL
    Quero, JM
    Franquelo, LG
    [J]. BIOLOGICAL AND ARTIFICIAL COMPUTATION: FROM NEUROSCIENCE TO TECHNOLOGY, 1997, 1240 : 1315 - 1323