FeFET-Based Binarized Neural Networks Under Temperature-Dependent Bit Errors

被引:9
|
作者
Yayla, Mikail [1 ]
Buschjaeger, Sebastian [2 ]
Gupta, Aniket [3 ]
Chen, Jian-Jia [1 ]
Henkel, Joerg [3 ]
Morik, Katharina [2 ]
Chen, Kuan-Hsun [1 ]
Amrouch, Hussam [4 ]
机构
[1] TU Dortmund Univ, Design Automat Embedded Syst Grp, D-44227 Dortmund, Germany
[2] TU Dortmund Univ, Artificial Intelligence Grp, D-44227 Dortmund, Germany
[3] Karlsruhe Inst Technol, Chair Embedded Syst, D-76131 Karlsruhe, Germany
[4] Univ Stuttgart, Chair Semicond Test & Reliabil STAR, D-70174 Stuttgart, Germany
关键词
FeFETs; Nonvolatile memory; Bit error rate; Random access memory; Artificial neural networks; Voltage measurement; Solid modeling; Non-volatile memory; FeFET; temperature; neural networks; bit error tolerance; MEMORY;
D O I
10.1109/TC.2021.3104736
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Ferroelectric FET (FeFET) is a highly promising emerging non-volatile memory (NVM) technology, especially for binarized neural network (BNN) inference on the low-power edge. The reliability of such devices, however, inherently depends on temperature. Hence, changes in temperature during run time manifest themselves as changes in bit error rates. In this work, we reveal the temperature-dependent bit error model of FeFET memories, evaluate its effect on BNN accuracy, and propose countermeasures. We begin on the transistor level and accurately model the impact of temperature on bit error rates of FeFET. This analysis reveals temperature-dependent asymmetric bit error rates. Afterwards, on the application level, we evaluate the impact of the temperature-dependent bit errors on the accuracy of BNNs. Under such bit errors, the BNN accuracy drops to unacceptable levels when no countermeasures are employed. We propose two countermeasures: (1) Training BNNs for bit error tolerance by injecting bit flips into the BNN data, and (2) applying a bit error rate assignment algorithm (BERA) which operates in a layer-wise manner and does not inject bit flips during training. In experiments, the BNNs, to which the countermeasures are applied to, effectively tolerate temperature-dependent bit errors for the entire range of operating temperature.
引用
收藏
页码:1681 / 1695
页数:15
相关论文
共 50 条
  • [1] Design and Optimization of FeFET-based Crossbars for Binary Convolution Neural Networks
    Chen, Xiaoming
    Yin, Xunzhao
    Niemier, Michael
    Hu, Xiaobo Sharon
    PROCEEDINGS OF THE 2018 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE), 2018, : 1205 - 1210
  • [2] Supervised Learning in All FeFET-Based Spiking Neural Network: Opportunities and Challenges
    Dutta, Sourav
    Schafer, Clemens
    Gomez, Jorge
    Ni, Kai
    Joshi, Siddharth
    Datta, Suman
    FRONTIERS IN NEUROSCIENCE, 2020, 14
  • [3] A FeFET-based Time-Domain Associative Memory for Multi-bit Similarity Computation
    Huang, Qingrong
    Barkam, Hamza Errahmouni
    Yang, Zeyu
    Yang, Jianyi
    Kaempfe, Thomas
    Ni, Kai
    Li Zhang, Grace
    Li, Bing
    Schlichtmann, Ulf
    Imani, Mohsen
    Zhuo, Cheng
    Yin, Xunzhao
    2024 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION, DATE, 2024,
  • [4] Outstanding Bit Error Tolerance of Resistive RAM-Based Binarized Neural Networks
    Hirtzlin, T.
    Bocquett, M.
    Klein, J. O.
    Nowak, E.
    Vianello, E.
    Portal, J. M.
    Querlioz, D.
    2019 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS 2019), 2019, : 288 - 292
  • [5] Temperature-dependent models of low-noise microwave transistors based on neural networks
    Marinkovic, ZD
    Markovic, VV
    INTERNATIONAL JOURNAL OF RF AND MICROWAVE COMPUTER-AIDED ENGINEERING, 2005, 15 (06) : 567 - 577
  • [6] Margin-Maximization in Binarized Neural Networks for Optimizing Bit Error Tolerance
    Buschjaeger, Sebastian
    Chen, Jian-Jia
    Chen, Kuan-Hsun
    Guenzel, Mario
    Hakert, Christian
    Morik, Katharina
    Novkin, Rodion
    Pfahler, Lukas
    Yayla, Mikail
    PROCEEDINGS OF THE 2021 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2021), 2021, : 673 - 678
  • [7] Neural networks for predicting the temperature-dependent viscoelastic response of PEEK under constant stress rate loading
    Aulova, Alexandra
    Oseli, Alen
    Bek, Marko
    POLYMER TESTING, 2021, 100
  • [8] Inverse Identification of Temperature-Dependent Volumetric Heat Capacity by Neural Networks
    Balázs Czél
    Keith A. Woodbury
    Gyula Gróf
    International Journal of Thermophysics, 2013, 34 : 284 - 305
  • [9] Inverse Identification of Temperature-Dependent Volumetric Heat Capacity by Neural Networks
    Czel, Balazs
    Woodbury, Keith A.
    Grof, Gyula
    INTERNATIONAL JOURNAL OF THERMOPHYSICS, 2013, 34 (02) : 284 - 305
  • [10] Predicting the temperature-dependent CMC of surfactant mixtures with graph neural networks
    Brozos, Christoforos
    Rittig, Jan G.
    Akanny, Elie
    Bhattacharya, Sandip
    Kohlmann, Christina
    Mitsos, Alexander
    COMPUTERS & CHEMICAL ENGINEERING, 2025, 198