NN Algorithm Aware Alternate Layer Retraining on Computation-in-Memory for Write Variation Compensation of Non-volatile Memories at Edge AI

被引:2
|
作者
Yoshikiyo, Shinsei [1 ]
Misawa, Naoko [1 ]
Matsui, Chihiro [1 ]
Takeuchi, Ken [1 ]
机构
[1] Univ Tokyo, Dept Elect Engn & Informat Syst, Tokyo, Japan
来源
2023 7TH IEEE ELECTRON DEVICES TECHNOLOGY & MANUFACTURING CONFERENCE, EDTM | 2023年
关键词
CiM; retraining; write variation;
D O I
10.1109/EDTM55494.2023.10103064
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This study proposes an alternate retraining of neural network (NN) to recover inference accuracy degraded by non-volatile memory (NVM) write variation in Computation-in-Memory (CiM). The proposed alternate layer retraining minimizes write variation when rewriting NN weights to NVM in CiM by updating only error tolerant layers of NN models. The proposed retraining exploits the difference in error tolerance among NN layers, and achieves 23.4% higher accuracy recovery with fewer rewriting NN weights than conventional methods.
引用
收藏
页数:3
相关论文
共 3 条
  • [1] Emerging Non-Volatile Memories for Computation-in-Memory
    Gao, Bin
    2020 25TH ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE, ASP-DAC 2020, 2020, : 381 - 384
  • [2] Investigation of Memory Non-Ideality Impacts on Non-Volatile Memory Based Computation-in-Memory AI Inference by Comprehensive Simulation Platform
    Higuchi, Kazuhide
    Matsui, Chihiro
    Takeuchi, Ken
    2022 IEEE SILICON NANOELECTRONICS WORKSHOP (SNW), 2022,
  • [3] HaVOC: A Hybrid Memory-aware Virtualization Layer for On-Chip Distributed ScratchPad and Non-Volatile Memories
    Bathen, Luis Angel
    Dutt, Nikil
    2012 49TH ACM/EDAC/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2012, : 447 - 452