Leveraging Stochasticity for In Situ Learning in Binarized Deep Neural Networks

被引:2
|
作者
Pyle, Steven D. [1 ]
Sapp, Justin D. [1 ]
DeMara, Ronald F. [2 ]
机构
[1] Univ Cent Florida, Comp Engn, Orlando, FL 32816 USA
[2] Univ Cent Florida, Dept Elect & Comp Engn, Orlando, FL 32816 USA
基金
美国国家科学基金会;
关键词
D O I
10.1109/MC.2019.2906133
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
A recent thrust in deep neural network (DNN) research has been toward binary approaches for compact and energy-sparing neuromorphic architectures utilizing emerging devices. However, approaches to deal with device process variations and the realization of stochastic behavior intrinsically within neural circuits remain underexplored. Herein, we leverage a novel probabilistic spintronic device for low-energy recognition operations that improves DNN performance through active in situ learning via the mitigation of device reliability challenges.
引用
收藏
页码:30 / 39
页数:10
相关论文
共 50 条
  • [1] Formal Analysis of Deep Binarized Neural Networks
    Narodytska, Nina
    [J]. PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 5692 - 5696
  • [2] Verifying Properties of Binarized Deep Neural Networks
    Narodytska, Nina
    Kasiviswanathan, Shiva
    Ryzhyk, Leonid
    Sagiv, Mooly
    Walsh, Toby
    [J]. THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 6615 - 6624
  • [3] Towards Stochasticity of Regularization in Deep Neural Networks
    Sandjakoska, Ljubinka
    Bogdanova, Ana Madevska
    [J]. 2018 14TH SYMPOSIUM ON NEURAL NETWORKS AND APPLICATIONS (NEUREL), 2018,
  • [4] Binarized Neural Networks
    Hubara, Itay
    Courbariaux, Matthieu
    Soudry, Daniel
    El-Yaniv, Ran
    Bengio, Yoshua
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [5] Fast Simulation Method for Analog Deep Binarized Neural Networks
    Lee, Chaeun
    Kim, Jaehyun
    Kim, Jihun
    Hwang, Cheol Seong
    Choi, Kiyoung
    [J]. 2019 INTERNATIONAL SOC DESIGN CONFERENCE (ISOCC), 2019, : 293 - 294
  • [6] LightNN: Filling the Gap between Conventional Deep Neural Networks and Binarized Networks
    Ding, Ruizhou
    Liu, Zeye
    Shi, Rongye
    Marculescu, Diana
    Blanton, R. D.
    [J]. PROCEEDINGS OF THE GREAT LAKES SYMPOSIUM ON VLSI 2017 (GLSVLSI' 17), 2017, : 35 - 40
  • [7] Verifying Binarized Neural Networks by Angluin-Style Learning
    Shih, Andy
    Darwiche, Adnan
    Choi, Arthur
    [J]. THEORY AND APPLICATIONS OF SATISFIABILITY TESTING - SAT 2019, 2019, 11628 : 354 - 370
  • [8] Memristor Binarized Neural Networks
    Khoa Van Pham
    Tien Van Nguyen
    Son Bao Tran
    Nam, Hyunkyung
    Lee, Mi Jung
    Choi, Byung Joon
    Son Ngoc Truong
    Min, Kyeong-Sik
    [J]. JOURNAL OF SEMICONDUCTOR TECHNOLOGY AND SCIENCE, 2018, 18 (05) : 568 - 577
  • [9] A Review of Binarized Neural Networks
    Simons, Taylor
    Lee, Dah-Jye
    [J]. ELECTRONICS, 2019, 8 (06)
  • [10] Leveraging deep learning to control neural oscillators
    Timothy D. Matchen
    Jeff Moehlis
    [J]. Biological Cybernetics, 2021, 115 : 219 - 235