Gaussian synapses for probabilistic neural networks

被引:83
|
作者
Sebastian, Amritanand [1 ]
Pannone, Andrew [1 ]
Radhakrishnan, Shiva Subbulakshmi [1 ,2 ]
Das, Saptarshi [1 ,3 ,4 ]
机构
[1] Penn State Univ, Dept Engn Sci & Mech, University Pk, PA 16802 USA
[2] Amrita Vishwa Vidyapeetham, Elect & Elect Engn, Coimbatore 641112, Tamil Nadu, India
[3] Penn State Univ, Dept Mat Sci & Engn, University Pk, PA 16802 USA
[4] Penn State Univ, Mat Res Inst, University Pk, PA 16802 USA
关键词
CIRCUIT; DEVICE; CLASSIFICATION; COMPUTATION; TRANSISTORS; MOSFETS; DESIGN; LIMITS;
D O I
10.1038/s41467-019-12035-6
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The recent decline in energy, size and complexity scaling of traditional von Neumann architecture has resurrected considerable interest in brain-inspired computing. Artificial neural networks (ANNs) based on emerging devices, such as memristors, achieve brain-like computing but lack energy-efficiency. Furthermore, slow learning, incremental adaptation, and false convergence are unresolved challenges for ANNs. In this article we, therefore, introduce Gaussian synapses based on heterostructures of atomically thin two-dimensional (2D) layered materials, namely molybdenum disulfide and black phosphorus field effect transistors (FETs), as a class of analog and probabilistic computational primitives for hardware implementation of statistical neural networks. We also demonstrate complete tunability of amplitude, mean and standard deviation of the Gaussian synapse via threshold engineering in dual gated molybdenum disulfide and black phosphorus FETs. Finally, we show simulation results for classification of brainwaves using Gaussian synapse based probabilistic neural networks.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Gaussian synapses for probabilistic neural networks
    Amritanand Sebastian
    Andrew Pannone
    Shiva Subbulakshmi Radhakrishnan
    Saptarshi Das
    [J]. Nature Communications, 10
  • [2] Probabilistic Lane Change Prediction using Gaussian Process Neural Networks
    Krueger, Martin
    Novo, Anne Stockem
    Nattermann, Till
    Bertram, Torsten
    [J]. 2019 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2019, : 3651 - 3656
  • [3] Neural networks with fluctuating synapses
    Torres, JJ
    Garrido, PL
    Marro, J
    [J]. FOURTH GRANADA LECTURES IN COMPUTATIONAL PHYSICS, 1997, 493 : 304 - 304
  • [4] Neural networks with dynamic synapses
    Tsodyks, M
    Pawelzik, K
    Markram, H
    [J]. NEURAL COMPUTATION, 1998, 10 (04) : 821 - 835
  • [5] PROBABILISTIC NEURAL NETWORKS
    SPECHT, DF
    [J]. NEURAL NETWORKS, 1990, 3 (01) : 109 - 118
  • [7] Chaos in neural networks with dynamic synapses
    Dror, G
    Tsodyks, M
    [J]. NEUROCOMPUTING, 2000, 32 : 365 - 370
  • [8] LEARNING IN NEURAL NETWORKS WITH MATERIAL SYNAPSES
    AMIT, DJ
    FUSI, S
    [J]. NEURAL COMPUTATION, 1994, 6 (05) : 957 - 982
  • [9] Unsupervised learning in probabilistic neural networks with multi-state metal-oxide memristive synapses
    Serb, Alexander
    Bill, Johannes
    Khiat, Ali
    Berdan, Radu
    Legenstein, Robert
    Prodromakis, Themis
    [J]. NATURE COMMUNICATIONS, 2016, 7
  • [10] Unsupervised learning in probabilistic neural networks with multi-state metal-oxide memristive synapses
    Alexander Serb
    Johannes Bill
    Ali Khiat
    Radu Berdan
    Robert Legenstein
    Themis Prodromakis
    [J]. Nature Communications, 7