Accelerated Physical Emulation of Bayesian Inference in Spiking Neural Networks

被引:21
|
作者
Kungl, Akos F. [1 ]
Schmitt, Sebastian [1 ]
Klaehn, Johann [1 ]
Mueller, Paul [1 ]
Baumbach, Andreas [1 ]
Dold, Dominik [1 ]
Kugele, Alexander [1 ]
Mueller, Eric [1 ]
Koke, Christoph [1 ]
Kleider, Mitja [1 ]
Mauch, Christian [1 ]
Breitwieser, Oliver [1 ]
Leng, Luziwei [1 ]
Guertler, Nico [1 ]
Guettler, Maurice [1 ]
Husmann, Dan [1 ]
Husmann, Kai [1 ]
Hartel, Andreas [1 ]
Karasenko, Vitali [1 ]
Gruebl, Andreas [1 ]
Schemmel, Johannes [1 ]
Meier, Karlheinz [1 ]
Petrovici, Mihai A. [1 ,2 ]
机构
[1] Heidelberg Univ, Kirchhoff Inst Phys, Heidelberg, Germany
[2] Univ Bern, Dept Physiol, Bern, Switzerland
基金
欧盟地平线“2020”;
关键词
physical models; neuromorphic engineering; massively parallel computing; spiking neurons; recurrent neural networks; neural sampling; probabilistic inference; NEURONS; MODEL;
D O I
10.3389/fnins.2019.01201
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The massively parallel nature of biological information processing plays an important role due to its superiority in comparison to human-engineered computing devices. In particular, it may hold the key to overcoming the von Neumann bottleneck that limits contemporary computer architectures. Physical-model neuromorphic devices seek to replicate not only this inherent parallelism, but also aspects of its microscopic dynamics in analog circuits emulating neurons and synapses. However, these machines require network models that are not only adept at solving particular tasks, but that can also cope with the inherent imperfections of analog substrates. We present a spiking network model that performs Bayesian inference through sampling on the BrainScaleS neuromorphic platform, where we use it for generative and discriminative computations on visual data. By illustrating its functionality on this platform, we implicitly demonstrate its robustness to various substrate-specific distortive effects, as well as its accelerated capability for computation. These results showcase the advantages of brain-inspired physical computation and provide important building blocks for large-scale neuromorphic applications.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Implementation of Bayesian inference in distributed neural networks
    Yu, Zhaofei
    Hang, Tiejun
    Liu, Jian K.
    [J]. 2018 26TH EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED, AND NETWORK-BASED PROCESSING (PDP 2018), 2018, : 666 - 673
  • [22] FPGA Accelerated Simulation of Biologically Plausible Spiking Neural Networks
    Thomas, David B.
    Luk, Wayne
    [J]. PROCEEDINGS OF THE 2009 17TH IEEE SYMPOSIUM ON FIELD PROGRAMMABLE CUSTOM COMPUTING MACHINES, 2009, : 45 - 52
  • [23] Bayesian spiking neurons I: Inference
    Deneve, Sophie
    [J]. NEURAL COMPUTATION, 2008, 20 (01) : 91 - 117
  • [24] Recognizing recurrent neural networks (rRNN): Bayesian inference for recurrent neural networks
    Sebastian Bitzer
    Stefan J. Kiebel
    [J]. Biological Cybernetics, 2012, 106 : 201 - 217
  • [25] Recognizing recurrent neural networks (rRNN): Bayesian inference for recurrent neural networks
    Bitzer, Sebastian
    Kiebel, Stefan J.
    [J]. BIOLOGICAL CYBERNETICS, 2012, 106 (4-5) : 201 - 217
  • [26] Simple Neural Networks and Bayesian Inference: A Computational Account
    Dawson, Michael R. W.
    Dupuis, Brian A.
    Jans, Sheldon
    [J]. CANADIAN JOURNAL OF EXPERIMENTAL PSYCHOLOGY-REVUE CANADIENNE DE PSYCHOLOGIE EXPERIMENTALE, 2013, 67 (04): : 299 - 299
  • [27] Bayesian neural networks on the inference of distillation product quality
    Barbosa, CH
    Melo, B
    Vellasco, M
    Pacheco, M
    Vasconcellos, LP
    [J]. VII BRAZILIAN SYMPOSIUM ON NEURAL NETWORKS, PROCEEDINGS, 2002, : 113 - 113
  • [28] TensorBNN: Bayesian inference for neural networks using TensorFlow
    Kronheim, B. S.
    Kuchera, M. P.
    Prosper, H. B.
    [J]. COMPUTER PHYSICS COMMUNICATIONS, 2022, 270
  • [29] Neural Networks for Astronomical Data Analysis and Bayesian Inference
    Graff, Philip
    Feroz, Farhan
    Hobson, Michael P.
    Lasenby, Anthony
    [J]. 2013 IEEE 13TH INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW), 2013, : 16 - 23
  • [30] Tractable approximate gaussian inference for bayesian neural networks
    Goulet, James A.
    Nguyen, Luong Ha
    Amiri, Saeid
    [J]. Journal of Machine Learning Research, 2021, 22