Approximation enhancement for stochastic Bayesian inference

被引:7
|
作者
Friedman, Joseph S. [1 ,2 ]
Droulez, Jacques [3 ]
Bessiere, Pierre [3 ]
Lobo, Jorge [4 ]
Querlioz, Damien [1 ]
机构
[1] Univ Paris Saclay, Univ Paris Sud, CNRS, Ctr Nanosci & Nanotechnol, 220 Rue Andre Ampere, F-91405 Orsay, France
[2] Univ Texas Dallas, Dept Elect & Comp Engn, 800 W Campbell Rd, Richardson, TX 75080 USA
[3] Univ Paris 06, Inst Syst Intelligents & Robot, CNRS, 4 Pl Jussieu, F-75005 Paris, France
[4] Univ Coimbra, Inst Syst & Robot, Dept Elect & Comp Engn, P-3030290 Coimbra, Portugal
关键词
Stochastic computing; Muller C-element; Bayesian inference; Autocorrelation; Approximate inference; DEVICES; INFORMATION; CODES;
D O I
10.1016/j.ijar.2017.03.007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Advancements in autonomous robotic systems have been impeded by the lack of a specialized computational hardware that makes real-time decisions based on sensory inputs. We have developed a novel circuit structure that efficiently approximates naive Bayesian inference with simple Muller C-elements. Using a stochastic computing paradigm, this system enables real-time approximate decision-making with an area-energy-delay product nearly one billion times smaller than a conventional general-purpose computer. In this paper, we propose several techniques to improve the approximation of Bayesian inference by reducing stochastic bitstream autocorrelation. We also evaluate the effectiveness of these techniques for various naive inference tasks and discuss hardware considerations, concluding that these circuits enable approximate Bayesian inferences while retaining orders-of-magnitude hardware advantages compared to conventional general-purpose computers. (C) 2017 Elsevier Inc. All rights reserved.
引用
收藏
页码:139 / 158
页数:20
相关论文
共 50 条
  • [1] Stochastic approximation cut algorithm for inference in modularized Bayesian models
    Yang Liu
    Robert J. B. Goudie
    [J]. Statistics and Computing, 2022, 32
  • [2] Bayesian inference for stochastic kinetic models using a diffusion approximation
    Golightly, A
    Wilkinson, DJ
    [J]. BIOMETRICS, 2005, 61 (03) : 781 - 788
  • [3] Stochastic approximation cut algorithm for inference in modularized Bayesian models
    Liu, Yang
    Goudie, Robert J. B.
    [J]. STATISTICS AND COMPUTING, 2022, 32 (01)
  • [4] APPROXIMATE BAYESIAN INFERENCE AS A FORM OF STOCHASTIC APPROXIMATION: A NEW CONSISTENCY THEORY WITH APPLICATIONS
    Chen, Ye
    Ryzhov, Ilya O.
    [J]. 2016 WINTER SIMULATION CONFERENCE (WSC), 2016, : 534 - 544
  • [5] Bayesian inference for stochastic processes
    Isheden, Gabriel
    [J]. BIOMETRICS, 2019, 75 (04) : 1414 - 1415
  • [6] Hierarchical Stochastic Model in Bayesian Inference for Engineering Applications: Theoretical Implications and Efficient Approximation
    Wu, Stephen
    Angelikopoulos, Panagiotis
    Beck, James L.
    Koumoutsakos, Petros
    [J]. ASCE-ASME JOURNAL OF RISK AND UNCERTAINTY IN ENGINEERING SYSTEMS PART B-MECHANICAL ENGINEERING, 2019, 5 (01):
  • [7] ON BAYESIAN LEARNING AND STOCHASTIC APPROXIMATION
    CHIEN, YT
    FU, KS
    [J]. IEEE TRANSACTIONS ON SYSTEMS SCIENCE AND CYBERNETICS, 1967, SSC3 (01): : 28 - +
  • [8] A Bayesian stochastic approximation method
    Xu, Jin
    Mu, Rongji
    Xiong, Cui
    [J]. JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2021, 211 : 391 - 401
  • [9] An optimal approximation algorithm for Bayesian inference
    Dagum, P
    Luby, M
    [J]. ARTIFICIAL INTELLIGENCE, 1997, 93 (1-2) : 1 - 27
  • [10] Bayesian nonparametric inference on stochastic ordering
    Dunson, David B.
    Peddada, Shyamal D.
    [J]. BIOMETRIKA, 2008, 95 (04) : 859 - 874