Statistical Mechanics of Mexican-Hat-Type Horizontal Connection

被引:4
|
作者
Takiyama, Ken [1 ]
Naruse, Yasushi [2 ]
Okada, Masato [1 ,3 ]
机构
[1] Univ Tokyo, Grad Sch Frontier Sci, Chiba 2778561, Japan
[2] NICT, Kobe Adv ICT Res Ctr, Kobe, Hyogo 6512492, Japan
[3] RIKEN, Brain Sci Inst, Wako, Saitama 3510198, Japan
关键词
hypercolumn; horizontal connection; Mexican hat; statistical mechanics; Bayesian inference; image restoration; von-Mises distribution; FUNCTIONAL ARCHITECTURE; MODEL; INTEGRATION; DYNAMICS;
D O I
10.1143/JPSJ.78.064002
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
We propose a multi-hypercolumn model consisting of M hypercolumns. Adjacent hypercolumns interact with each other through horizontal connections. This model consists of inter-hypercolumn and intra-hypercolumn Mexican-hat-type interactions. We analyze our model using statistical-mechanical methods. In this model, we theoretically show that the free energy is equivalent to the posterior distribution in the Bayesian framework in extremely weak inter-hypercolumn interactions. A numerical experiment supports this equivalence. The results of this study reveal the relationship between a microscopic neural structure and a macroscopic computational theory.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Bayesian estimation inherent in a Mexican-hat-type neural network
    Takiyama, Ken
    [J]. PHYSICAL REVIEW E, 2016, 93 (05)
  • [2] Correlated firing in a feedforward network with Mexican-hat-type connectivity
    Hamaguchi, K
    Okada, M
    Yamana, M
    Aihara, K
    [J]. NEURAL COMPUTATION, 2005, 17 (09) : 2034 - 2059
  • [3] Multistability of Neural Networks With Mexican-Hat-Type Activation Functions
    Wang, Lili
    Chen, Tianping
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (11) : 1816 - 1826
  • [4] Stability Analysis on Neural Networks with A Class of Mexican-Hat-type Activation Functions
    Wang, Lili
    [J]. 2014 INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE, ELECTRONICS AND ELECTRICAL ENGINEERING (ISEEE), VOLS 1-3, 2014, : 1150 - 1154
  • [5] Multistability and Instability of Competitive Neural Networks with Mexican-Hat-Type Activation Functions
    Nie, Xiaobing
    Cao, Jinde
    Fei, Shumin
    [J]. ABSTRACT AND APPLIED ANALYSIS, 2014,
  • [6] Quantitative information transfer through layers of spiking neurons connected by Mexican-Hat-type connectivity
    Hamaguchi, K
    Aihara, K
    [J]. NEUROCOMPUTING, 2004, 58 : 85 - 90
  • [7] Quantitative infonnation transfer through layers of spiking neurons connected by Mexican-Hat-type connectivity
    Hamaguchi, K
    Aihara, K
    [J]. COMPUTATIONAL NEUROSCIENCE: TRENDS IN RESEARCH 2004, 2004, : 85 - 90
  • [8] Analysis of Ising Spin Neural Network with Time-Dependent Mexican-Hat-Type Interaction
    Hara, Kazuyuki
    Miyoshi, Seiji
    Uezu, Tatsuya
    Okada, Masato
    [J]. ADVANCES IN NEURO-INFORMATION PROCESSING, PT II, 2009, 5507 : 195 - +
  • [9] Stability Analysis of Multiple Equilibria for Recurrent Neural Networks with Discontinuous Mexican-Hat-Type Activation Function
    Nie, Xiaobing
    Zheng, Wei Xing
    Lu, Jinhu
    [J]. 2015 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2015, : 569 - 572
  • [10] Solvable Model of a Phase Oscillator Network on a Circle with Infinite-Range Mexican-Hat-Type Interaction
    Uezu, Tatsuya
    Kimoto, Tomoyuki
    Okada, Masato
    [J]. JOURNAL OF THE PHYSICAL SOCIETY OF JAPAN, 2012, 81 (07)