Statistical properties of random asymmetrical neural networks

被引:0
|
作者
Miranda, EN
Zanette, DH
Reidel, D
机构
[1] INST BALSEIRO,RA-8400 SAN CARLOS BARILO,ARGENTINA
[2] CTR ATOM BARILOCHE,RA-8400 SAN CARLOS BARILO,ARGENTINA
来源
PHYSICA A | 1997年 / 241卷 / 3-4期
关键词
neural networks; nonequilibrium phase transitions;
D O I
10.1016/S0378-4371(97)00178-7
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
A fully connected set of formal neurons that has not been subject to any training algorithm is studied. The thresholds and couplings are random variables chosen from Gaussian distributions. The dynamics of the model can be studied within a mean field approximation. Our results show a change of behaviour from a monostable to a bistable regime as the parameters are modified. A nonequilibrium potential is introduced to describe the model, and an analogy with a usual phase transition can be drawn. This analogy suggests using a thermodynamical approach to study the problem. Both the dynamical and the thermodynamical approaches give the same phase diagram for the model. The mean value of the threshold controls the order of the phase transition between the monostable and bistable regimes.
引用
收藏
页码:481 / 492
页数:12
相关论文
共 50 条
  • [41] Statistical methods for modelling neural networks
    Medeiros, MC
    Teräsvirta, T
    ENGINEERING INTELLIGENT SYSTEMS FOR ELECTRICAL ENGINEERING AND COMMUNICATIONS, 2001, 9 (04): : 227 - 235
  • [42] Statistical field theory for neural networks
    Helias, Moritz
    Dahmen, David
    arXiv, 2019,
  • [43] Statistical methods for modelling neural networks
    Medeiros, M.C.
    Teräsvirta, T.
    International Journal of Engineering Intelligent Systems for Electrical Engineering and Communications, 2001, 9 (04): : 227 - 235
  • [44] STATISTICAL-MECHANICS OF NEURAL NETWORKS
    ZIPPELIUS, A
    PHYSICA A, 1993, 194 (1-4): : 471 - 481
  • [45] ON LEARNING RULES AND MEMORY STORAGE ABILITIES OF ASYMMETRICAL NEURAL NETWORKS
    PERETTO, P
    JOURNAL DE PHYSIQUE, 1988, 49 (05): : 711 - 726
  • [46] Principles of statistical mechanics of uncorrelated random networks
    Dorogovtsev, SN
    Mendes, JFF
    Samukhin, A
    NUCLEAR PHYSICS B, 2003, 666 (03) : 396 - 416
  • [47] Random Sketching for Neural Networks With ReLU
    Wang, Di
    Zeng, Jinshan
    Lin, Shao-Bo
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (02) : 748 - 762
  • [48] Random recurrent neural networks dynamics
    Samuelides, M.
    Cessac, B.
    EUROPEAN PHYSICAL JOURNAL-SPECIAL TOPICS, 2007, 142 (1): : 89 - 122
  • [49] Neural networks meet random forests
    Qiu, Rui
    Xu, Shuntuo
    Yu, Zhou
    JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2024,
  • [50] Learning by optimization in random neural networks
    Atalay, V
    ADVANCES IN COMPUTER AND INFORMATION SCIENCES '98, 1998, 53 : 143 - 148