Phase transitions in the generalization behaviour of multilayer perceptrons: II. The influence of noise

被引:9
|
作者
Schottky, B [1 ]
Krey, U
机构
[1] Aston Univ, Dept Comp Sci & Appl Math, Birmingham B4 7ET, W Midlands, England
[2] Univ Regensburg, Inst Phys 2, D-93040 Regensburg, Germany
来源
关键词
D O I
10.1088/0305-4470/30/24/017
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
We extend our study of phase transitions in the generalization behaviour of multilayer perceptrons with non-overlapping receptive fields to the problem of the influence of noise concerning, for example, the input units and/or the couplings between the input units and the hidden units of the second layer (= 'input noise') or the final output unit (= 'output noise'). Without output noise, the output itself is given by a general, permutation-invariant Boolean function of the outputs of the hidden units. As a result we find that the phase transitions which we found in the deterministic case, mostly persist in the presence of noise. The influence of the noise on the position of the phase transition, as well as on the behaviour in other regimes of the loading parameter alpha, can often be described by a simple rescaling of alpha depending on the strength and type of the noise. We then consider the problem of the optimal noise level for Gibbsian and Bayesian learning, looking at replica symmetry breaking as well. Finally, we consider the question of why learning with errors is useful at all.
引用
收藏
页码:8541 / 8571
页数:31
相关论文
共 50 条
  • [41] Crystal structure and phase transitions of the ferroelectric antimony sulfoiodide SbSI. Part II. Crystal structure of SbSI in phases I, II and III
    Lukaszewicz, K
    Pietraszko, A
    Stepien-Damm, J
    Kajokas, A
    POLISH JOURNAL OF CHEMISTRY, 1997, 71 (12) : 1852 - 1857
  • [42] Reading depth of the magnetic Barkhausen noise. II. Two-phase surface-treated steels
    Stupakov, A.
    Perevertov, A.
    Neslusan, M.
    JOURNAL OF MAGNETISM AND MAGNETIC MATERIALS, 2020, 513
  • [43] Comparable Evaluation of Leather Waterproofing Behaviour upon Hide Quality. II. Influence of Finishing on Leather Properties
    Jankauskaite, Virginija
    Gulbiniene, Ada
    Jiyembetova, Indira
    Sirvaityte, Justa
    Urbelis, Virginijus
    Mickus, Kazys Vytautas
    MATERIALS SCIENCE-MEDZIAGOTYRA, 2014, 20 (02): : 165 - 170
  • [44] Phase Behaviour and Physical Property Measurements for VAPEX Solvents: Part II. Propane, Carbon Dioxide and Athabasca Bitumen
    Badamchi-Zadeh, A.
    Yarranton, H. W.
    Maini, B. B.
    Satyro, M. A.
    JOURNAL OF CANADIAN PETROLEUM TECHNOLOGY, 2009, 48 (03): : 57 - 65
  • [45] Excited-state quantum phase transitions in systems with two degrees of freedom: II. Finite-size effects
    Stransky, Pavel
    Macek, Michal
    Leviatan, Amiram
    Cejnar, Pavel
    ANNALS OF PHYSICS, 2015, 356 : 57 - 82
  • [46] Gravitational waves from vacuum first-order phase transitions. II. From thin to thick walls
    Cutting, Daniel
    Escartin, Elba Granados
    Hindmarsh, Mark
    Weir, David J.
    PHYSICAL REVIEW D, 2021, 103 (02)
  • [47] Polarised vibrational spectra of betaine ortho-phosphoric acid complex.: Part II.: Phase transitions studies
    Ilczyszyn, MM
    SPECTROCHIMICA ACTA PART A-MOLECULAR AND BIOMOLECULAR SPECTROSCOPY, 2003, 59 (05) : 963 - 977
  • [48] Understanding the complex metallic element Mn.: II.: Geometric frustration in β-Mn, phase stability, and phase transitions -: art. no. 014408
    Hafner, J
    Hobbs, D
    PHYSICAL REVIEW B, 2003, 68 (01):
  • [49] The influence of step-type behaviour of phase control on signal/noise ratio in adaptive antenna arrays
    Voloshina, V.A.
    Gabriel'yan, D.D.
    Shatskij, V.V.
    Izvestiya Vysshikh Uchebnykh Zavedenij. Radioelektronika, 1995, 38 (07): : 67 - 69
  • [50] Noise-induced dynamic symmetry breaking and stochastic transitions in ABA molecules: II. Symmetric-antisymmetric normal mode switching
    Kryvohuz, Maksym
    Cao, Jianshu
    CHEMICAL PHYSICS, 2010, 370 (1-3) : 258 - 269