Gating creates slow modes and controls phase-space complexity in GRUs and LSTMs

被引：0
|
作者：
Can, Tankut [1 ]
Krishnamurthy, Kamesh [2 ]
Schwab, David J. [1 ]
机构：
[1] Initiative for the Theoretical Sciences, CUNY Graduate Center, United States
[2] Joseph Henry Laboratories of Physics and PNI, Princeton University, United States
来源：
Proceedings of Machine Learning Research | 2020年 / 107卷
关键词：
Control phase - Fixed points - GRU - Jacobians - LSTM - MFT - Phase spaces - RMT - Slow control - Slow mode;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
41
引用
收藏
页码：476 / 511
相关论文
共 19 条
  • [1] Gating creates slow modes and controls phase-space complexity in GRUs and LSTMs
    Can, Tankut
    Krishnamurthy, Kamesh
    Schwab, David J.
    MATHEMATICAL AND SCIENTIFIC MACHINE LEARNING, VOL 107, 2020, 107 : 476 - 511
  • [2] ON THE PHASE-SPACE APPROACH TO COMPLEXITY
    FOGEDBY, HC
    JOURNAL OF STATISTICAL PHYSICS, 1992, 69 (1-2) : 411 - 425
  • [3] Phase-Space Differential Equations for Modes
    Cohen, Leon
    PSEUDO-DIFFERENTIAL OPERATORS: COMPLEX ANALYSIS AND PARTIAL DIFFERENTIAL EQUATIONS, 2010, 205 : 235 - 250
  • [4] COMPLEXITY AND 1/F NOISE - A PHASE-SPACE APPROACH
    ZHANG, YC
    JOURNAL DE PHYSIQUE I, 1991, 1 (07): : 971 - 977
  • [5] Phase-Space of Strong Coupling of Two Bosonic Modes
    Laussy, F. P.
    del Valle, E.
    PHYSICS OF SEMICONDUCTORS: 30TH INTERNATIONAL CONFERENCE ON THE PHYSICS OF SEMICONDUCTORS, 2011, 1399
  • [6] Phase-space analysis of lasing modes in a chaotic microcavity
    Kwon, Tae-Yoon
    Lee, Soo-Young
    Ryu, Jung-Wan
    Hentschel, Martina
    PHYSICAL REVIEW A, 2013, 88 (02):
  • [7] The phase-space dependence of fast on interaction with tearing modes
    Heidbrink, W. W.
    Bardocz, L.
    Collins, C. S.
    Kramer, G. J.
    La Haye, R. J.
    Lin, D. J.
    Muscatello, C. M.
    Podesta, M.
    Stagner, L.
    Van Zeeland, M. A.
    Zhu, Y. B.
    NUCLEAR FUSION, 2018, 58 (08)
  • [8] PHASE-SPACE REPRESENTATION OF MODES IN OPTICAL WAVE-GUIDES
    DRAGOMAN, D
    JOURNAL OF MODERN OPTICS, 1995, 42 (09) : 1815 - 1823
  • [9] ON BELL CORRELATIONS FOR THE PHASE-SPACE OF 2 ENTANGLED LIGHT MODES
    LEONHARDT, U
    PHYSICS LETTERS A, 1993, 182 (2-3) : 195 - 200
  • [10] PHASE-SPACE THEORY OF ELECTRON DETACHMENT IN SLOW ATOMIC-COLLISIONS
    SHUI, VH
    KECK, JC
    JOURNAL OF CHEMICAL PHYSICS, 1973, 59 (10): : 5242 - 5250
12