The learning problem of multi-layer neural networks

被引:14
|
作者
Ban, Jung-Chao [1 ]
Chang, Chih-Hung [2 ]
机构
[1] Natl Dong Hwa Univ, Dept Appl Math, Hualien 970003, Taiwan
[2] Feng Chia Univ, Dept Appl Math, Taichung 40724, Taiwan
关键词
Multi-layer neural networks; Topological entropy; Sofic shift; Learning problem; Linear separation; PATTERN;
D O I
10.1016/j.neunet.2013.05.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This manuscript considers the learning problem of multi-layer neural networks (MNNs) with an activation function which comes from cellular neural networks. A systematic investigation of the partition of the parameter space is provided. Furthermore, the recursive formula of the transition matrix of an MNN is obtained. By implementing the well-developed tools in the symbolic dynamical systems, the topological entropy of an MNN can be computed explicitly. A novel phenomenon, the asymmetry of a topological diagram that was seen in Ban, Chang, Lin, and Lin (2009) [J. Differential Equations 246, pp. 552-580,2009], is revealed. (C) 2013 Elsevier Ltd. All rights reserved.
引用
收藏
页码:116 / 123
页数:8
相关论文
共 50 条
  • [31] Multi-Layer and Recursive Neural Networks for Metagenomic Classification
    Ditzler, Gregory
    Polikar, Robi
    Rosen, Gail
    IEEE TRANSACTIONS ON NANOBIOSCIENCE, 2015, 14 (06) : 608 - 616
  • [32] High precision expansion of multi-layer neural networks
    Wang, QY
    Aoyama, T
    Nagashima, U
    PROCEEDING OF THE 2002 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-3, 2002, : 1493 - 1498
  • [33] Gradient conjugate priors and multi-layer neural networks
    Gurevich, Pavel
    Stuke, Hannes
    ARTIFICIAL INTELLIGENCE, 2020, 278
  • [34] Multi-layer neural networks applied to distance relaying
    Coury, DV
    Oleskovicz, M
    INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 1998, 20 (08) : 539 - 542
  • [35] Stability of multi-layer cellular neural/nonlinear networks
    Török, L
    Roska, T
    INTERNATIONAL JOURNAL OF BIFURCATION AND CHAOS, 2004, 14 (10): : 3567 - 3586
  • [36] A New Method of Learning for Multi-Layer Neural Network
    Wang, Rong-Long
    Zhang, Cui
    Okazaki, Kozo
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2007, 7 (05): : 86 - 89
  • [37] A Fast Learning Algorithm for the Multi-layer Neural Network
    Bilski, Jaroslaw
    Kowalczyk, Bartosz
    ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, ICAISC 2022, PT I, 2023, 13588 : 3 - 15
  • [38] Neural Hilbert Ladders: Multi-Layer Neural Networks in Function Space
    Chen, Zhengdao
    JOURNAL OF MACHINE LEARNING RESEARCH, 2024, 25
  • [39] Neural networks having the time-variant connection for multi-layer channel routing problem
    Yamamoto, T
    Jin'no, K
    Hirose, H
    8TH INTERNATIONAL CONFERENCE ON NEURAL INFORMATION PROCESSING, VOLS 1-3, PROCEEDING, 2001, : 642 - 647
  • [40] Learning specific and conserved features of multi-layer networks
    Wu, Wenming
    Yang, Tao
    Ma, Xiaoke
    Zhang, Wensheng
    Li, He
    Huang, Jianbin
    Li, Yanni
    Cui, Jiangtao
    INFORMATION SCIENCES, 2023, 622 : 930 - 945