Uniqueness Theorem of Complex-Valued Neural Networks with Polar-Represented Activation Function

被引:7
|
作者
Kobayashi, Masaki [1 ]
机构
[1] Yamanashi Univ, Interdisciplinary Grad Sch, Kofu, Yamanashi 4008511, Japan
关键词
complex-valued neural networks; activation function; reducibility; uniqueness theorem; BACKPROPAGATION ALGORITHM; MULTILAYER PERCEPTRONS; HIERARCHICAL STRUCTURES; LOCAL MINIMA;
D O I
10.1587/transfun.E98.A.1937
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Several models of feed-forward complex-valued neural networks have been proposed, and those with split and polar-represented activation functions have been mainly studied. Neural networks with split activation functions are relatively easy to analyze, but complex-valued neural networks with polar-represented functions have many applications but are difficult to analyze. In previous research, Nitta proved the uniqueness theorem of complex-valued neural networks with split activation functions. Subsequently, he studied their critical points, which caused plateaus and local minima in their learning processes. Thus, the uniqueness theorem is closely related to the learning process. In the present work, we first define three types of reducibility for feed-forward complex-valued neural networks with polar-represented activation functions and prove that we can easily transform reducible complex-valued neural networks into irreducible ones. We then prove the uniqueness theorem of complex-valued neural networks with polar-represented activation functions.
引用
收藏
页码:1937 / 1943
页数:7
相关论文
共 50 条
  • [41] Relaxation of the stability condition of the complex-valued neural networks
    Lee, DL
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2001, 12 (05): : 1260 - 1262
  • [42] Optimal approximation using complex-valued neural networks
    Geuchen, Paul
    Voigtlaender, Felix
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [43] FRACTAL VARIATION OF ATTRACTORS IN COMPLEX-VALUED NEURAL NETWORKS
    HIROSE, A
    [J]. NEURAL PROCESSING LETTERS, 1994, 1 (01) : 6 - 8
  • [44] Quantitative Approximation Results for Complex-Valued Neural Networks
    Caragea, Andrei
    Lee, Dae Gwan
    Maly, Johannes
    Pfander, Goetz
    Voigtlaender, Felix
    [J]. SIAM JOURNAL ON MATHEMATICS OF DATA SCIENCE, 2022, 4 (02): : 553 - 580
  • [45] An Introduction to Complex-Valued Recurrent Correlation Neural Networks
    Valle, Marcos Eduardo
    [J]. PROCEEDINGS OF THE 2014 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2014, : 3387 - 3394
  • [46] Multistability of complex-valued neural networks with distributed delays
    Gong, Weiqiang
    Liang, Jinling
    Zhang, Congjun
    [J]. NEURAL COMPUTING & APPLICATIONS, 2017, 28 : S1 - S14
  • [47] An augmented CRTRL for complex-valued recurrent neural networks
    Goh, Su Lee
    Mandic, Danilo P.
    [J]. NEURAL NETWORKS, 2007, 20 (10) : 1061 - 1066
  • [48] Multistability and Multiperiodicity Analysis of Complex-Valued Neural Networks
    Hu, Jin
    Wang, Jun
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2014, 2014, 8866 : 59 - 68
  • [49] Representation of complex-valued neural networks: A real-valued approach
    Yadav, A
    Mishra, D
    Ray, S
    Yadav, RN
    Kalra, PK
    [J]. 2005 International Conference on Intelligent Sensing and Information Processing, Proceedings, 2005, : 331 - 335
  • [50] A Structural Optimization Algorithm for Complex-Valued Neural Networks
    Dong, Zhongying
    Huang, He
    [J]. 2019 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2019), 2019, : 1530 - 1535