Uniqueness Theorem of Complex-Valued Neural Networks with Polar-Represented Activation Function

被引:7
|
作者
Kobayashi, Masaki [1 ]
机构
[1] Yamanashi Univ, Interdisciplinary Grad Sch, Kofu, Yamanashi 4008511, Japan
关键词
complex-valued neural networks; activation function; reducibility; uniqueness theorem; BACKPROPAGATION ALGORITHM; MULTILAYER PERCEPTRONS; HIERARCHICAL STRUCTURES; LOCAL MINIMA;
D O I
10.1587/transfun.E98.A.1937
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Several models of feed-forward complex-valued neural networks have been proposed, and those with split and polar-represented activation functions have been mainly studied. Neural networks with split activation functions are relatively easy to analyze, but complex-valued neural networks with polar-represented functions have many applications but are difficult to analyze. In previous research, Nitta proved the uniqueness theorem of complex-valued neural networks with split activation functions. Subsequently, he studied their critical points, which caused plateaus and local minima in their learning processes. Thus, the uniqueness theorem is closely related to the learning process. In the present work, we first define three types of reducibility for feed-forward complex-valued neural networks with polar-represented activation functions and prove that we can easily transform reducible complex-valued neural networks into irreducible ones. We then prove the uniqueness theorem of complex-valued neural networks with polar-represented activation functions.
引用
收藏
页码:1937 / 1943
页数:7
相关论文
共 50 条
  • [21] Symmetric Complex-Valued Hopfield Neural Networks
    Kobayashi, Masaki
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (04) : 1011 - 1015
  • [22] DYNAMICS OF FULLY COMPLEX-VALUED NEURAL NETWORKS
    HIROSE, A
    [J]. ELECTRONICS LETTERS, 1992, 28 (16) : 1492 - 1494
  • [23] On the Computational Complexities of Complex-valued Neural Networks
    Mayer, Kayol S.
    Soares, Jonathan A.
    Cruz, Ariadne A.
    Arantes, Dalton S.
    [J]. 2023 IEEE LATIN-AMERICAN CONFERENCE ON COMMUNICATIONS, LATINCOM, 2023,
  • [24] Exceptional Reducibility of Complex-Valued Neural Networks
    Kobayashi, Masaki
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2010, 21 (07): : 1060 - 1072
  • [25] Stochastic Complex-valued Neural Networks for Radar
    Ouabi, Othmane-Latif
    Pribic, Radmila
    Olaru, Sorin
    [J]. 28TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2020), 2021, : 1442 - 1446
  • [26] Complex-valued neural networks with adaptive spline activation function for digital radio links nonlinear equalization
    Uncini, A
    Vecci, L
    Campolucci, P
    Piazza, F
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1999, 47 (02) : 505 - 514
  • [27] Entanglement Detection with Complex-Valued Neural Networks
    Qu, Yue-Di
    Zhang, Rui-Qi
    Shen, Shu-Qian
    Yu, Juan
    Li, Ming
    [J]. INTERNATIONAL JOURNAL OF THEORETICAL PHYSICS, 2023, 62 (09)
  • [28] Lebesgue's Convergence Theorem of Complex-Valued Function
    Narita, Keiko
    Endou, Noboru
    Shidama, Yasunari
    [J]. FORMALIZED MATHEMATICS, 2009, 17 (02): : 137 - 145
  • [29] Dynamical Behavior of Complex-Valued Hopfield Neural Networks with Discontinuous Activation Functions
    Zengyun Wang
    Zhenyuan Guo
    Lihong Huang
    Xinzhi Liu
    [J]. Neural Processing Letters, 2017, 45 : 1039 - 1061
  • [30] Dynamical Behavior of Complex-Valued Hopfield Neural Networks with Discontinuous Activation Functions
    Wang, Zengyun
    Guo, Zhenyuan
    Huang, Lihong
    Liu, Xinzhi
    [J]. NEURAL PROCESSING LETTERS, 2017, 45 (03) : 1039 - 1061