Uniqueness Theorem of Complex-Valued Neural Networks with Polar-Represented Activation Function

被引:7
|
作者
Kobayashi, Masaki [1 ]
机构
[1] Yamanashi Univ, Interdisciplinary Grad Sch, Kofu, Yamanashi 4008511, Japan
关键词
complex-valued neural networks; activation function; reducibility; uniqueness theorem; BACKPROPAGATION ALGORITHM; MULTILAYER PERCEPTRONS; HIERARCHICAL STRUCTURES; LOCAL MINIMA;
D O I
10.1587/transfun.E98.A.1937
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Several models of feed-forward complex-valued neural networks have been proposed, and those with split and polar-represented activation functions have been mainly studied. Neural networks with split activation functions are relatively easy to analyze, but complex-valued neural networks with polar-represented functions have many applications but are difficult to analyze. In previous research, Nitta proved the uniqueness theorem of complex-valued neural networks with split activation functions. Subsequently, he studied their critical points, which caused plateaus and local minima in their learning processes. Thus, the uniqueness theorem is closely related to the learning process. In the present work, we first define three types of reducibility for feed-forward complex-valued neural networks with polar-represented activation functions and prove that we can easily transform reducible complex-valued neural networks into irreducible ones. We then prove the uniqueness theorem of complex-valued neural networks with polar-represented activation functions.
引用
收藏
页码:1937 / 1943
页数:7
相关论文
共 50 条
  • [1] FPGA Implementation of Complex-Valued Neural Network for Polar-Represented Image Classification
    Ahmad, Maruf
    Zhang, Lei
    Chowdhury, Muhammad E. H.
    [J]. SENSORS, 2024, 24 (03)
  • [2] The uniqueness theorem for complex-valued neural networks with threshold parameters and the redundancy of the parameters
    Nitta, Tohru
    [J]. INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2008, 18 (02) : 123 - 134
  • [3] Uniqueness of feedforward complex-valued neural network with a given complex-valued function
    Nitta, T
    [J]. KNOWLEDGE-BASED INTELLIGENT INFORMATION ENGINEERING SYSTEMS & ALLIED TECHNOLOGIES, PTS 1 AND 2, 2001, 69 : 550 - 554
  • [4] The universal approximation theorem for complex-valued neural networks
    Voigtlaender, Felix
    [J]. APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2023, 64 : 33 - 61
  • [5] Complex-Valued Neural Networks With Nonparametric Activation Functions
    Scardapane, Simone
    Van Vaerenbergh, Steven
    Hussain, Amir
    Uncini, Aurelio
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2020, 4 (02): : 140 - 150
  • [6] Efficient RSOA modelling using polar complex-valued neural networks
    Dghais, Wael
    Ribeiro, Vitor
    Liu, Zhansheng
    Vujicic, Zoran
    Violas, Manuel
    Teixeira, Antonio
    [J]. OPTICS COMMUNICATIONS, 2015, 334 : 129 - 132
  • [7] Singularities of Three-Layered Complex-Valued Neural Networks With Split Activation Function
    Kobayashi, Masaki
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (05) : 1900 - 1907
  • [8] Multistability of complex-valued neural networks with discontinuous activation functions
    Liang, Jinling
    Gong, Weiqiang
    Huang, Tingwen
    [J]. NEURAL NETWORKS, 2016, 84 : 125 - 142
  • [9] On energy function for complex-valued neural networks and its applications
    Kuroe, Y
    Hashimoto, N
    Mori, T
    [J]. ICONIP'02: PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON NEURAL INFORMATION PROCESSING: COMPUTATIONAL INTELLIGENCE FOR THE E-AGE, 2002, : 1079 - 1083
  • [10] Complex-Valued Logic for Neural Networks
    Kagan, Evgeny
    Rybalov, Alexander
    Yager, Ronald
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON THE SCIENCE OF ELECTRICAL ENGINEERING IN ISRAEL (ICSEE), 2018,