Fully Complex-valued Dendritic Neuron Model

被引:54
|
作者
Gao, Shangce [1 ]
Zhou, MengChu [2 ]
Wang, Ziqian [1 ]
Sugiyama, Daiki [3 ]
Cheng, Jiujun [4 ]
Wang, Jiahai [5 ]
Todo, Yuki [6 ]
机构
[1] Univ Toyama, Fac Engn, Toyama 9308555, Japan
[2] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
[3] NEC Solut Innovators Ltd, Tokyo 1368627, Japan
[4] Tongji Univ, Dept Comp Sci & Technol, Key Lab Embedded Syst & Serv Comp, Minist Educ, Shanghai 200092, Peoples R China
[5] Sun Yat Sen Univ, Sch Comp Sci & Engn, Guangzhou 510275, Peoples R China
[6] Kanazawa Univ, Fac Elect Informat & Commun Engn, Kanazawa, Ishikawa 9201192, Japan
基金
中国国家自然科学基金;
关键词
Neurons; Biological neural networks; Task analysis; Convergence; Dendrites (neurons); Computer architecture; Computational modeling; Activation functions; complex back-propagation (BP); complex domain; complex-valued neural networks; dendritic neuron model (DNM); elementary transcendental functions; McCulloch-Pitts neuron; LEARNING ALGORITHM; BACKPROPAGATION ALGORITHM; MULTILAYER PERCEPTRON; SEARCH ALGORITHM; SINGLE-NEURON; NETWORK; SYNCHRONIZATION; OPTIMIZATION; INPUTS; PHASE;
D O I
10.1109/TNNLS.2021.3105901
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A single dendritic neuron model (DNM) that owns the nonlinear information processing ability of dendrites has been widely used for classification and prediction. Complex-valued neural networks that consist of a number of multiple/deep-layer McCulloch-Pitts neurons have achieved great successes so far since neural computing was utilized for signal processing. Yet no complex value representations appear in single neuron architectures. In this article, we first extend DNM from a real-value domain to a complex-valued one. Performance of complex-valued DNM (CDNM) is evaluated through a complex xor problem, a non-minimum phase equalization problem, and a real-world wind prediction task. Also, a comparative analysis on a set of elementary transcendental functions as an activation function is implemented and preparatory experiments are carried out for determining hyperparameters. The experimental results indicate that the proposed CDNM significantly outperforms real-valued DNM, complex-valued multi-layer perceptron, and other complex-valued neuron models.
引用
收藏
页码:2105 / 2118
页数:14
相关论文
共 50 条
  • [31] Complex-Valued Neural Network and Complex-Valued Backpropagation Learning Algorithm
    Nitta, Tohru
    ADVANCES IN IMAGING AND ELECTRON PHYSICS, VOL 152, 2008, 152 : 153 - 220
  • [32] A Multi-valued Neuron ELM with Complex-Valued Inputs for System Identification Using FRA
    Grasso, Francesco
    Luchetta, Antonio
    Manetti, Stefano
    PROCEEDINGS OF ELM-2016, 2018, 9 : 11 - 25
  • [33] An Improved Complex-Valued Recurrent Neural Network Model for Time-Varying Complex-Valued Sylvester Equation
    Ding, Lei
    Xiao, Lin
    Zhou, Kaiqing
    Lan, Yonghong
    Zhang, Yongsheng
    Li, Jichun
    IEEE ACCESS, 2019, 7 : 19291 - 19302
  • [34] Fully Complex-Valued Gated Recurrent Neural Network for Ultrasound Imaging
    Lei, Zhenyu
    Gao, Shangce
    Hasegawa, Hideyuki
    Zhang, Zhiming
    Zhou, MengChu
    Sedraoui, Khaled
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (10) : 14918 - 14931
  • [35] Complex-Valued Fully Convolutional Networks for MIMO Radar Signal Segmentation
    Tachibana, Motoko
    Yamamoto, Kohei
    Maeno, Kurato
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2018, E101D (05): : 1445 - 1448
  • [36] Stability and Hopf Bifurcation of Fractional-Order Complex-Valued Single Neuron Model with Time Delay
    Wang, Zhen
    Wang, Xiaohong
    Li, Yuxia
    Huang, Xia
    INTERNATIONAL JOURNAL OF BIFURCATION AND CHAOS, 2017, 27 (13):
  • [37] Complex-valued neuron to describe the dynamics after Hopf bifurcation: an example of CPG model for a biped locomotion
    Nishikawa, Ikuko
    Hayashi, Kohei
    Sakakibara, Kazutoshi
    2007 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-6, 2007, : 327 - +
  • [38] Convergence analysis of an augmented algorithm for fully complex-valued neural networks
    Xu, Dongpo
    Zhang, Huisheng
    Mandic, Danilo P.
    NEURAL NETWORKS, 2015, 69 : 44 - 50
  • [39] Complex-valued tapers
    Politis, DN
    IEEE SIGNAL PROCESSING LETTERS, 2005, 12 (07) : 512 - 515
  • [40] Complex-valued autoencoders
    Baldi, Pierre
    Lu, Zhiqin
    NEURAL NETWORKS, 2012, 33 : 136 - 147