Fully Complex-valued Dendritic Neuron Model

被引:54
|
作者
Gao, Shangce [1 ]
Zhou, MengChu [2 ]
Wang, Ziqian [1 ]
Sugiyama, Daiki [3 ]
Cheng, Jiujun [4 ]
Wang, Jiahai [5 ]
Todo, Yuki [6 ]
机构
[1] Univ Toyama, Fac Engn, Toyama 9308555, Japan
[2] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
[3] NEC Solut Innovators Ltd, Tokyo 1368627, Japan
[4] Tongji Univ, Dept Comp Sci & Technol, Key Lab Embedded Syst & Serv Comp, Minist Educ, Shanghai 200092, Peoples R China
[5] Sun Yat Sen Univ, Sch Comp Sci & Engn, Guangzhou 510275, Peoples R China
[6] Kanazawa Univ, Fac Elect Informat & Commun Engn, Kanazawa, Ishikawa 9201192, Japan
基金
中国国家自然科学基金;
关键词
Neurons; Biological neural networks; Task analysis; Convergence; Dendrites (neurons); Computer architecture; Computational modeling; Activation functions; complex back-propagation (BP); complex domain; complex-valued neural networks; dendritic neuron model (DNM); elementary transcendental functions; McCulloch-Pitts neuron; LEARNING ALGORITHM; BACKPROPAGATION ALGORITHM; MULTILAYER PERCEPTRON; SEARCH ALGORITHM; SINGLE-NEURON; NETWORK; SYNCHRONIZATION; OPTIMIZATION; INPUTS; PHASE;
D O I
10.1109/TNNLS.2021.3105901
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A single dendritic neuron model (DNM) that owns the nonlinear information processing ability of dendrites has been widely used for classification and prediction. Complex-valued neural networks that consist of a number of multiple/deep-layer McCulloch-Pitts neurons have achieved great successes so far since neural computing was utilized for signal processing. Yet no complex value representations appear in single neuron architectures. In this article, we first extend DNM from a real-value domain to a complex-valued one. Performance of complex-valued DNM (CDNM) is evaluated through a complex xor problem, a non-minimum phase equalization problem, and a real-world wind prediction task. Also, a comparative analysis on a set of elementary transcendental functions as an activation function is implemented and preparatory experiments are carried out for determining hyperparameters. The experimental results indicate that the proposed CDNM significantly outperforms real-valued DNM, complex-valued multi-layer perceptron, and other complex-valued neuron models.
引用
收藏
页码:2105 / 2118
页数:14
相关论文
共 50 条
  • [1] Stochastic adaptive CL-BFGS algorithms for fully complex-valued dendritic neuron model
    Wang, Yuelin
    Wang, Zhidong
    Huang, He
    KNOWLEDGE-BASED SYSTEMS, 2023, 277
  • [2] FCCNs: Fully Complex-valued Convolutional Networks using Complex-valued Color Model and Loss Function
    Yadav, Saurabh
    Jerripothula, Koteswar Rao
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 10655 - 10664
  • [3] The computational power of complex-valued neuron
    Nitta, T
    ARTIFICAIL NEURAL NETWORKS AND NEURAL INFORMATION PROCESSING - ICAN/ICONIP 2003, 2003, 2714 : 993 - 1000
  • [4] Complex-valued Nagumo-Sato model of a single neuron
    Nemoto, I
    Saitoh, K
    KNOWLEDGE-BASED INTELLIGENT INFORMATION ENGINEERING SYSTEMS & ALLIED TECHNOLOGIES, PTS 1 AND 2, 2001, 69 : 566 - 570
  • [5] A Fully Complex-Valued Neural Network for Rapid Solution of Complex-Valued Systems of Linear Equations
    Xiao, Lin
    Meng, Weiwei
    Lu, Rongbo
    Yang, Xi
    Liao, Bolin
    Ding, Lei
    ADVANCES IN NEURAL NETWORKS - ISNN 2015, 2015, 9377 : 444 - 451
  • [6] DYNAMICS OF FULLY COMPLEX-VALUED NEURAL NETWORKS
    HIROSE, A
    ELECTRONICS LETTERS, 1992, 28 (16) : 1492 - 1494
  • [7] Complex-Valued Neural Network in Signal Processing: A Study on the Effectiveness of Complex Valued Generalized Mean Neuron Model
    Pande, Anupama
    Thakur, Ashok Kumar
    Roy, Swapnoneel
    PROCEEDINGS OF WORLD ACADEMY OF SCIENCE, ENGINEERING AND TECHNOLOGY, VOL 27, 2008, 27 : 240 - 245
  • [8] A Fully Complex-Valued Gradient Neural Network for Rapidly Computing Complex-Valued Linear Matrix Equations
    Xiao Lin
    Lu Rongbo
    CHINESE JOURNAL OF ELECTRONICS, 2017, 26 (06) : 1194 - 1197
  • [9] A Fully Complex-Valued Gradient Neural Network for Rapidly Computing Complex-Valued Linear Matrix Equations
    XIAO Lin
    LU Rongbo
    Chinese Journal of Electronics, 2017, 26 (06) : 1194 - 1197
  • [10] Complex-valued recurrent neural network with IIR neuron model: Training and applications
    Li, CG
    Liao, XG
    Yu, JB
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2002, 21 (05) : 461 - 471