Fully Complex-valued Dendritic Neuron Model

被引:54
|
作者
Gao, Shangce [1 ]
Zhou, MengChu [2 ]
Wang, Ziqian [1 ]
Sugiyama, Daiki [3 ]
Cheng, Jiujun [4 ]
Wang, Jiahai [5 ]
Todo, Yuki [6 ]
机构
[1] Univ Toyama, Fac Engn, Toyama 9308555, Japan
[2] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
[3] NEC Solut Innovators Ltd, Tokyo 1368627, Japan
[4] Tongji Univ, Dept Comp Sci & Technol, Key Lab Embedded Syst & Serv Comp, Minist Educ, Shanghai 200092, Peoples R China
[5] Sun Yat Sen Univ, Sch Comp Sci & Engn, Guangzhou 510275, Peoples R China
[6] Kanazawa Univ, Fac Elect Informat & Commun Engn, Kanazawa, Ishikawa 9201192, Japan
基金
中国国家自然科学基金;
关键词
Neurons; Biological neural networks; Task analysis; Convergence; Dendrites (neurons); Computer architecture; Computational modeling; Activation functions; complex back-propagation (BP); complex domain; complex-valued neural networks; dendritic neuron model (DNM); elementary transcendental functions; McCulloch-Pitts neuron; LEARNING ALGORITHM; BACKPROPAGATION ALGORITHM; MULTILAYER PERCEPTRON; SEARCH ALGORITHM; SINGLE-NEURON; NETWORK; SYNCHRONIZATION; OPTIMIZATION; INPUTS; PHASE;
D O I
10.1109/TNNLS.2021.3105901
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A single dendritic neuron model (DNM) that owns the nonlinear information processing ability of dendrites has been widely used for classification and prediction. Complex-valued neural networks that consist of a number of multiple/deep-layer McCulloch-Pitts neurons have achieved great successes so far since neural computing was utilized for signal processing. Yet no complex value representations appear in single neuron architectures. In this article, we first extend DNM from a real-value domain to a complex-valued one. Performance of complex-valued DNM (CDNM) is evaluated through a complex xor problem, a non-minimum phase equalization problem, and a real-world wind prediction task. Also, a comparative analysis on a set of elementary transcendental functions as an activation function is implemented and preparatory experiments are carried out for determining hyperparameters. The experimental results indicate that the proposed CDNM significantly outperforms real-valued DNM, complex-valued multi-layer perceptron, and other complex-valued neuron models.
引用
收藏
页码:2105 / 2118
页数:14
相关论文
共 50 条
  • [41] A fully complex-valued radial basis function classifier for real-valued classification problems
    Savitha, R.
    Suresh, S.
    Sundararajan, N.
    Kim, H. J.
    NEUROCOMPUTING, 2012, 78 (01) : 104 - 110
  • [42] Novel complex-valued neural network for dynamic complex-valued matrix inversion
    Liao B.
    Xiao L.
    Jin J.
    Ding L.
    Liu M.
    2016, Fuji Technology Press (20) : 132 - 138
  • [43] Novel Complex-Valued Neural Network for Dynamic Complex-Valued Matrix Inversion
    Liao, Bolin
    Xiao, Lin
    Jin, Jie
    Ding, Lei
    Liu, Mei
    JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2016, 20 (01) : 132 - 138
  • [44] Uniqueness of feedforward complex-valued neural network with a given complex-valued function
    Nitta, T
    KNOWLEDGE-BASED INTELLIGENT INFORMATION ENGINEERING SYSTEMS & ALLIED TECHNOLOGIES, PTS 1 AND 2, 2001, 69 : 550 - 554
  • [45] Solving the XOR problem and the detection of symmetry using a single complex-valued neuron
    Nitta, T
    NEURAL NETWORKS, 2003, 16 (08) : 1101 - 1105
  • [46] Protein acetylation sites with complex-valued polynomial model
    Wenzheng Bao
    Bin Yang
    Frontiers of Computer Science, 2024, 18
  • [47] Protein acetylation sites with complex-valued polynomial model
    Bao, Wenzheng
    Yang, Bin
    FRONTIERS OF COMPUTER SCIENCE, 2024, 18 (03)
  • [48] Complex-Valued SIRMs Connected Fuzzy Inference Model
    Seki, Hirosato
    Nakashima, Tomoharu
    2014 IEEE INTERNATIONAL CONFERENCE ON GRANULAR COMPUTING (GRC), 2014, : 250 - 253
  • [49] BIFURCATION IN A COMPLEX-VALUED WAVE-FIELD MODEL
    AUGUSTEIJN, MF
    BREITENBERGER, E
    PHYSICA D, 1983, 6 (03): : 321 - 336
  • [50] Quantum-Inspired Fully Complex-Valued Neutral Network for Sentiment Analysis
    Lai, Wei
    Shi, Jinjing
    Chang, Yan
    AXIOMS, 2023, 12 (03)