Multilayer feedforward networks with adaptive spline activation function

被引:81
|
作者
Guarnieri, S [1 ]
Piazza, F [1 ]
Uncini, A [1 ]
机构
[1] Univ Ancona, Dipartimento Elettron & Automat, I-60131 Ancona, Italy
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 1999年 / 10卷 / 03期
关键词
adaptive activation functions; function shape autotuning; generalization; generalized sigmoidal functions; multilayer perceptron; neural networks; spline neural networks;
D O I
10.1109/72.761726
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
in this paper, a new adaptive spline activation function neural network (ASNN) is presented. Due to the ASNN's high representation capabilities, networks with a small number of interconnections can be trained to solve both pattern recognition and data processing real-time problems. The main idea is to use a Catmull-Rom cubic spline as the neuron's activation function, which ensures a simple structure suitable for both software and hardware implementation. Experimental results demonstrate improvements in terms of generalization capability and of learning speed in both pattern recognition and data processing tasks.
引用
收藏
页码:672 / 683
页数:12
相关论文
共 50 条
  • [31] A Non-Sigmoidal Activation Function for Feedforward Artificial Neural Networks
    Chandra, Pravin
    Ghose, Udayan
    Sood, Apoorvi
    [J]. 2015 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2015,
  • [32] ROBUSTNESS OF REPRESENTATIONS IN MULTILAYER FEEDFORWARD NEURAL NETWORKS
    DIAMOND, P
    FOMENKO, IV
    [J]. CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 1993, 12 (02) : 211 - 221
  • [33] Fault Tolerant Regularizers for Multilayer Feedforward Networks
    Qiao, Deng-yu
    Leung, Chi Sing
    Sum, Pui Fai
    [J]. NEURAL INFORMATION PROCESSING, PT 1, PROCEEDINGS, 2009, 5863 : 277 - +
  • [34] Am activation function adapting training algorithm for sigmoidal feedforward networks
    Chandra, P
    Singh, Y
    [J]. NEUROCOMPUTING, 2004, 61 : 429 - 437
  • [35] Adaptive Morphing Activation Function for Neural Networks
    Herrera-Alcantara, Oscar
    Arellano-Balderas, Salvador
    [J]. FRACTAL AND FRACTIONAL, 2024, 8 (08)
  • [36] Adaptive training and pruning in feedforward networks
    Chang, SJ
    Sum, J
    Wong, KW
    Leung, CS
    [J]. ELECTRONICS LETTERS, 2001, 37 (02) : 106 - 107
  • [37] The faulty behavior of feedforward neural networks with hard-limiting activation function
    Tian, ZY
    Lin, TTY
    Yang, SY
    Tong, SB
    [J]. NEURAL COMPUTATION, 1997, 9 (05) : 1109 - 1126
  • [38] Evolutionary discovery of learning rules for feedforward neural networks with step activation function
    Radi, A
    Poli, R
    [J]. GECCO-99: PROCEEDINGS OF THE GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, 1999, : 1178 - 1183
  • [39] Feedforward Multilayer Phase-Based Neural Networks
    Pavaloiu, Ionel-Bujorel
    Vasile, Adrian
    Rosu, Sebastian Marius
    Dragoi, George
    [J]. 2014 12TH SYMPOSIUM ON NEURAL NETWORK APPLICATIONS IN ELECTRICAL ENGINEERING (NEUREL), 2014, : 125 - 129
  • [40] Hammerstein model identification by multilayer feedforward neural networks
    AlDuwaish, H
    Karim, MN
    Chandrasekar, V
    [J]. INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 1997, 28 (01) : 49 - 54