Am activation function adapting training algorithm for sigmoidal feedforward networks

被引：50
|
作者：
Chandra, P [1 ]
Singh, Y [1 ]
机构：
[1] GGS Indraprastha Univ, Sch Informat Technol, Delhi 110006, India
来源：
NEUROCOMPUTING | 2004年 / 61卷
关键词：
feedforward artificial neural networks; sigmoidal activation; squashing function; self-adaptation;
D O I：
10.1016/j.neucom.2004.04.001
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
The universal approximation results for sigmoidal feedforward artificial neural networks do not recommend a preferred activation function. In this paper a new activation function adapting algorithm is proposed for sigmoidal feedforward neural network training. The algorithm is compared against the backpropagation algorithm on four function approximation tasks. The results demonstrate that the proposed algorithm can be an order of magnitude faster than the backpropagation algorithm. (C) 2004 Elsevier B.V. All rights reserved.
引用
收藏
页码：429 / 437
页数：9
相关论文
共 50 条
  • [1] Bi-modal derivative activation function for sigmoidal feedforward networks
    Sodhi, Sartaj Singh
    Chandra, Pravin
    [J]. NEUROCOMPUTING, 2014, 143 : 182 - 196
  • [2] A Non-Sigmoidal Activation Function for Feedforward Artificial Neural Networks
    Chandra, Pravin
    Ghose, Udayan
    Sood, Apoorvi
    [J]. 2015 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2015,
  • [3] Function estimation by feedforward sigmoidal networks with bounded weights
    Rao, NSV
    Protopopescu, V
    [J]. NEURAL PROCESSING LETTERS, 1998, 7 (03) : 125 - 131
  • [4] Sigmoidal Function Classes for Feedforward Artificial Neural Networks
    Pravin Chandra
    [J]. Neural Processing Letters, 2003, 18 (3) : 205 - 215
  • [5] Function Estimation by Feedforward Sigmoidal Networks with Bounded Weights
    Nageswara S.V. Rao
    Vladimir Protopopescu
    [J]. Neural Processing Letters, 1998, 7 : 125 - 131
  • [6] Sigmoidal function classes for feedforward artificial neural networks
    Chandra, P
    [J]. NEURAL PROCESSING LETTERS, 2003, 18 (03) : 185 - 195
  • [7] Bi-modal derivative adaptive activation function sigmoidal feedforward artificial neural networks
    Mishra, Akash
    Chandra, Pravin
    Ghose, Udayan
    Sodhi, Sartaj Singh
    [J]. APPLIED SOFT COMPUTING, 2017, 61 : 983 - 994
  • [8] Construction and approximation for a class of feedforward neural networks with sigmoidal function
    Meng, Xinhong
    Yan, Jinyao
    Ye, Hailiang
    Cao, Feilong
    [J]. INTERNATIONAL JOURNAL OF WAVELETS MULTIRESOLUTION AND INFORMATION PROCESSING, 2023, 21 (06)
  • [9] TRAINING FEEDFORWARD NETWORKS WITH THE MARQUARDT ALGORITHM
    HAGAN, MT
    MENHAJ, MB
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (06): : 989 - 993
  • [10] A hybrid training algorithm for feedforward neural networks
    Ben Nasr, Mounir
    Chtourou, Mohamed
    [J]. NEURAL PROCESSING LETTERS, 2006, 24 (02) : 107 - 117
12345