Dynamic neural network with adaptive neuron activation function

An attempt has been made to establish a nonlinear dynamic discrete-time neuron model, the so called Dynamic Elementary Processor (DEP). This dynamic neuron disposes of local memory, in that it has dynamic states. To accelerate the convergence of proposed extended dynamic error back propagation learning algorithm, the adaptive neuron activation function and momentum method are applied Instead of most popular bipolar and unipolar Sigmoid neuron activation functions, the Gauss activation function with adaptive parameters is proposed. Based on the DEP neuron with adaptive activation function in hidden layer, a Dynamic Multi Layer Neural Network is proposed and tested in prediction of a Glass-Mackey time series.