Fast training of multilayer perceptrons with a mixed norm algorithm

A new fast training algorithm for the Multilayer Perceptron (MLP) is proposed. This new algorithm is based on the optimization of a mixed Least Square (LS) and a Least Fourth (LF) criterion producing a modified form of the standard back propagation algorithm (SBP). To determine the updating rules in the hidden layers, an analogous back propagation strategy used in the conventional learning algorithms is developed. This permits the application of the learning procedure to all the layers. Experimental results on benchmark applications and a real medical problem are obtained which indicates significant reduction in the total number of iterations, the convergence time, and the generalization capacity when compared to those of the SBP algorithm.