A novel global hybrid algorithm for feedforward neural networks

A novel global optimization hybrid algorithm was presented for training neural networks in this paper. During the course of neural networks training, when the weights are being adjusted with Quasi-Newton(QN) method, the error function may be stuck in a local minimum. In order to solve this problem, a original Filled-Function was created and proved. It was combined with QN method to become a global optimization hybrid algorithm. When the net is trained with our new hybrid algorithm, if error function was tripped in a local minimal point, the new hybrid algorithm was able to help networks out of the local minimal point. After that, the weights could being adjusted until the global minimal point for weights vector was found. One illustrative example is used to demonstrate the effectiveness of the presented scheme.