A pruning algorithm for training neural network ensembles

This paper presents a pruning algorithm i.e., Dynamic Ensemble Pruning Algorithm (DEPA) by utilizing the knowledge of overfitting and importance of hidden node. The generalization performance of a machine learner depends oil how much it avoids the overfitting. The main idea of this algorithm is to reduce the complexity of ensemble networks according to overfitting oil progress toward training. DEPA emphasizes oil avoiding "overfitting" by dynamically deleting individual neural networks and their hidden nodes starting from a large number of individual neural networks. DEPA has been tested on several standard benchmark problems in machine learning and neural networks, including breast cancer, diabetes and heart disease problems. The experimental results show that DEPA can produce neural network ensembles with good generalization ability.