Extreme Learning Machine with Elastic Net Regularization

Compared with deep neural learning, the extreme learning machine (ELM) can be quickly converged without iteratively tuning hidden nodes. Inspired by this merit, an extreme learning machine with elastic net regularization (ELM-EN) is proposed in this paper. The elastic net is a regularization method that combines LASSO and ridge penalties. This regulartation can keep a balance between system stability and solution's sparsity. Moreover, an excellent optimization method, i.e., accelerated proximal gradient, is used to find the minimum of the system optimization function. Various datasets from UCI repository and two facial expression image datasets are used to validate the efficiency of our system. Final experimental results indicate that our ELM-EN requires less training tine than multi-layer perceptron, and can achieve higher recognition accuracy than ELM and sparse ELM.