Online training for single hidden-layer feedforward neural networks using RLS-ELM

Extreme learning machine (ELM) is one of the effective training algorithms for single hidden layer feedforward neural networks (SLFNs), but it often requires a large number of hidden units which makes the trained networks respond slowly to input patterns. Regularized least-squares extreme learning machine (RLS-ELM) is one of the improvements which can overcome this problem. It determines the input weights including hidden layer biases based on the regularized least squares scheme and the output weights based on the pseudo-inverse operation of hidden layer output matrix. In this paper, we develop the RLS-ELM for online sequential learning to due with large training datasets. It can learn the arriving data with one-by-one and chunk-by-chunk, blocks with different sizes. Experimental results show that the proposed approach can obtain good performance with compact network which results in high speed for both training and testing.