Online Learning Algorithm of Gaussian Process Based on Adaptive Natural Gradient for Regression

dGaussian Process (GP) is a new learning method on nonlinear system modeling. The most common way of model training is conjugate gradient method, but this method should compute Heisenberg matrix which needs much computing resource. It is not a suitable training method for online learning algorithm. There is one online learning algorithm of GP which is named sparse online GP now. This algorithm has constraint to the training data sets. In order to satisfy the real-time modeling without the limit of the training data sets, an online algorithm of GP based on adaptive natural gradient (ANG) is proposed in this paper. The algorithm is applied in Continuous Stirred Tank Reactor (CSTR) modeling and the sparse online GP is also applied in CSTR modeling for comparison. Obtained from the simulation results, the algorithm is effective and has higher Accuracy compared with the sparse online GP algorithm.