A novel neural network using the genetic algorithm and structure of the support vector machine

Recently, deep learning has been studied as one of the most effective methods in the machine-learning field, and lots of results have been reported. However, the most effective way to construct neural networks has not yet been determined. Besides, the interpretation of an obtained network by a user is difficult. To solve this problem, we have proposed a neural network with a support vector machine (SVM) called “SVM-NN”. In this proposed method, support vectors in the SVM determine the number of neurons in the neural network and their weights and biases. Then, the hyperplane of the neural network is expected to behave similarly to that of the SVM before training. This method has an advantage in that users can understand the mechanism of the network based on the support vectors. However, there are several problems to apply SVM-NN to real problems. In this study, we proposed the SVM-NN with the genetic algorithm. To confirm the effectiveness of proposed methods, the computer simulations are carried out taking benchmark problems as examples. © 2020 The Institute of Electrical Engineers of Japan.