Handwritten digits recognition using transfer learning

Researchers often focus on building models that maximize overall predictive accuracy. In prac-tice, however, it can be important for a model to yield good accuracy with each class value. Toward this end, a new recognition with a one-step verification methodology is proposed. It emphasizes the accuracy of each class value. The proposed discriminative system constructs an ensemble using several deep Convolutional Neural Networks (CNNs) with the help of statistical information. To the best of our knowledge, this is the first ensemble model that combines many deep CNNs with a focus on maximizing the accuracy for each class, rather than just overall accuracy. Experimental results show that the demonstration models achieved accuracy in the range of 97.82% to 99.72% within only a few epochs, rivaling the state-of-the-art. These results indicate that the performance of the proposed approach substantially improves the intra-class correlation, leading to improved classification accuracy for each class.