Evolutionary convolutional neural networks: An application to handwriting recognition

被引:107
|
作者
Baldominos, Alejandro [1 ]
Saez, Yago [1 ]
Isasi, Pedro [1 ]
机构
[1] Univ Carlos III Madrid, Comp Sci Dept, Ave Univ 30, Madrid 28911, Spain
关键词
Neuroevolution; Evolutionary algorithms; Convolutional neural networks; Automatic topology design; Genetic algorithms; Grammatical evolution;
D O I
10.1016/j.neucom.2017.12.049
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Convolutional neural networks (CNNs) have been used over the past years to solve many different artificial intelligence (AI) problems, providing significant advances in some domains and leading to state-of-the-art results. However, the topologies of CNNs involve many different parameters, and in most cases, their design remains a manual process that involves effort and a significant amount of trial and error. In this work, we have explored the application of neuroevolution to the automatic design of CNN topologies, introducing a common framework for this task and developing two novel solutions based on genetic algorithms and grammatical evolution. We have evaluated our proposal using the MNIST dataset for handwritten digit recognition, achieving a result that is highly competitive with the state-of-the-art without any kind of data augmentation or preprocessing. When misclassified samples are carefully observed, it is found that most of them involve handwritten digits that are difficult to recognize even by a human. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:38 / 52
页数:15
相关论文
共 50 条
  • [31] Dropout improves Recurrent Neural Networks for Handwriting Recognition
    Vu Pham
    Bluche, Theodore
    Kermorvant, Christopher
    Louradour, Jerome
    [J]. 2014 14TH INTERNATIONAL CONFERENCE ON FRONTIERS IN HANDWRITING RECOGNITION (ICFHR), 2014, : 285 - 290
  • [32] Faster Evolutionary Convolutional Neural Networks Based on iSSO for Lesion Recognition in Medical Images
    Zhu, Wenbo
    Yeh, Weichang
    Cao, Liang
    Zhu, Zhengjun
    Chen, Dafeng
    Chen, Jianwen
    Li, Aiyuan
    Lin, Yangyang
    [J]. BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2019, 124 : 329 - 329
  • [33] Hybridizing Evolutionary Computation and Deep Neural Networks: An Approach to Handwriting Recognition Using Committees and Transfer Learning
    Baldominos, Alejandro
    Saez, Yago
    Isasi, Pedro
    [J]. COMPLEXITY, 2019, 2019
  • [34] Unsupervised Adaptation of Neural Networks for Chinese Handwriting Recognition
    Yang, Hong-Ming
    Zhang, Xu-Yao
    Yin, Fei
    Luo, Zhenbo
    Liu, Cheng-Lin
    [J]. PROCEEDINGS OF 2016 15TH INTERNATIONAL CONFERENCE ON FRONTIERS IN HANDWRITING RECOGNITION (ICFHR), 2016, : 512 - 517
  • [35] Handwriting Recognition by Attribute Embedding and Recurrent Neural Networks
    Ignacio Toledo, J.
    Dey, Sounak
    Fornes, Alicia
    Llados, Josep
    [J]. 2017 14TH IAPR INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION (ICDAR), VOL 1, 2017, : 1038 - 1043
  • [36] Mongolian Handwriting Character Recognition Based On Convolutional Neural Network(CNN)
    Natsagdorj, Narankhuu
    [J]. PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE ON INFORMATION ENGINEERING FOR MECHANICS AND MATERIALS, 2016, 97 : 580 - 584
  • [37] Evolutionary Convolutional Neural Networks Using ABC
    Zhu, Wenbo
    Yeh, Weichang
    Chen, Jianwen
    Chen, Dafeng
    Li, Aiyuan
    Lin, Yangyang
    [J]. ICMLC 2019: 2019 11TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND COMPUTING, 2019, : 156 - 162
  • [38] Parallelizing Convolutional Neural Network for the Handwriting Recognition Problems with Different Architectures
    Zhou, Junhao
    Chen, Weibin
    Peng, Guishen
    Xiao, Hong
    Wang, Hao
    Chen, Zhigang
    [J]. PROCEEDINGS OF 2017 IEEE INTERNATIONAL CONFERENCE ON PROGRESS IN INFORMATICS AND COMPUTING (PIC 2017), 2017, : 71 - 76
  • [39] Evolutionary prototyping for handwriting recognition
    Cordella, L. P.
    De Stefano, C.
    Fontanella, F.
    [J]. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2007, 21 (01) : 157 - 178
  • [40] Multi-Stroke handwriting character recognition based on sEMG using convolutional-recurrent neural networks
    Guadalupe Beltran-Hernandez, Jose
    Ruiz-Pinales, Jose
    Lopez-Rodriguez, Pedro
    Luis Lopez-Ramirez, Jose
    Gabriel Avina-Cervantes, Juan
    [J]. MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2020, 17 (05) : 5432 - 5448