Evolutionary convolutional neural networks: An application to handwriting recognition

被引:107
|
作者
Baldominos, Alejandro [1 ]
Saez, Yago [1 ]
Isasi, Pedro [1 ]
机构
[1] Univ Carlos III Madrid, Comp Sci Dept, Ave Univ 30, Madrid 28911, Spain
关键词
Neuroevolution; Evolutionary algorithms; Convolutional neural networks; Automatic topology design; Genetic algorithms; Grammatical evolution;
D O I
10.1016/j.neucom.2017.12.049
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Convolutional neural networks (CNNs) have been used over the past years to solve many different artificial intelligence (AI) problems, providing significant advances in some domains and leading to state-of-the-art results. However, the topologies of CNNs involve many different parameters, and in most cases, their design remains a manual process that involves effort and a significant amount of trial and error. In this work, we have explored the application of neuroevolution to the automatic design of CNN topologies, introducing a common framework for this task and developing two novel solutions based on genetic algorithms and grammatical evolution. We have evaluated our proposal using the MNIST dataset for handwritten digit recognition, achieving a result that is highly competitive with the state-of-the-art without any kind of data augmentation or preprocessing. When misclassified samples are carefully observed, it is found that most of them involve handwritten digits that are difficult to recognize even by a human. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:38 / 52
页数:15
相关论文
共 50 条
  • [1] Gated Convolutional Recurrent Neural Networks for Multilingual Handwriting Recognition
    Bluche, Theodore
    Messina, Ronaldo
    [J]. 2017 14TH IAPR INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION (ICDAR), VOL 1, 2017, : 646 - 651
  • [2] Farsi Handwriting Digit Recognition based on Convolutional Neural Networks
    Dehghanian, Atefeh
    Ghods, Vahid
    [J]. 2018 6TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL AND BUSINESS INTELLIGENCE (ISCBI 2018), 2018, : 65 - 68
  • [3] Fully Convolutional Networks for Handwriting Recognition
    Such, Felipe Petroski
    Peri, Dheeraj
    Brockler, Frank
    Hutkowski, Paul
    Ptucha, Raymond
    [J]. PROCEEDINGS 2018 16TH INTERNATIONAL CONFERENCE ON FRONTIERS IN HANDWRITING RECOGNITION (ICFHR), 2018, : 86 - 91
  • [4] Handwriting Comenia Script Recognition with Convolutional Neural Network
    Rajnoha, Martin
    Burget, Radim
    Dutta, Malay Kishore
    [J]. 2017 40TH INTERNATIONAL CONFERENCE ON TELECOMMUNICATIONS AND SIGNAL PROCESSING (TSP), 2017, : 775 - 779
  • [5] Application of optimized convolutional neural networks for early aided diagnosis of essential tremor: Automatic handwriting recognition and feature analysis
    Wang, Yanwen
    Yang, Jiayu
    Cai, Miao
    Liu, Xiaoli
    Lu, Kang
    Lou, Yue
    Li, Zhu
    [J]. MEDICAL ENGINEERING & PHYSICS, 2023, 113
  • [6] Bayesian Versus Convolutional Networks for Arabic Handwriting Recognition
    Akram Khémiri
    Afef Kacem Echi
    Mourad Elloumi
    [J]. Arabian Journal for Science and Engineering, 2019, 44 : 9301 - 9319
  • [7] Bayesian Versus Convolutional Networks for Arabic Handwriting Recognition
    Khemiri, Akram
    Echi, Afef Kacem
    Elloumi, Mourad
    [J]. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2019, 44 (11) : 9301 - 9319
  • [8] Dynamic handwriting recognition based on an evolutionary neural classifier
    Gentric, S
    Prevost, L
    Milgram, M
    [J]. ARTIFICIAL NEURAL NETS AND GENETIC ALGORITHMS, 2001, : 394 - 397
  • [9] Application of deep convolutional neural networks for ocean front recognition
    Lima, Estanislau
    Sun, Xin
    Yang, Yuting
    Dong, Junyu
    [J]. JOURNAL OF APPLIED REMOTE SENSING, 2017, 11
  • [10] Application of Convolutional Neural Networks to Speaker Recognition in Noisy Conditions
    McLaren, Mitchell
    Lei, Yun
    Scheffer, Nicolas
    Ferrer, Luciana
    [J]. 15TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2014), VOLS 1-4, 2014, : 686 - 690