Evolutionary convolutional neural networks: An application to handwriting recognition

被引:107
|
作者
Baldominos, Alejandro [1 ]
Saez, Yago [1 ]
Isasi, Pedro [1 ]
机构
[1] Univ Carlos III Madrid, Comp Sci Dept, Ave Univ 30, Madrid 28911, Spain
关键词
Neuroevolution; Evolutionary algorithms; Convolutional neural networks; Automatic topology design; Genetic algorithms; Grammatical evolution;
D O I
10.1016/j.neucom.2017.12.049
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Convolutional neural networks (CNNs) have been used over the past years to solve many different artificial intelligence (AI) problems, providing significant advances in some domains and leading to state-of-the-art results. However, the topologies of CNNs involve many different parameters, and in most cases, their design remains a manual process that involves effort and a significant amount of trial and error. In this work, we have explored the application of neuroevolution to the automatic design of CNN topologies, introducing a common framework for this task and developing two novel solutions based on genetic algorithms and grammatical evolution. We have evaluated our proposal using the MNIST dataset for handwritten digit recognition, achieving a result that is highly competitive with the state-of-the-art without any kind of data augmentation or preprocessing. When misclassified samples are carefully observed, it is found that most of them involve handwritten digits that are difficult to recognize even by a human. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:38 / 52
页数:15
相关论文
共 50 条
  • [41] Multi-Stroke handwriting character recognition based on sEMG using convolutional-recurrent neural networks
    Beltran-Hernandez J.G.
    Ruiz-Pinales J.
    Lopez-Rodriguez P.
    Lopez-Ramirez J.L.
    Avina-Cervantes J.G.
    [J]. Ruiz-Pinales, Jose (pinales@ugto.mx), 1600, American Institute of Mathematical Sciences (17): : 5432 - 5448
  • [42] Convolutional Neural Networks Considering Robustness Improvement and Its Application to Face Recognition
    Jalali, Amin
    Jang, Giljin
    Kang, Jun-Su
    Lee, Minho
    [J]. NEURAL INFORMATION PROCESSING, ICONIP 2015, PT IV, 2015, 9492 : 240 - 245
  • [43] Application of Deep Convolutional Neural Networks in Image Recognition and Classification in Library Management
    Wang, Songyun
    [J]. WIRELESS PERSONAL COMMUNICATIONS, 2023,
  • [44] Application of Advanced Deep Convolutional Neural Networks for the Recognition of Road Surface Anomalies
    Van, Dong Doan
    [J]. ENGINEERING TECHNOLOGY & APPLIED SCIENCE RESEARCH, 2023, 13 (03) : 10765 - 10768
  • [45] Padding Methods in Convolutional Sequence Model: An Application in Japanese Handwriting Recognition
    Nguyen Tuan Nam
    Phan Duy Hung
    [J]. PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND SOFT COMPUTING (ICMLSC 2019), 2019, : 138 - 142
  • [46] Evolutionary Design of Convolutional Neural Networks for Human Activity Recognition in Sensor-Rich Environments
    Baldominos, Alejandro
    Saez, Yago
    Isasi, Pedro
    [J]. SENSORS, 2018, 18 (04)
  • [47] A Comparative Study on Handwriting Digit Recognition Using Neural Networks
    Abu Ghosh, Mahmoud M.
    Maghari, Ashraf Y.
    [J]. 2017 INTERNATIONAL CONFERENCE ON PROMISING ELECTRONIC TECHNOLOGIES (ICPET 2017), 2017, : 77 - 81
  • [48] Handwriting Recognition with Artificial Neural Networks a Decade Literature Review
    Remaida, Ahmed
    Moumen, Aniss
    El Idrissi, Younes El Bouzekri
    Sabri, Zineb
    [J]. 3RD INTERNATIONAL CONFERENCE ON NETWORKING, INFORMATION SYSTEM & SECURITY (NISS'20), 2020,
  • [49] Hybrid and Convolutional Neural Networks for Locomotion Recognition
    Osmani, Aomar
    Hamidi, Massinissa
    [J]. PROCEEDINGS OF THE 2018 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2018 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS (UBICOMP/ISWC'18 ADJUNCT), 2018, : 1531 - 1540
  • [50] Food Image Recognition with Convolutional Neural Networks
    Zhang, Weishan
    Zhao, Dehai
    Gong, Wenjuan
    Li, Zhongwei
    Lu, Qinghua
    Yang, Su
    [J]. IEEE 12TH INT CONF UBIQUITOUS INTELLIGENCE & COMP/IEEE 12TH INT CONF ADV & TRUSTED COMP/IEEE 15TH INT CONF SCALABLE COMP & COMMUN/IEEE INT CONF CLOUD & BIG DATA COMP/IEEE INT CONF INTERNET PEOPLE AND ASSOCIATED SYMPOSIA/WORKSHOPS, 2015, : 690 - 693