Fine-Tuning Convolutional Neural Networks Using Harmony Search

被引:37
|
作者
Rosa, Gustavo [1 ]
Papa, Joao [1 ]
Marana, Aparecido [1 ]
Scheirer, Walter [2 ]
Cox, David [2 ]
机构
[1] Sao Paulo State Univ, Bauru, SP, Brazil
[2] Harvard Univ, Cambridge, MA 02138 USA
关键词
D O I
10.1007/978-3-319-25751-8_82
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning-based approaches have been paramount in the last years, mainly due to their outstanding results in several application domains, that range from face and object recognition to handwritten digits identification. Convolutional Neural Networks (CNN) have attracted a considerable attention since they model the intrinsic and complex brain working mechanism. However, the huge amount of parameters to be set up may turn such approaches more prone to configuration errors when using a manual tuning of the parameters. Since only a few works have addressed such shortcoming by means of meta-heuristic-based optimization, in this paper we introduce the Harmony Search algorithm and some of its variants for CNN optimization, being the proposed approach validated in the context of fingerprint and handwritten digit recognition, as well as image classification.
引用
收藏
页码:683 / 690
页数:8
相关论文
共 50 条
  • [1] Fine-tuning Deep Belief Networks using Harmony Search
    Papa, Joao Paulo
    Scheirer, Walter
    Cox, David Daniel
    APPLIED SOFT COMPUTING, 2016, 46 : 875 - 885
  • [2] Fine-tuning and Visualization of Convolutional Neural Networks
    Yin, Xiangnan
    Chen, Weihai
    Wu, Xingming
    Yue, Haosong
    PROCEEDINGS OF THE 2017 12TH IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA), 2017, : 1310 - 1315
  • [3] Fine-tuning Convolutional Neural Networks for fine art classification
    Cetinic, Eva
    Lipic, Tomislav
    Grgic, Sonja
    EXPERT SYSTEMS WITH APPLICATIONS, 2018, 114 : 107 - 118
  • [4] A study on training fine-tuning of convolutional neural networks
    Cai, Zhicheng
    Peng, Chenglei
    2021 13TH INTERNATIONAL CONFERENCE ON KNOWLEDGE AND SMART TECHNOLOGY (KST-2021), 2021, : 84 - 89
  • [5] Exponential Fine-Tuning Harmony Search Algorithm
    Zhang, Lipu
    Shen, Xuewen
    ADVANCES IN INTELLIGENT SYSTEMS AND COMPUTING (ECC 2021), 2022, 268 : 145 - 154
  • [6] Improving optimization of convolutional neural networks through parameter fine-tuning
    Becherer, Nicholas
    Pecarina, John
    Nykl, Scott
    Hopkinson, Kenneth
    NEURAL COMPUTING & APPLICATIONS, 2019, 31 (08): : 3469 - 3479
  • [7] On Fine-tuning Convolutional Neural Networks for Smartphone based Ocular Recognition
    Rattani, Ajita
    Derakhshani, Reza
    2017 IEEE INTERNATIONAL JOINT CONFERENCE ON BIOMETRICS (IJCB), 2017, : 762 - 767
  • [8] Comparison of Fine-Tuning and Extension Strategies for Deep Convolutional Neural Networks
    Pittaras, Nikiforos
    Markatopoulou, Foteini
    Mezaris, Vasileios
    Patras, Ioannis
    MULTIMEDIA MODELING (MMM 2017), PT I, 2017, 10132 : 102 - 114
  • [9] Improving optimization of convolutional neural networks through parameter fine-tuning
    Nicholas Becherer
    John Pecarina
    Scott Nykl
    Kenneth Hopkinson
    Neural Computing and Applications, 2019, 31 : 3469 - 3479
  • [10] Fine-tuning Convolutional Neural Networks for Biomedical Image Analysis: Actively and Incrementally
    Zhou, Zongwei
    Shin, Jae
    Zhang, Lei
    Gurudu, Suryakanth
    Gotway, Michael
    Liang, Jianming
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 4761 - 4772