Fine-Tuning Convolutional Neural Networks Using Harmony Search

被引:37
|
作者
Rosa, Gustavo [1 ]
Papa, Joao [1 ]
Marana, Aparecido [1 ]
Scheirer, Walter [2 ]
Cox, David [2 ]
机构
[1] Sao Paulo State Univ, Bauru, SP, Brazil
[2] Harvard Univ, Cambridge, MA 02138 USA
关键词
D O I
10.1007/978-3-319-25751-8_82
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning-based approaches have been paramount in the last years, mainly due to their outstanding results in several application domains, that range from face and object recognition to handwritten digits identification. Convolutional Neural Networks (CNN) have attracted a considerable attention since they model the intrinsic and complex brain working mechanism. However, the huge amount of parameters to be set up may turn such approaches more prone to configuration errors when using a manual tuning of the parameters. Since only a few works have addressed such shortcoming by means of meta-heuristic-based optimization, in this paper we introduce the Harmony Search algorithm and some of its variants for CNN optimization, being the proposed approach validated in the context of fingerprint and handwritten digit recognition, as well as image classification.
引用
收藏
页码:683 / 690
页数:8
相关论文
共 50 条
  • [21] Fine-tuning the search for microsatellites
    de Ridder, C.
    Kourie, D. G.
    Watson, B. W.
    Fourie, T. R.
    Reyneke, P. V.
    JOURNAL OF DISCRETE ALGORITHMS, 2013, 20 : 21 - 37
  • [22] InstaTune: Instantaneous Neural Architecture Search During Fine-Tuning
    Sridhar, Sharath Nittur
    Kundu, Souvik
    Sundaresan, Sairam
    Szankin, Maciej
    Sarah, Anthony
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 1515 - 1519
  • [23] NFP: A No Fine-tuning Pruning Approach for Convolutional Neural Network Compression
    Liu, Rui
    Cao, Jian
    Li, Pu
    Sun, Wenyu
    Zhang, Ying
    Wang, Yuan
    2020 3RD INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND BIG DATA (ICAIBD 2020), 2020, : 74 - 77
  • [24] Fine-Tuning Convolutional Neural Network Based Railway Damage Detection
    Aydin, Ahmet
    Salur, Mehmet Umut
    Aydin, Ilhan
    IEEE EUROCON 2021 - 19TH INTERNATIONAL CONFERENCE ON SMART TECHNOLOGIES, 2021, : 216 - 221
  • [25] Convolutional Neural Network Ensemble Fine-Tuning for Extended Transfer Learning
    Korzh, Oxana
    Joaristi, Mikel
    Serra, Edoardo
    BIG DATA - BIGDATA 2018, 2018, 10968 : 110 - 123
  • [26] Enhanced harmony search for hyperparameter tuning of deep neural networks
    Purnomo H.D.
    Gonsalves T.
    Wahyono T.
    Saian P.O.N.
    Soft Computing, 2024, 28 (17-18) : 9905 - 9919
  • [27] Fine-Tuning Based Deep Convolutional Networks for Lepidopterous Genus Recognition
    Carvajal, Juan A.
    Romero, Dennis G.
    Sappa, Angel D.
    PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS, COMPUTER VISION, AND APPLICATIONS, CIARP 2016, 2017, 10125 : 467 - 475
  • [28] Convolutional neural networks: Ensemble modeling, fine-tuning and unsupervised semantic localization for neurosurgical CLE images
    Izadyyazdanabadi, Mohammadhassan
    Belykh, Evgenii
    Mooney, Michael
    Martirosyan, Nikolay
    Eschbacher, Jennifer
    Nakaji, Peter
    Preul, Mark C.
    Yang, Yezhou
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2018, 54 : 10 - 20
  • [29] Patient-specific fine-tuning of convolutional neural networks for follow-up lesion quantification
    Jansen, Marielle J. A.
    Kuijf, Hugo J.
    Dhara, Ashis K.
    Weaver, Nick A.
    Biessels, Geert Jan
    Strand, Robin
    Pluim, Josien P. W.
    JOURNAL OF MEDICAL IMAGING, 2020, 7 (06)
  • [30] Activation Fine-Tuning of Convolutional Neural Networks for Improved Input Attribution Based on Class Activation Maps
    Han, Sungmin
    Lee, Jeonghyun
    Lee, Sangkyun
    APPLIED SCIENCES-BASEL, 2022, 12 (24):