Automatic Hyperparameter Tuning in Deep Convolutional Neural Networks Using Asynchronous Reinforcement Learning

被引:35
|
作者
Neary, Patrick L. [1 ]
机构
[1] Utah State Univ, Dept Comp Sci, Logan, UT 84322 USA
关键词
image recognition; neural networks; machine learning; convolutional neural networks; artificial intelligence; hyperparameter tuning; deep learning;
D O I
10.1109/ICCC.2018.00017
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Major gains have been made in recent years in object recognition due to advances in deep neural networks. One struggle with deep learning, however, revolves around the fact that currently it is unknown what network architecture is best for a given problem. Consequently, different configurations are tried until one is identified that gives acceptable results. This paper proposes an asynchronous reinforcement learning algorithm that finds an optimal network configuration by automatically adjusting parameters for a given problem. It is shown that asynchronous reinforcement learning is able to converge on an optimal solution for the MNIST data set.
引用
下载
收藏
页码:73 / 77
页数:5
相关论文
共 50 条
  • [1] Multiagent Reinforcement Learning for Hyperparameter Optimization of Convolutional Neural Networks
    Iranfar, Arman
    Zapater, Marina
    Atienza, David
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2022, 41 (04) : 1034 - 1047
  • [2] DeepHyper: Asynchronous Hyperparameter Search for Deep Neural Networks
    Balaprakash, Prasanna
    Salim, Michael
    Uram, Thomas D.
    Vishwanath, Venkat
    Wild, Stefan M.
    2018 IEEE 25TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING (HIPC), 2018, : 42 - 51
  • [3] Reinforcement Learning and Deep Neural Networks for PI Controller Tuning
    Shipman, William J.
    Coetzee, Loutjie C.
    IFAC PAPERSONLINE, 2019, 52 (14): : 111 - 116
  • [4] Hyperparameter tuning of convolutional neural networks for building construction image classification
    André Luiz Carvalho Ottoni
    Marcela Silva Novo
    Dayana Bastos Costa
    The Visual Computer, 2023, 39 : 847 - 861
  • [5] Hyperparameter tuning of convolutional neural networks for building construction image classification
    Carvalho Ottoni, Andre Luiz
    Novo, Marcela Silva
    Costa, Dayana Bastos
    VISUAL COMPUTER, 2023, 39 (03): : 847 - 861
  • [6] Speeding up the Hyperparameter Optimization of Deep Convolutional Neural Networks
    Hinz, Tobias
    Navarro-Guerrero, Nicolas
    Magg, Sven
    Wermter, Stefan
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE AND APPLICATIONS, 2018, 17 (02)
  • [7] Enhanced harmony search for hyperparameter tuning of deep neural networks
    Purnomo H.D.
    Gonsalves T.
    Wahyono T.
    Saian P.O.N.
    Soft Computing, 2024, 28 (17-18) : 9905 - 9919
  • [8] Hyperparameter Tuning for Deep Neural Networks Based Optimization Algorithm
    Vidyabharathi, D.
    Mohanraj, V.
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2023, 36 (03): : 2559 - 2573
  • [9] Hyperparameter Tuning in Offline Reinforcement Learning
    Tittaferrante, Andrew
    Yassine, Abdulsalam
    2022 21ST IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, ICMLA, 2022, : 585 - 590
  • [10] Speeding Up Automatic Hyperparameter Optimization of Deep Neural Networks by Extrapolation of Learning Curves
    Domhan, Tobias
    Springenberg, Jost Tobias
    Hutter, Frank
    PROCEEDINGS OF THE TWENTY-FOURTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI), 2015, : 3460 - 3468