Optimising Deep Learning by Hyper-heuristic Approach for Classifying Good Quality Images

被引:6
|
作者
ul Hassan, Muneeb [1 ]
Sabar, Nasser R. [2 ]
Song, Andy [1 ]
机构
[1] RMIT Univ, Melbourne, Vic 3000, Australia
[2] La Trobe Univ, Melbourne, Vic 3083, Australia
来源
关键词
Hyper-heuristics; Deep learning; CNN; Optimisation;
D O I
10.1007/978-3-319-93701-4_41
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Deep Convolutional Neural Network (CNN), which is one of the prominent deep learning methods, has shown a remarkable success in a variety of computer vision tasks, especially image classification. However, tuning CNN hyper-parameters requires expert knowledge and a large amount of manual effort of trial and error. In this work, we present the use of CNN on classifying good quality images versus bad quality images without understanding the image content. The well known data-sets were used for performance evaluation. More importantly we propose a hyper-heuristic approach for tuning CNN hyper-parameters. The proposed hyper-heuristic encompasses of a high level strategy and various low level heuristics. The high level strategy utilises search performance to determine how to apply low level heuristics to automatically find an appropriate set of CNN hyper-parameters. Our experiments show the effectiveness of this hyper-heuristic approach which can achieve high accuracy even when the training size is significantly reduced and conventional CNNs can no longer perform well. In short the proposed hyper-heuristic approach does enhance CNN deep learning.
引用
收藏
页码:528 / 539
页数:12
相关论文
共 50 条
  • [21] A Study on Online Hyper-heuristic Learning for Swarm Robots
    Yu, Shuang
    Song, Andy
    Aleti, Aldeida
    2019 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2019, : 2721 - 2728
  • [22] A Learning Automata-Based Multiobjective Hyper-Heuristic
    Li, Wenwen
    Ozcan, Ender
    John, Robert
    IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2019, 23 (01) : 59 - 73
  • [23] Automatic design of hyper-heuristic based on reinforcement learning
    Choong, Shin Siang
    Wong, Li-Pei
    Lim, Chee Peng
    INFORMATION SCIENCES, 2018, 436 : 89 - 107
  • [24] A Selection Hyper-Heuristic for Transfer Learning in Genetic Programming
    Russell, Jeffrey
    Pillay, Nelishia
    PROCEEDINGS OF THE 2023 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE COMPANION, GECCO 2023 COMPANION, 2023, : 631 - 634
  • [25] A Lifelong Learning Hyper-heuristic Method for Bin Packing
    Sim, Kevin
    Hart, Emma
    Paechter, Ben
    EVOLUTIONARY COMPUTATION, 2015, 23 (01) : 37 - 67
  • [26] An Apprenticeship Learning Hyper-Heuristic for Vehicle Routing in HyFlex
    Asta, Shahriar
    Ozcan, Ender
    2014 IEEE SYMPOSIUM ON EVOLVING AND AUTONOMOUS LEARNING SYSTEMS (EALS), 2014, : 65 - 72
  • [27] A Hyper-heuristic approach for efficient resource scheduling in grid
    Bhanu, S. Mary Saira
    Gopalan, N. P.
    INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL, 2008, 3 (03) : 249 - 258
  • [28] A hyper-heuristic approach to aircraft structural design optimization
    Jonathan G. Allen
    Graham Coates
    Jon Trevelyan
    Structural and Multidisciplinary Optimization, 2013, 48 : 807 - 819
  • [29] A hyper-heuristic approach to sequencing by hybridization of DNA sequences
    Jacek Blazewicz
    Edmund K. Burke
    Graham Kendall
    Wojciech Mruczkiewicz
    Ceyda Oguz
    Aleksandra Swiercz
    Annals of Operations Research, 2013, 207 : 27 - 41
  • [30] A hyper-heuristic approach to aircraft structural design optimization
    Allen, Jonathan G.
    Coates, Graham
    Trevelyan, Jon
    STRUCTURAL AND MULTIDISCIPLINARY OPTIMIZATION, 2013, 48 (04) : 807 - 819