Genetic Algorithm Based Deep Learning Neural Network Structure and Hyperparameter Optimization

被引:43
|
作者
Lee, Sanghyeop [1 ]
Kim, Junyeob [2 ]
Kang, Hyeon [3 ]
Kang, Do-Young [3 ,4 ,5 ]
Park, Jangsik [1 ]
机构
[1] Kyungsung Univ, Dept Elect Engn, Busan 48434, South Korea
[2] Univ Cambridge, Dept Engn, Cambridge CB2 1PZ, England
[3] Dong A Univ, Inst Convergence Biohlth, Busan 49315, South Korea
[4] Dong A Univ, Dept Nucl Med, Coll Med, Busan 49201, South Korea
[5] Dong A Univ, Dept Translat Biomed Sci, Coll Med, Busan 49201, South Korea
来源
APPLIED SCIENCES-BASEL | 2021年 / 11卷 / 02期
基金
新加坡国家研究基金会;
关键词
Alzheimer's disease; classification; deep learning; convolutional neural network; genetic algorithm; model optimisation;
D O I
10.3390/app11020744
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Alzheimer's disease is one of the major challenges of population ageing, and diagnosis and prediction of the disease through various biomarkers is the key. While the application of deep learning as imaging technologies has recently expanded across the medical industry, empirical design of these technologies is very difficult. The main reason for this problem is that the performance of the Convolutional Neural Networks (CNN) differ greatly depending on the statistical distribution of the input dataset. Different hyperparameters also greatly affect the convergence of the CNN models. With this amount of information, selecting appropriate parameters for the network structure has became a large research area. Genetic Algorithm (GA), is a very popular technique to automatically select a high-performance network architecture. In this paper, we show the possibility of optimising the network architecture using GA, where its search space includes both network structure configuration and hyperparameters. To verify the performance of our Algorithm, we used an amyloid brain image dataset that is used for Alzheimer's disease diagnosis. As a result, our algorithm outperforms Genetic CNN by 11.73% on a given classification task.
引用
收藏
页码:1 / 12
页数:12
相关论文
共 50 条
  • [1] Hyperparameter Tuning for Deep Neural Networks Based Optimization Algorithm
    Vidyabharathi, D.
    Mohanraj, V.
    [J]. INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2023, 36 (03): : 2559 - 2573
  • [2] Neural Network Structure Optimization Based on Improved Genetic Algorithm
    Wu, Wei
    [J]. 2012 IEEE FIFTH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE (ICACI), 2012, : 893 - 895
  • [3] Genetic Algorithm-based Optimization of Deep Neural Network Ensemble
    Feng, Xuanang
    Zhao, Jianing
    Kita, Eisuke
    [J]. REVIEW OF SOCIONETWORK STRATEGIES, 2021, 15 (01): : 27 - 47
  • [4] Genetic Algorithm-based Optimization of Deep Neural Network Ensemble
    Xuanang Feng
    Jianing Zhao
    Eisuke Kita
    [J]. The Review of Socionetwork Strategies, 2021, 15 : 27 - 47
  • [5] Bayesian Hyperparameter Optimization of Deep Neural Network Algorithms Based on Ant Colony Optimization
    Jlassi, Sinda
    Jdey, Imen
    Ltifi, Hela
    [J]. DOCUMENT ANALYSIS AND RECOGNITION, ICDAR 2021, PT III, 2021, 12823 : 585 - 594
  • [6] Hyperparameter optimization of deep neural network using univariate dynamic encoding algorithm for searches
    Yoo, YoungJun
    [J]. KNOWLEDGE-BASED SYSTEMS, 2019, 178 : 74 - 83
  • [7] Bayesian Hyperparameter Optimization for Deep Neural Network-Based Network Intrusion Detection
    Masum, Mohammad
    Shahriar, Hossain
    Haddad, Hisham
    Faruk, Md Jobair Hossain
    Valero, Maria
    Khan, Md Abdullah
    Rahman, Mohammad A.
    Adnan, Muhaiminul, I
    Cuzzocrea, Alfredo
    Wu, Fan
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 5413 - 5419
  • [8] Hyperparameter Optimization Using a Genetic Algorithm Considering Verification Time in a Convolutional Neural Network
    Han, Ji-Hoon
    Choi, Dong-Jin
    Park, Sang-Uk
    Hong, Sun-Ki
    [J]. JOURNAL OF ELECTRICAL ENGINEERING & TECHNOLOGY, 2020, 15 (02) : 721 - 726
  • [9] Hyperparameter Optimization Using a Genetic Algorithm Considering Verification Time in a Convolutional Neural Network
    Ji-Hoon Han
    Dong-Jin Choi
    Sang-Uk Park
    Sun-Ki Hong
    [J]. Journal of Electrical Engineering & Technology, 2020, 15 : 721 - 726
  • [10] Deep Neural Network Hyperparameter Optimization with Orthogonal Array Tuning
    Zhang, Xiang
    Chen, Xiaocong
    Yao, Lina
    Ge, Chang
    Dong, Manqing
    [J]. NEURAL INFORMATION PROCESSING (ICONIP 2019), PT IV, 2019, 1142 : 287 - 295