The effects of hyperparameters on deep learning of turbulent signals

被引:0
|
作者
Tirchas, Panagiotis [1 ]
Drikakis, Dimitris [1 ]
Kokkinakis, Ioannis W. [1 ]
Spottswood, S. Michael [2 ]
机构
[1] Univ Nicosia, Inst Adv Modelling & Simulat, CY-2417 Nicosia, Cyprus
[2] Air Force Res Lab, Wright Patterson AFB, OH 45433 USA
关键词
LARGE-EDDY SIMULATION; HIGH-ORDER; SCHEMES;
D O I
10.1063/5.0245473
中图分类号
O3 [力学];
学科分类号
08 ; 0801 ;
摘要
The effect of hyperparameter selection in deep learning (DL) models for fluid dynamics remains an open question in the current scientific literature. Many authors report results using deep learning models. However, better insight is required to assess deep learning models' behavior, particularly for complex datasets such as turbulent signals. This study presents a meticulous investigation of the long short-term memory (LSTM) hyperparameters, focusing specifically on applications involving predicting signals in shock turbulent boundary layer interaction. Unlike conventional methodologies that utilize automated optimization techniques, this research explores the intricacies and impact of manual adjustments to the deep learning model. The investigation includes the number of layers, neurons per layer, learning rate, dropout rate, and batch size to investigate their impact on the model's predictive accuracy and computational efficiency. The paper details the iterative tuning process through a series of experimental setups, highlighting how each parameter adjustment contributes to a deeper understanding of complex, time-series data. The findings emphasize the effectiveness of precise manual tuning in achieving superior model performance, providing valuable insights to researchers and practitioners who seek to leverage long short-term memory networks for intricate temporal data analysis. The optimization not only refines the predictability of the long short-term memory in specific contexts but also serves as a guide for similar manual tuning in other specialized domains, thereby informing the development of more effective deep learning models.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Investigating the Effects of Hyperparameters in Quantum-Enhanced Deep Reinforcement Learning
    Fikadu Tilaye, Getahun
    Pandey, Amit
    Quantum Engineering, 2023, 2023
  • [2] Evolutionary Optimization of Hyperparameters in Deep Learning Models
    Kim, Jin-Young
    Cho, Sung-Bae
    2019 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2019, : 831 - 837
  • [3] GreenNAS: A Green Approach to the Hyperparameters Tuning in Deep Learning
    Franchini, Giorgia
    MATHEMATICS, 2024, 12 (06)
  • [4] Goal-Oriented Sensitivity Analysis of Hyperparameters in Deep Learning
    Paul Novello
    Gaël Poëtte
    David Lugato
    Pietro Marco Congedo
    Journal of Scientific Computing, 2023, 94
  • [5] Influence of Hyperparameters in Deep Learning Models for Coffee Rust Detection
    Chavarro, Adrian F. F.
    Renza, Diego
    Ballesteros, Dora M. M.
    APPLIED SCIENCES-BASEL, 2023, 13 (07):
  • [6] Goal-Oriented Sensitivity Analysis of Hyperparameters in Deep Learning
    Novello, Paul
    Poette, Gael
    Lugato, David
    Congedo, Pietro Marco
    JOURNAL OF SCIENTIFIC COMPUTING, 2023, 94 (03)
  • [7] A Survey on Hyperparameters Optimization of Deep Learning for Time Series Classification
    Fristiana, Ayuningtyas Hari
    Alfarozi, Syukron Abu Ishaq
    Permanasari, Adhistya Erna
    Pratama, Mahardhika
    Wibirama, Sunu
    IEEE ACCESS, 2024, 12 : 191162 - 191198
  • [8] Course Evaluation Based on Deep Learning and SSA Hyperparameters Optimization
    El-Demerdash, Alaa A.
    Hussein, Sherif E.
    Zaki, John F. W.
    CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 71 (01): : 941 - 959
  • [9] Sparse Bayesian learning using correlated hyperparameters for recovery of block sparse signals
    Cui, Hongyu
    Duan, Huiping
    DIGITAL SIGNAL PROCESSING, 2017, 68 : 24 - 30
  • [10] Radiogenomic Prediction of MGMT Using Deep Learning with Bayesian Optimized Hyperparameters
    Farzana, Walia
    Temtam, Ahmed G.
    Shboul, Zeina A.
    Rahman, M. Monibor
    Sadique, M. Shibly
    Iftekharuddin, Khan M.
    BRAINLESION: GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES, BRAINLES 2021, PT II, 2022, 12963 : 357 - 366