The effects of hyperparameters on deep learning of turbulent signals

被引:0
|
作者
Tirchas, Panagiotis [1 ]
Drikakis, Dimitris [1 ]
Kokkinakis, Ioannis W. [1 ]
Spottswood, S. Michael [2 ]
机构
[1] Univ Nicosia, Inst Adv Modelling & Simulat, CY-2417 Nicosia, Cyprus
[2] Air Force Res Lab, Wright Patterson AFB, OH 45433 USA
关键词
LARGE-EDDY SIMULATION; HIGH-ORDER; SCHEMES;
D O I
10.1063/5.0245473
中图分类号
O3 [力学];
学科分类号
08 ; 0801 ;
摘要
The effect of hyperparameter selection in deep learning (DL) models for fluid dynamics remains an open question in the current scientific literature. Many authors report results using deep learning models. However, better insight is required to assess deep learning models' behavior, particularly for complex datasets such as turbulent signals. This study presents a meticulous investigation of the long short-term memory (LSTM) hyperparameters, focusing specifically on applications involving predicting signals in shock turbulent boundary layer interaction. Unlike conventional methodologies that utilize automated optimization techniques, this research explores the intricacies and impact of manual adjustments to the deep learning model. The investigation includes the number of layers, neurons per layer, learning rate, dropout rate, and batch size to investigate their impact on the model's predictive accuracy and computational efficiency. The paper details the iterative tuning process through a series of experimental setups, highlighting how each parameter adjustment contributes to a deeper understanding of complex, time-series data. The findings emphasize the effectiveness of precise manual tuning in achieving superior model performance, providing valuable insights to researchers and practitioners who seek to leverage long short-term memory networks for intricate temporal data analysis. The optimization not only refines the predictability of the long short-term memory in specific contexts but also serves as a guide for similar manual tuning in other specialized domains, thereby informing the development of more effective deep learning models.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] Robust deep learning for emulating turbulent viscosities
    Patil, Aakash
    Viquerat, Jonathan
    Larcher, Aurelien
    El Haber, George
    Hachem, Elie
    PHYSICS OF FLUIDS, 2021, 33 (10)
  • [32] Meta-Learning with Adaptive Hyperparameters
    Baik, Sungyong
    Choi, Myungsub
    Choi, Janghoon
    Kim, Heewon
    Lee, Kyoung Mu
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [33] Tuning of data augmentation hyperparameters in deep learning to building construction image classification with small datasets
    André Luiz C. Ottoni
    Raphael M. de Amorim
    Marcela S. Novo
    Dayana B. Costa
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 171 - 186
  • [34] Tuning of data augmentation hyperparameters in deep learning to building construction image classification with small datasets
    Ottoni, Andre Luiz C.
    de Amorim, Raphael M.
    Novo, Marcela S.
    Costa, Dayana B.
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (01) : 171 - 186
  • [35] PHYSIOLOGICAL SIGNALS AND THEIR EFFECTS ON PREDICTING FUTURE BLOOD GLUCOSE VALUES IN A DEEP LEARNING MODEL
    Lamkin-Kennard, K.
    Rearson, A.
    DIABETES TECHNOLOGY & THERAPEUTICS, 2023, 25 : A92 - A92
  • [36] Deep Learning for Automatic Electroencephalographic Signals Classification
    Sanchez-Pozo, Nadia N.
    Lascano-Rivera, Samuel
    Montalvo-Marquez, Francisco J.
    Ortiz-Reinoso, Dalia Y.
    BIOINFORMATICS AND BIOMEDICAL ENGINEERING, IWBBIO 2023, PT I, 2023, 13919 : 259 - 271
  • [37] Deep Learning for Detection of Railway Signs and Signals
    Karagiannis, Georgios
    Olsen, Soren
    Pedersen, Kim
    ADVANCES IN COMPUTER VISION, CVC, VOL 1, 2020, 943 : 1 - 15
  • [38] Deep Learning Models for Denoising ECG Signals
    Arsene, Corneliu T. C.
    Hankins, Richard
    Yin, Hujun
    2019 27TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2019,
  • [39] Modulation recognition of terahertz signals by deep learning
    Wu, Zhendong
    Zhang, Yuping
    Li, Dehua
    Ma, Jianjun
    2022 15TH UK-EUROPE-CHINA WORKSHOP ON MILLIMETRE-WAVES AND TERAHERTZ TECHNOLOGIES (UCMMT), 2022, : 71 - 73
  • [40] Deep learning for intermittent gravitational wave signals
    Yamamoto, Takahiro S.
    Kuroyanagi, Sachiko
    Liu, Guo-Chin
    PHYSICAL REVIEW D, 2023, 107 (04)