The effects of hyperparameters on deep learning of turbulent signals

被引:0
|
作者
Tirchas, Panagiotis [1 ]
Drikakis, Dimitris [1 ]
Kokkinakis, Ioannis W. [1 ]
Spottswood, S. Michael [2 ]
机构
[1] Univ Nicosia, Inst Adv Modelling & Simulat, CY-2417 Nicosia, Cyprus
[2] Air Force Res Lab, Wright Patterson AFB, OH 45433 USA
关键词
LARGE-EDDY SIMULATION; HIGH-ORDER; SCHEMES;
D O I
10.1063/5.0245473
中图分类号
O3 [力学];
学科分类号
08 ; 0801 ;
摘要
The effect of hyperparameter selection in deep learning (DL) models for fluid dynamics remains an open question in the current scientific literature. Many authors report results using deep learning models. However, better insight is required to assess deep learning models' behavior, particularly for complex datasets such as turbulent signals. This study presents a meticulous investigation of the long short-term memory (LSTM) hyperparameters, focusing specifically on applications involving predicting signals in shock turbulent boundary layer interaction. Unlike conventional methodologies that utilize automated optimization techniques, this research explores the intricacies and impact of manual adjustments to the deep learning model. The investigation includes the number of layers, neurons per layer, learning rate, dropout rate, and batch size to investigate their impact on the model's predictive accuracy and computational efficiency. The paper details the iterative tuning process through a series of experimental setups, highlighting how each parameter adjustment contributes to a deeper understanding of complex, time-series data. The findings emphasize the effectiveness of precise manual tuning in achieving superior model performance, providing valuable insights to researchers and practitioners who seek to leverage long short-term memory networks for intricate temporal data analysis. The optimization not only refines the predictability of the long short-term memory in specific contexts but also serves as a guide for similar manual tuning in other specialized domains, thereby informing the development of more effective deep learning models.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Stealing Hyperparameters in Machine Learning
    Wang, Binghui
    Gong, Neil Zhenqiang
    2018 IEEE SYMPOSIUM ON SECURITY AND PRIVACY (SP), 2018, : 36 - 52
  • [22] Optimizing hyperparameters of deep reinforcement learning for autonomous driving based on whale optimization algorithm
    Ashraf, Nesma M.
    Mostafa, Reham R.
    Sakr, Rasha H.
    Rashad, M. Z.
    PLOS ONE, 2021, 16 (06):
  • [23] Optimizing hyperparameters of deep hybrid learning for rainfall prediction: a case study of a Mediterranean basin
    Ahmed Elbeltagi
    Bilel Zerouali
    Nadjem Bailek
    Kada Bouchouicha
    Chaitanya Pande
    Celso Augusto Guimarães Santos
    Abueza Reza Md. Towfiqul Islam
    Nadhir Al-Ansari
    El-Sayed M. El-kenawy
    Arabian Journal of Geosciences, 2022, 15 (10)
  • [24] Generating electrocardiogram signals by deep learning
    Wulan, Naren
    Wang, Wei
    Sun, Pengzhong
    Wang, Kuanquan
    Xia, Yong
    Zhang, Henggui
    NEUROCOMPUTING, 2020, 404 (404) : 122 - 136
  • [25] Physical consistency and invariance in machine learning of turbulent signals
    Drikakis, Dimitris
    Kokkinakis, Ioannis William
    Tirchas, Panagiotis
    Spottswood, S. Michael
    PHYSICS OF FLUIDS, 2024, 36 (01)
  • [26] Deep Learning for the Classification of Genomic Signals
    Alejandro Morales, J.
    Saldana, Roman
    Santana-Castolo, Manuel H.
    Emilio Torres-Cerna, Carlos
    Borrayo, Ernesto
    Mendizabal-Ruiz, Adriana P.
    Velez-Perez, Hugo A.
    Mendizabal-Ruiz, Gerardo
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2020, 2020
  • [27] Learning Diffusion using Hyperparameters
    Kalimeris, Dimitris
    Singer, Yaron
    Subbian, Karthik
    Weinsberg, Udi
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [28] Experimental Analysis of Hyperparameters for Deep Learning-Based Churn Prediction in the Banking Sector
    Domingos, Edvaldo
    Ojeme, Blessing
    Daramola, Olawande
    COMPUTATION, 2021, 9 (03)
  • [29] A deep learning framework for supersonic turbulent combustion
    Zhao, Tong
    Wu, Chong
    Zhu, Runtong
    Liu, Bing
    Qin, Fei
    An, Jian
    He, Guoqiang
    ACTA ASTRONAUTICA, 2024, 225 : 524 - 537
  • [30] Probabilistic deep learning of turbulent premixed combustion
    Shin, Junsu
    Xing, Victor
    Pfitzner, Michael
    Lapeyre, Corentin
    AIP ADVANCES, 2023, 13 (08)