The effects of hyperparameters on deep learning of turbulent signals

被引:0
|
作者
Tirchas, Panagiotis [1 ]
Drikakis, Dimitris [1 ]
Kokkinakis, Ioannis W. [1 ]
Spottswood, S. Michael [2 ]
机构
[1] Univ Nicosia, Inst Adv Modelling & Simulat, CY-2417 Nicosia, Cyprus
[2] Air Force Res Lab, Wright Patterson AFB, OH 45433 USA
关键词
LARGE-EDDY SIMULATION; HIGH-ORDER; SCHEMES;
D O I
10.1063/5.0245473
中图分类号
O3 [力学];
学科分类号
08 ; 0801 ;
摘要
The effect of hyperparameter selection in deep learning (DL) models for fluid dynamics remains an open question in the current scientific literature. Many authors report results using deep learning models. However, better insight is required to assess deep learning models' behavior, particularly for complex datasets such as turbulent signals. This study presents a meticulous investigation of the long short-term memory (LSTM) hyperparameters, focusing specifically on applications involving predicting signals in shock turbulent boundary layer interaction. Unlike conventional methodologies that utilize automated optimization techniques, this research explores the intricacies and impact of manual adjustments to the deep learning model. The investigation includes the number of layers, neurons per layer, learning rate, dropout rate, and batch size to investigate their impact on the model's predictive accuracy and computational efficiency. The paper details the iterative tuning process through a series of experimental setups, highlighting how each parameter adjustment contributes to a deeper understanding of complex, time-series data. The findings emphasize the effectiveness of precise manual tuning in achieving superior model performance, providing valuable insights to researchers and practitioners who seek to leverage long short-term memory networks for intricate temporal data analysis. The optimization not only refines the predictability of the long short-term memory in specific contexts but also serves as a guide for similar manual tuning in other specialized domains, thereby informing the development of more effective deep learning models.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Deep Learning Hunts for Signals Among the Noise
    Edwards, Chris
    COMMUNICATIONS OF THE ACM, 2018, 61 (06) : 13 - 14
  • [42] Deep Learning of Recurrence Texture in Physiological Signals
    Pham, Than D.
    AIXIA 2021 - ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, 13196 : 503 - 514
  • [43] Deep Learning Approach for Vibration Signals Applications
    Chen, Han-Yun
    Lee, Ching-Hung
    SENSORS, 2021, 21 (11)
  • [44] Predicting Coherent Turbulent Structures via Deep Learning
    Schmekel, D.
    Alcántara-Ávila, F.
    Hoyas, S.
    Vinuesa, R.
    Frontiers in Physics, 2022, 10
  • [45] Predicting Coherent Turbulent Structures via Deep Learning
    Schmekel, D.
    Alcantara-Avila, F.
    Hoyas, S.
    Vinuesa, R.
    FRONTIERS IN PHYSICS, 2022, 10
  • [46] Arabic sentiment analysis of Monkeypox using deep neural network and optimized hyperparameters of machine learning algorithms
    Gharaibeh, Hasan
    Al Mamlook, Rabia Emhamed
    Samara, Ghassan
    Nasayreh, Ahmad
    Smadi, Saja
    Nahar, Khalid M. O.
    Aljaidi, Mohammad
    Al-Daoud, Essam
    Gharaibeh, Mohammad
    Abualigah, Laith
    SOCIAL NETWORK ANALYSIS AND MINING, 2024, 14 (01)
  • [47] Effect of data preprocessing methods and hyperparameters on accuracy of ball bearing fault detection based on deep learning
    Kim, Dong Wook
    Lee, Eun Sung
    Jang, Woong Ki
    Kim, Byeong Hee
    Seo, Young Ho
    ADVANCES IN MECHANICAL ENGINEERING, 2022, 14 (02)
  • [48] Deep Learning Approach for Removal of Water Vapor Effects from THz-TDS Signals
    Mikerov, Mikhail
    Ornik, Jan
    Koch, Martin
    2019 44TH INTERNATIONAL CONFERENCE ON INFRARED, MILLIMETER, AND TERAHERTZ WAVES (IRMMW-THZ), 2019,
  • [49] Investigation of Hyperparameters for DOA Using Machine Learning
    Nosho, Takahiro
    Fujimoto, Mitoshi
    2020 INTERNATIONAL SYMPOSIUM ON ANTENNAS AND PROPAGATION (ISAP), 2021, : 505 - 506
  • [50] KERNEL MATRIX APPROXIMATION FOR LEARNING THE KERNEL HYPERPARAMETERS
    Fauvel, Mathieu
    2012 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2012, : 5418 - 5421