From Simulation to Validation in Ensuring Quality and Reliability in Model-Based Predictive Analysis

被引:0
|
作者
Hrehova, Stella [1 ]
Antosz, Katarzyna [2 ]
Husar, Jozef [1 ]
Vagaska, Alena [3 ]
机构
[1] Tech Univ Kosice, Fac Mfg Technol, Dept Ind Engn & Informat, Bayerova 1, Presov 08001, Slovakia
[2] Rzeszow Univ Technol, Fac Mech Engn & Aeronaut, Powstancow Warszawy Av 35-959, Rzeszow, Poland
[3] Tech Univ Kosice, Fac Mfg Technol, Dept Nat Sci & Humanities, Bayerova 1, Presov 08001, Slovakia
来源
APPLIED SCIENCES-BASEL | 2025年 / 15卷 / 06期
关键词
simulation; model; evaluation; metrics;
D O I
10.3390/app15063107
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
The increasing complexity of artificial intelligence and machine learning models has raised concerns about balancing model accuracy and interpretability. While advanced software tools facilitate model design, they also introduce challenges in selecting models that offer both high quality and manageable complexity. Validation techniques such as Root Mean Squared Error (RMSE), Mean Absolute Error (MAE), and the Akaike Information Criterion (AIC) enable quantitative assessment, but empirical studies indicate that higher complexity does not always improve predictive performance. This study proposes an approach to evaluate model complexity versus accuracy in predicting the absorption properties of composite materials with varying textile fibre content (10%, 20%, 30%, 40%). Using MATLAB's Curve Fitting Toolbox, we assessed polynomial, Fourier, and Gaussian regression models. The Gaussian regression model with six parameters (Gauss6) achieved the best balance between complexity and accuracy (R2 = 0.9429; RMSE = 0.013537; MAE = 0.004885). Increasing parameters beyond six showed diminishing returns, as confirmed by AIC (-2806.93 for Gauss6 vs. -2847.17 for Gauss7). These findings emphasise that higher model complexity does not necessarily enhance quality, highlighting the importance of structured model validation. This study provides insights for optimising predictive modelling in material science and other domains.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Model-based reliability analysis
    Bierbaum, RL
    Brown, TD
    Kerschen, TJ
    ANNUAL RELIABILITY AND MAINTAINABILITY SYMPOSIUM, 2001 PROCEEDINGS, 2001, : 326 - 332
  • [2] Model-based reliability analysis
    Linden, Julia
    Sellgren, Ulf
    Soderberg, Anders
    AI EDAM-ARTIFICIAL INTELLIGENCE FOR ENGINEERING DESIGN ANALYSIS AND MANUFACTURING, 2016, 30 (03): : 277 - 288
  • [3] Model-based reliability analysis
    Bierbaum, RL
    Brown, TD
    Kerschen, TJ
    IEEE TRANSACTIONS ON RELIABILITY, 2002, 51 (02) : 133 - 140
  • [4] A tool for model-based reliability analysis
    Niskanen, Antti
    VTT Tiedotteita - Valtion Teknillinen Tutkimuskeskus, 2006, (2331): : 3 - 58
  • [5] Model-based Human Reliability Analysis
    Jun, Li
    Tao, Zhang
    PROCEEDINGS OF THE 9TH CONFERENCE ON MAN-MACHINE-ENVIRONMENT SYSTEM ENGINEERING, 2009, : 6 - +
  • [6] Simulation and Analysis of the Reliability of the Cloud Model-based Automatic Environmental Monitoring System
    Shao, Ying
    Li, Xiaoming
    2011 ASIA-PACIFIC POWER AND ENERGY ENGINEERING CONFERENCE (APPEEC), 2011,
  • [7] Complex System Reliability Analysis using a Model-Based Shared Systems Simulation
    Ross, Jeremy
    INCOSE International Symposium, 2023, 33 (01) : 212 - 228
  • [8] A Model-Based method for System Reliability Analysis
    Garro, Alfredo
    Tundis, Andrea
    THEORY OF MODELING AND SIMULATION: DEVS INTEGRATIVE M&S SYMPOSIUM 2012 (DEVS 2012), 2012, 44 (04): : 126 - 133
  • [9] Performance model-based reliability simulation analysis of multi-state electromechanical system
    Hu, Yubin
    Wang, Ruping
    Wang, Xin
    Wang, Tao
    Zhan, Zitao
    2018 PROGNOSTICS AND SYSTEM HEALTH MANAGEMENT CONFERENCE (PHM-CHONGQING 2018), 2018, : 985 - 992
  • [10] Model-based testing considering cost, reliability and software quality
    Htoon, Chaw Yupar
    Thein, Ni Lar
    APSITT 2005: 6th Asia-Pacific Symposium on Information and Telecommunication Technologies, Proceedings, 2005, : 160 - 164