From Simulation to Validation in Ensuring Quality and Reliability in Model-Based Predictive Analysis

被引:0
|
作者
Hrehova, Stella [1 ]
Antosz, Katarzyna [2 ]
Husar, Jozef [1 ]
Vagaska, Alena [3 ]
机构
[1] Tech Univ Kosice, Fac Mfg Technol, Dept Ind Engn & Informat, Bayerova 1, Presov 08001, Slovakia
[2] Rzeszow Univ Technol, Fac Mech Engn & Aeronaut, Powstancow Warszawy Av 35-959, Rzeszow, Poland
[3] Tech Univ Kosice, Fac Mfg Technol, Dept Nat Sci & Humanities, Bayerova 1, Presov 08001, Slovakia
来源
APPLIED SCIENCES-BASEL | 2025年 / 15卷 / 06期
关键词
simulation; model; evaluation; metrics;
D O I
10.3390/app15063107
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
The increasing complexity of artificial intelligence and machine learning models has raised concerns about balancing model accuracy and interpretability. While advanced software tools facilitate model design, they also introduce challenges in selecting models that offer both high quality and manageable complexity. Validation techniques such as Root Mean Squared Error (RMSE), Mean Absolute Error (MAE), and the Akaike Information Criterion (AIC) enable quantitative assessment, but empirical studies indicate that higher complexity does not always improve predictive performance. This study proposes an approach to evaluate model complexity versus accuracy in predicting the absorption properties of composite materials with varying textile fibre content (10%, 20%, 30%, 40%). Using MATLAB's Curve Fitting Toolbox, we assessed polynomial, Fourier, and Gaussian regression models. The Gaussian regression model with six parameters (Gauss6) achieved the best balance between complexity and accuracy (R2 = 0.9429; RMSE = 0.013537; MAE = 0.004885). Increasing parameters beyond six showed diminishing returns, as confirmed by AIC (-2806.93 for Gauss6 vs. -2847.17 for Gauss7). These findings emphasise that higher model complexity does not necessarily enhance quality, highlighting the importance of structured model validation. This study provides insights for optimising predictive modelling in material science and other domains.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] Model-based validation of CANopen systems
    Lekidis, Alexios
    Bozga, Marius
    Bensalem, Saddek
    PROCEEDINGS OF 2014 10TH IEEE WORKSHOP ON FACTORY COMMUNICATION SYSTEMS (WFCS 2014), 2014,
  • [42] Model-Based Validation for Internet Services
    Tjang, Andrew
    Oliveira, Fabio
    Bianchini, Ricardo
    Martin, Richard P.
    Nguyen, Thu D.
    2009 28TH IEEE INTERNATIONAL SYMPOSIUM ON RELIABLE DISTRIBUTED SYSTEMS, PROCEEDINGS, 2009, : 61 - 70
  • [43] Model-based Validation as Probabilistic Inference
    Delecki, Harrison
    Corso, Anthony
    Kochenderfer, Mykel J.
    LEARNING FOR DYNAMICS AND CONTROL CONFERENCE, VOL 211, 2023, 211
  • [44] OpenErrorPro: A New Tool for Stochastic Model-based Reliability and Resilience Analysis
    Morozov, Andrey
    Ding, Kai
    Steurer, Mikael
    Janschek, Klaus
    2019 IEEE 30TH INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING (ISSRE), 2019, : 303 - 312
  • [45] From Model-based to Model and Simulation-based Systems Architectures – achieving quality engineering through descriptive and analytical models
    Nowodzienski, Pierre
    Navas, Juan
    INCOSE Int. Sym., 2022, 1 (1247-1266): : 1247 - 1266
  • [46] Model-based System Reliability Analysis by using Monte Carlo Methods
    Dong, Li
    Lu, Zhong
    Li, Mengdie
    Zhou, Jia
    2019 PROGNOSTICS AND SYSTEM HEALTH MANAGEMENT CONFERENCE (PHM-QINGDAO), 2019,
  • [47] Attitude Analysis of Small Satellites Using Model-Based Simulation
    Rawashdeh, Samir A.
    INTERNATIONAL JOURNAL OF AEROSPACE ENGINEERING, 2019, 2019
  • [48] Simulation of a model-based predictive control system to optimize the methane production of a biogas reactor
    Attar, Shadi
    Haugen, Finn Aakre
    2017 11TH ASIAN CONTROL CONFERENCE (ASCC), 2017, : 1590 - 1595
  • [49] Model-based simulation and threat analysis of in-vehicle networks
    Lekidis, Alexios
    Barosan, Ion
    2019 15TH IEEE INTERNATIONAL WORKSHOP ON FACTORY COMMUNICATION SYSTEMS (WFCS), 2019,
  • [50] Modelling, simulation and multivariable model-based predictive control of marine power generation system
    Hansen, JF
    Ådnanes, AK
    Fossen, TI
    CONTROL APPLICATIONS IN MARINE SYSTEMS (CAMS'98), 1999, : 41 - 46