Sensitivity analysis approaches to high-dimensional screening problems at low sample size

被引:22
|
作者
Becker, W. E. [1 ]
Tarantola, S. [1 ]
Deman, G. [2 ]
机构
[1] European Commiss, Joint Res Ctr, Via E Fermi 2749, I-21027 Ispra, Italy
[2] Univ Neuchatel, Ctr Hydrogeol & Geotherm CHYN, Neuchatel, Switzerland
关键词
Sensitivity analysis; screening; Sobol' indices; elementary effects; Derivative-based global sensitivity measures; G* function; low-discrepancy sequences; MODELS; VARIABLES; INDEXES; DESIGNS; OUTPUT; LINK;
D O I
10.1080/00949655.2018.1450876
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Sensitivity analysis is an essential tool in the development of robust models for engineering, physical sciences, economics and policy-making, but typically requires running the model a large number of times in order to estimate sensitivity measures. While statistical emulators allow sensitivity analysis even on complex models, they only perform well with a moderately low number of model inputs: in higher dimensional problems they tend to require a restrictively high number of model runs unless the model is relatively linear. Therefore, an open question is how to tackle sensitivity problems in higher dimensionalities, at very low sample sizes. This article examines the relative performance of four sampling-based measures which can be used in such high-dimensional nonlinear problems. The measures tested are the Sobol' total sensitivity indices, the absolute mean of elementary effects, a derivative-based global sensitivity measure, and a modified derivative-based measure. Performance is assessed in a screening' context, by assessing the ability of each measure to identify influential and non-influential inputs on a wide variety of test functions at different dimensionalities. The results show that the best-performing measure in the screening context is dependent on the model or function, but derivative-based measures have a significant potential at low sample sizes that is currently not widely recognised.
引用
收藏
页码:2089 / 2110
页数:22
相关论文
共 50 条
  • [31] Multiple-instance ensemble for construction of deep heterogeneous committees for high-dimensional low-sample-size data
    Zhou, Qinghua
    Wang, Shuihua
    Zhu, Hengde
    Zhang, Xin
    Zhang, Yudong
    [J]. NEURAL NETWORKS, 2023, 167 : 380 - 399
  • [32] Why are high-dimensional finance problems often of low effective dimension?
    Wang, XQ
    Sloan, IH
    [J]. SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2005, 27 (01): : 159 - 183
  • [33] Relations between facets of low- and high-dimensional group problems
    Santanu S. Dey
    Jean-Philippe P. Richard
    [J]. Mathematical Programming, 2010, 123 : 285 - 313
  • [34] Adaptive Differential Evolution with Variable Population Size for Solving High-Dimensional Problems
    Wang, Hui
    Rahnamayan, Shahryar
    Wu, Zhijian
    [J]. 2011 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2011, : 2626 - 2632
  • [35] Analysis of high-dimensional repeated measures designs: The one sample case
    Ahmad, M. Rauf
    Werner, C.
    Brunner, E.
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2008, 53 (02) : 416 - 427
  • [36] Sample Size Determination With False Discovery Rate Adjustment for Experiments With High-Dimensional Data
    Cai, Gengqian
    Lin, Xiwu
    Lee, Kwan
    [J]. STATISTICS IN BIOPHARMACEUTICAL RESEARCH, 2010, 2 (02): : 165 - 174
  • [37] Spectral analysis of high-dimensional sample covariance matrices with missing observations
    Jurczak, Kamil
    Rohde, Angelika
    [J]. BERNOULLI, 2017, 23 (4A) : 2466 - 2532
  • [38] Sample size planning for developing classifiers using high-dimensional DNA microarray data
    Dobbin, Kevin K.
    Simon, Richard M.
    [J]. BIOSTATISTICS, 2007, 8 (01) : 101 - 117
  • [39] Risk of Selection of Irrelevant Features from High-Dimensional Data with Small Sample Size
    Maciejewski, Henryk
    [J]. STOCHASTIC MODELS, STATISTICS AND THEIR APPLICATIONS, 2015, 122 : 399 - 405
  • [40] A simulation-approximation approach to sample size planning for high-dimensional classification studies
    de Valpine, Perry
    Bitter, Hans-Marcus
    Brown, Michael P. S.
    Heller, Jonathan
    [J]. BIOSTATISTICS, 2009, 10 (03) : 424 - 435