Importance sampling method for Feldman-Cousins confidence intervals

被引:0
|
作者
Berns, Lukas [1 ]
机构
[1] Tohoku Univ, Sendai, Miyagi, Japan
关键词
D O I
10.1103/PhysRevD.109.092002
中图分类号
P1 [天文学];
学科分类号
0704 ;
摘要
In various high-energy physics contexts, such as neutrino-oscillation experiments, several assumptions underlying the typical asymptotic confidence interval construction are violated, such that one has to resort to computationally expensive methods like the Feldman-Cousins method for obtaining confidence intervals with proper statistical coverage. By construction, the computation of intervals at high confidence levels requires fitting millions or billions of pseudoexperiments, while wasting most of the computational cost on overly precise intervals at low confidence levels. In this work, a simple importance sampling method is introduced that reuses pseudoexperiments produced for all tested parameter values in a single mixture distribution. This results in a significant error reduction on the estimated critical values, especially at high confidence levels, and simultaneously yields a correct interpolation of these critical values between the parameter values at which the pseudoexperiments were produced. The theoretically calculated performance is demonstrated numerically using a simple example from the analysis of neutrino oscillations. The relationship to similar techniques applied in statistical mechanics and p-value computations is discussed.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Combining neutrino oscillation experiments with the Feldman-Cousins method
    Waldron, A. V.
    Haigh, M. D.
    Weber, A.
    NEW JOURNAL OF PHYSICS, 2012, 14
  • [2] Harmonizing discovery thresholds and reporting two-sided confidence intervals: a modified Feldman & Cousins method
    Mora, K. D.
    JOURNAL OF INSTRUMENTATION, 2019, 14 (02)
  • [3] BETTER CONFIDENCE INTERVALS FOR IMPORTANCE SAMPLING
    Sak, Halis
    Hormann, Wolfgang
    Leydold, Josef
    INTERNATIONAL JOURNAL OF THEORETICAL AND APPLIED FINANCE, 2010, 13 (08) : 1279 - 1291
  • [4] BETTER CONFIDENCE INTERVALS FOR IMPORTANCE SAMPLING
    Sak, Halis
    Leydold, Josef
    2008 WINTER SIMULATION CONFERENCE, VOLS 1-5, 2008, : 2949 - 2949
  • [5] Implementation of Feldman-Cousins corrections and oscillation calculations in the HPC environment for the NOvA Experiment
    Sousa, Alexandre
    Buchanan, Norman
    Calvez, Steven
    Ding, Pengfei
    Doyle, Derek
    Himmel, Alexander
    Holzman, Burt
    Kowalkowski, James
    Norman, Andrew
    Peterka, Thomas
    23RD INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP 2018), 2019, 214
  • [7] Estimates and confidence intervals for importance sampling sensitivity analysis
    Hesterberg, TC
    MATHEMATICAL AND COMPUTER MODELLING, 1996, 23 (8-9) : 79 - 85
  • [9] Conservative hypothesis tests and confidence intervals using importance sampling
    Harrison, Matthew T.
    BIOMETRIKA, 2012, 99 (01) : 57 - 69
  • [10] Confidence intervals in Cavalieri sampling
    Garcia-Finana, M.
    JOURNAL OF MICROSCOPY, 2006, 222 : 146 - 157