Confidence and Discoveries with E-values

被引:8
|
作者
Vovk, Vladimir [1 ]
Wang, Ruodu [2 ]
机构
[1] Royal Holloway Univ London, Dept Comp Sci, Egham, Surrey, England
[2] Univ Waterloo, Dept Stat & Actuarial Sci, Waterloo, ON, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Hypothesis testing; multiple hypothesis testing; Bayes factor; discovery vector; discovery matrix; STATISTICAL SIGNIFICANCE; TESTS; CALIBRATION;
D O I
10.1214/22-STS874
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We discuss systematically two versions of confidence regions: those based on p-values and those based on e-values, a recent alternative to p-values. Both versions can be applied to multiple hypothesis testing, and in this paper we are interested in procedures that control the number of false dis-coveries under arbitrary dependence between the base p- or e-values. We in-troduce a procedure that is based on e-values and show that it is efficient both computationally and statistically using simulated and real-world data sets. Comparison with the corresponding standard procedure based on p-values is not straightforward, but there are indications that the new one performs significantly better in some situations.
引用
收藏
页码:329 / 354
页数:26
相关论文
共 50 条
  • [21] E-values for effect heterogeneity and approximations for causal interaction
    Mathur, Maya B.
    Smith, Louisa H.
    Yoshida, Kazuki
    Ding, Peng
    VanderWeele, Tyler J.
    INTERNATIONAL JOURNAL OF EPIDEMIOLOGY, 2022, 51 (04) : 1268 - 1275
  • [22] Web Site and R Package for Computing E-values
    Mathur, Maya B.
    Ding, Peng
    Riddell, Corinne A.
    VanderWeele, Tyler J.
    EPIDEMIOLOGY, 2018, 29 (05) : E45 - E47
  • [23] E-values for k-Sample Tests with Exponential Families
    Hao, Yunda
    Grunwald, Peter
    Lardy, Tyron
    Long, Long
    Adams, Reuben
    SANKHYA-SERIES A-MATHEMATICAL STATISTICS AND PROBABILITY, 2024, 86 (01): : 596 - 636
  • [24] Testing with p*-values: Between p-values, mid p-values, and e-values
    Wang, Ruodu
    BERNOULLI, 2024, 30 (02) : 1313 - 1346
  • [25] Testing exchangeability in the batch mode with e-values and Markov alternatives
    Vovk, Vladimir
    MACHINE LEARNING, 2025, 114 (04)
  • [26] Log-optimal anytime-valid E-values
    Koolen, Wouter M.
    Grünwald, Peter
    International Journal of Approximate Reasoning, 2022, 141 : 69 - 82
  • [27] Addressing Unmeasured Confounders in Observational Surgical Studies: E-values
    D. C. Chang
    C. E. Cauley
    Journal of Gastrointestinal Surgery, 2023, 27 : 1296 - 1297
  • [28] Are E-values too optimistic or too pessimistic? Both and neither
    Sjolander, Arvid
    Greenland, Sander
    INTERNATIONAL JOURNAL OF EPIDEMIOLOGY, 2022, 51 (02) : 355 - 363
  • [29] Addressing Unmeasured Confounders in Observational Surgical Studies: E-values
    Chang, D. C.
    Cauley, C. E.
    JOURNAL OF GASTROINTESTINAL SURGERY, 2023, 27 (06) : 1296 - 1297
  • [30] THE USE OF CORRECTLY ORIENTED MOLECULAR FRAGMENTS FOR A MODIFICATION OF E-VALUES
    MESSERSCHMIDT, A
    RECK, G
    KUTSCHABSKY, L
    ACTA CRYSTALLOGRAPHICA SECTION A, 1982, 38 (NOV): : 868 - 869