Selecting informative conformal prediction sets with false coverage rate control

被引:0
|
作者
Gazin, Ulysse [1 ,2 ]
Heller, Ruth [3 ]
Marandon, Ariane [4 ]
Roquain, Etienne [5 ,6 ]
机构
[1] Univ Paris Cite, F-75013 Paris, France
[2] Sorbonne Univ, CNRS, Lab Probabil Stat & Modelisat, F-75013 Paris, France
[3] Tel Aviv Univ, Dept Stat & Operat Res, Tel Aviv, Israel
[4] Alan Turing Inst, London, England
[5] Sorbonne Univ, F-75005 Paris, France
[6] Univ Paris Cite, CNRS, Lab Probabil Stat & Modelisat, F-75005 Paris, France
关键词
classification; false discovery rate; label shift; prediction interval; regression; selective inference; DISCOVERY RATE;
D O I
10.1093/jrsssb/qkae120
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In supervised learning, including regression and classification, conformal methods provide prediction sets for the outcome/label with finite sample coverage for any machine learning predictor. We consider here the case where such prediction sets come after a selection process. The selection process requires that the selected prediction sets be 'informative' in a well-defined sense. We consider both the classification and regression settings where the analyst may consider as informative only the sample with prediction sets small enough, excluding null values, or obeying other appropriate 'monotone' constraints. We develop a unified framework for building such informative conformal prediction sets while controlling the false coverage rate (FCR) on the selected sample. While conformal prediction sets after selection have been the focus of much recent literature in the field, the new introduced procedures, called InfoSP and InfoSCOP, are to our knowledge the first ones providing FCR control for informative prediction sets. We show the usefulness of our resulting procedures on real and simulated data.
引用
收藏
页数:21
相关论文
共 50 条
  • [31] Distributed False Discovery Rate Control with Quantization
    Xiang, Yu
    2019 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2019, : 246 - 249
  • [32] Contextual Online False Discovery Rate Control
    Chen, Shiyun
    Kasiviswanathan, Shiva Prasad
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 108, 2020, 108 : 952 - 960
  • [33] The application conditions of false discovery rate control
    Zhang, Hongbin
    Le, Xin
    Xiang, Tingxiu
    GENES & DISEASES, 2023, 10 (04) : 1145 - 1146
  • [34] Symmetric directional false discovery rate control
    Holte, Sarah E.
    Lee, Eva K.
    Mei, Yajun
    STATISTICAL METHODOLOGY, 2016, 33 : 71 - 82
  • [35] Copulas, uncertainty, and false discovery rate control
    Cerquet, Roy
    Lupi, Claudio
    INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 2018, 100 : 105 - 114
  • [36] MOTION DETECTION WITH FALSE DISCOVERY RATE CONTROL
    McHugh, J. Mike
    Konrad, Janusz
    Saligrama, Venkatesh
    Jodoin, Pierre-Marc
    Castanon, David
    2008 15TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-5, 2008, : 873 - 876
  • [37] Multiple Attribute Control Charts with False Discovery Rate Control
    Li, Yanting
    Tsung, Fugee
    QUALITY AND RELIABILITY ENGINEERING INTERNATIONAL, 2012, 28 (08) : 857 - 871
  • [38] Quantitative quality control in microarray experiments and the application in data filtering, normalization and false positive rate prediction
    Wang, XJ
    Hessner, MJ
    Wu, Y
    Pati, N
    Ghosh, S
    BIOINFORMATICS, 2003, 19 (11) : 1341 - 1347
  • [39] Coverage-Guaranteed Prediction Sets for Out-of-Distribution Data
    Zou, Xin
    Liu, Weiwei
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 15, 2024, : 17263 - 17270
  • [40] Technical note: Improving the accuracy of mid-infrared prediction models by selecting the most informative wavelengths
    Gottardo, P.
    De Marchi, M.
    Cassandro, M.
    Penasa, M.
    JOURNAL OF DAIRY SCIENCE, 2015, 98 (06) : 4168 - 4173