Selecting informative conformal prediction sets with false coverage rate control

被引:0
|
作者
Gazin, Ulysse [1 ,2 ]
Heller, Ruth [3 ]
Marandon, Ariane [4 ]
Roquain, Etienne [5 ,6 ]
机构
[1] Univ Paris Cite, F-75013 Paris, France
[2] Sorbonne Univ, CNRS, Lab Probabil Stat & Modelisat, F-75013 Paris, France
[3] Tel Aviv Univ, Dept Stat & Operat Res, Tel Aviv, Israel
[4] Alan Turing Inst, London, England
[5] Sorbonne Univ, F-75005 Paris, France
[6] Univ Paris Cite, CNRS, Lab Probabil Stat & Modelisat, F-75005 Paris, France
关键词
classification; false discovery rate; label shift; prediction interval; regression; selective inference; DISCOVERY RATE;
D O I
10.1093/jrsssb/qkae120
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In supervised learning, including regression and classification, conformal methods provide prediction sets for the outcome/label with finite sample coverage for any machine learning predictor. We consider here the case where such prediction sets come after a selection process. The selection process requires that the selected prediction sets be 'informative' in a well-defined sense. We consider both the classification and regression settings where the analyst may consider as informative only the sample with prediction sets small enough, excluding null values, or obeying other appropriate 'monotone' constraints. We develop a unified framework for building such informative conformal prediction sets while controlling the false coverage rate (FCR) on the selected sample. While conformal prediction sets after selection have been the focus of much recent literature in the field, the new introduced procedures, called InfoSP and InfoSCOP, are to our knowledge the first ones providing FCR control for informative prediction sets. We show the usefulness of our resulting procedures on real and simulated data.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Conformal link prediction for false discovery rate control
    Marandon, Ariane
    TEST, 2024, 33 (04) : 1062 - 1083
  • [2] Selective conformal inference with false coverage-statement rate control
    Bao, Yajie
    Huo, Yuyang
    Ren, Haojie
    Zou, Changliang
    BIOMETRIKA, 2024, 111 (03) : 727 - 742
  • [3] Conformal Prediction Sets with Limited False Positives
    Fisch, Adam
    Schuster, Tal
    Jaakkola, Tommi
    Barzilay, Regina
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [4] Selecting More Informative Training Sets with Fewer Observations
    Kaufman, Aaron R.
    POLITICAL ANALYSIS, 2024, 32 (01) : 133 - 139
  • [5] Restoring coverage to the Bayesian false discovery rate control procedure
    David L. Gold
    Knowledge and Information Systems, 2012, 33 : 401 - 417
  • [6] Restoring coverage to the Bayesian false discovery rate control procedure
    Gold, David L.
    KNOWLEDGE AND INFORMATION SYSTEMS, 2012, 33 (02) : 401 - 417
  • [7] Stable Conformal Prediction Sets
    Ndiaye, Eugene
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [8] Selecting an Informative/Discriminating Multivariate Response for Inverse Prediction
    Thomas, Edward V.
    Lewis, John R.
    Anderson-Cook, Christine M.
    Burr, Tom
    Hamada, Michael S.
    JOURNAL OF QUALITY TECHNOLOGY, 2017, 49 (03) : 228 - 243
  • [9] Selection and Aggregation of Conformal Prediction Sets
    Yang, Yachong
    Kuchibhotla, Arun Kumar
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2024,
  • [10] On the Expected Size of Conformal Prediction Sets
    Dhillon, Guneet S.
    Deligiannidis, George
    Rainforth, Tom
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 238, 2024, 238