Conformal Prediction Sets for Ordinal Classification

被引:0
|
作者
Dey, Prasenjit [1 ]
Merugu, Srujana [1 ]
Kaveri, Sivaramakrishnan [1 ]
机构
[1] Amazon, Bangalore, Karnataka, India
关键词
AGE; REGRESSION;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Ordinal classification (OC), i.e., labeling instances along classes with a natural ordering, is common in multiple applications such as disease severity labeling and size or budget based recommendations. Often in practical scenarios, it is desirable to obtain a small set of likely classes with a guaranteed high chance of including the true class. Recent works on conformal prediction (CP) address this problem for the classification setting with non-ordered labels but the resulting prediction sets (PS) are often non-contiguous and unsuitable for ordinal classification. In this work, we propose a framework to adapt existing CP methods to generate contiguous sets with guaranteed coverage and minimal cardinality. Our framework employs a novel non-parametric approach for modeling unimodal distributions. Empirical results on both synthetic and real-world datasets demonstrate that our method outperforms SOTA baselines by 4% on Accuracy@K and 8% on PS size.
引用
下载
收藏
页数:21
相关论文
共 50 条
  • [1] Conformal Risk Control for Ordinal Classification
    Xu, Yunpeng
    Guo, Wenge
    Wei, Zhi
    UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, 2023, 216 : 2346 - 2355
  • [2] Rough sets and ordinal classification
    Bioch, JC
    Popova, V
    ALGORITHMIC LEARNING THEORY, PROCEEDINGS, 2000, 1968 : 291 - 305
  • [3] NESTED CONFORMAL PREDICTION SETS FOR CLASSIFICATION WITH APPLICATIONS TO PROBATION DATA
    Kuchibhotla, Arun K.
    Berk, Richard A.
    ANNALS OF APPLIED STATISTICS, 2023, 17 (01): : 761 - 785
  • [4] Improving Trustworthiness of AI Disease Severity Rating in Medical Imaging with Ordinal Conformal Prediction Sets
    Lu, Charles
    Angelopoulos, Anastasios N.
    Pomerantz, Stuart
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT VIII, 2022, 13438 : 545 - 554
  • [5] Stable Conformal Prediction Sets
    Ndiaye, Eugene
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [6] Selection and Aggregation of Conformal Prediction Sets
    Yang, Yachong
    Kuchibhotla, Arun Kumar
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2024,
  • [7] On the Expected Size of Conformal Prediction Sets
    Dhillon, Guneet S.
    Deligiannidis, George
    Rainforth, Tom
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 238, 2024, 238
  • [8] Conformal Prediction Sets with Limited False Positives
    Fisch, Adam
    Schuster, Tal
    Jaakkola, Tommi
    Barzilay, Regina
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [9] Interpretation of Conformal Prediction Classification Models
    Ahlberg, Ernst
    Spjuth, Ola
    Hasselgren, Catrin
    Carlsson, Lars
    STATISTICAL LEARNING AND DATA SCIENCES, 2015, 9047 : 323 - 334
  • [10] Classification with Reject Option Using Conformal Prediction
    Linusson, Henrik
    Johansson, Ulf
    Bostrom, Henrik
    Lofstrom, Tuve
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2018, PT I, 2018, 10937 : 94 - 105