Consistency results for the ROC curves of fused classifiers

被引:0
|
作者
Bjerkaas, KS [1 ]
Oxley, ME [1 ]
Bauer, KW [1 ]
机构
[1] USAF, Inst Technol, Dept Math & Stat, Grad Sch Engn & Management, Wright Patterson AFB, OH 45433 USA
关键词
C lassifier fusion; evaluation; receiver operating characteristic (ROC) curve; consistent estimator; unbiased estimator;
D O I
10.1117/12.542284
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The U.S. Air Force is researching the fusion of multiple sensors and classifiers. Given a finite collection of classifiers to be fused one seeks a new classifier with improved performance. An established performance quantifier is the Receiver Operating Characteristic (ROC) curve. This curve allows one to view the probability of detection versus probability of false alarm in one graph. In reality only finite data is available so only an approximate ROC curve can be constructed. Previous research shows that one does not have to perform an experiment for this new fused classifier to determine its ROC curve. If the ROC curve for each individual classifier has been determined, then formulas for the ROC curve of the fused classifier exist for certain fusion rules. This will be an enormous saving in time and money since the performance of many fused classifiers will be determined without having to perform tests on each one. But, again, these will be approximate ROC curves, since they are based on finite data. We show that if the individual approximate ROC curves are consistent then the approximate ROC curve for the fused classifier is also consistent under certain circumstances. We give the details for these circumstances, as well as some examples related to sensor fusion.
引用
收藏
页码:361 / 372
页数:12
相关论文
共 50 条
  • [1] Evaluating classifiers using ROC curves
    Prati, Ronaldo Cristiano
    Batista, Gustavo Enrique De Almeida Prado Alves
    Monard, Maria Carolina
    [J]. IEEE Latin America Transactions, 2008, 6 (02) : 215 - 222
  • [2] Evaluating the fusion of multiple classifiers via ROC curves
    Hill, JM
    Oxley, ME
    Bauer, KW
    [J]. SIGNAL PROCESSING, SENSOR FUSION, AND TARGET RECOGNITION XII, 2003, 5096 : 411 - 422
  • [3] Using theoretical ROC curves for analysing machine learning binary classifiers
    Omar, Luma
    Ivrissimtzis, Ioannis
    [J]. PATTERN RECOGNITION LETTERS, 2019, 128 : 447 - 451
  • [4] A comparison of ROC curves for label-fused within and across classifier systems
    Schubert, CM
    Oxley, ME
    Bauer, KW
    [J]. 2005 7th International Conference on Information Fusion (FUSION), Vols 1 and 2, 2005, : 415 - 422
  • [5] On the Convexity of ROC Curves Estimated from Radiological Test Results
    Pesce, Lorenzo L.
    Metz, Charles E.
    Berbaum, Kevin S.
    [J]. ACADEMIC RADIOLOGY, 2010, 17 (08) : 960 - 968
  • [6] Quantifying Concept Drifting in Network Traffic using ROC Curves from Naive Bayes Classifiers
    Singh, Mayank Pal
    [J]. 2013 4TH NIRMA UNIVERSITY INTERNATIONAL CONFERENCE ON ENGINEERING (NUICONE 2013), 2013,
  • [7] ROC curves for regression
    Hernandez-Orallo, Jose
    [J]. PATTERN RECOGNITION, 2013, 46 (12) : 3395 - 3411
  • [8] Some results on the area under the curve (AUC) for ROC curves.
    Walter, SD
    [J]. AMERICAN JOURNAL OF EPIDEMIOLOGY, 2002, 155 (11) : s48 - s48
  • [9] An Alternative to ROC and AUC Analysis of Classifiers
    Klawonn, Frank
    Hoeppner, Frank
    May, Sigrun
    [J]. ADVANCES IN INTELLIGENT DATA ANALYSIS X: IDA 2011, 2011, 7014 : 210 - +
  • [10] ROC curves in cost space
    José Hernández-Orallo
    Peter Flach
    César Ferri
    [J]. Machine Learning, 2013, 93 : 71 - 91