Two information-theoretic tools to assess the performance of multi-class classifiers

被引：16

作者：

Valverde-Albacete, Francisco J. ^{[1
]}

Pelaez-Moreno, Carmen ^{[1
]}

机构：

[1] Univ Carlos III Madrid, Dept Teoria Senal & Comunicac, Leganes 28911, Spain

来源：

PATTERN RECOGNITION LETTERS | 2010年 / 31卷 / 12期

关键词：

Multi-class classifier; Confusion matrix; Contingency table; Performance measure; de Finetti diagram; Entropy triangle; ROC CURVE; AREA;

D O I：

10.1016/j.patrec.2010.05.017

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

We develop two tools to analyze the behavior of multiple-class, or multi-class, classifiers by means of entropic measures on their confusion matrix or contingency table. First we obtain a balance equation on the entropies that captures interesting properties of the classifier. Second, by normalizing this balance equation we first obtain a 2-simplex in a three-dimensional entropy space and then the de Finetti entropy diagram or entropy triangle. We also give examples of the assessment of classifiers with these tools. (C) 2010 Elsevier B.V. All rights reserved.

引用

页码：1665 / 1671

页数：7

共 50 条

[21] Impact of Information on Network Performance - An Information-Theoretic Perspective
Hong, Jun
Li, Victor O. K.
GLOBECOM 2009 - 2009 IEEE GLOBAL TELECOMMUNICATIONS CONFERENCE, VOLS 1-8, 2009, : 3540 - 3545
[22] Information-theoretic matching of two point sets
Wang, Y
Woods, K
McClain, M
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2002, 11 (08) : 868 - 872
[23] Using information-theoretic measures to assess association rule interestingness
Blanchard, J
Guillet, F
Gras, R
Briand, H
FIFTH IEEE INTERNATIONAL CONFERENCE ON DATA MINING, PROCEEDINGS, 2005, : 66 - 73
[24] An Information-Theoretic Approach to the Prediction of Protein Structural Class
Zheng, Xiaoqi
Li, Chun
Wang, Jun
JOURNAL OF COMPUTATIONAL CHEMISTRY, 2010, 31 (06) : 1201 - 1206
[25] Information-theoretic performance of quadrature mirror filters
Divakaran, A
Pearlman, WA
IEEE TRANSACTIONS ON INFORMATION THEORY, 1995, 41 (06) : 2094 - 2100
[26] Information-theoretic bounds on target recognition performance
Jain, A
Moulin, P
Miller, MI
Ramchandran, K
AUTOMATIC TARGET RECOGNITION X, 2000, 4050 : 347 - 358
[27] An Information-Theoretic Approach to Performance Evaluation of Supercomputers
Anton, Rakitskiy
Boris, Ryabko
2016 XV INTERNATIONAL SYMPOSIUM PROBLEMS OF REDUNDANCY IN INFORMATION AND CONTROL SYSTEMS (REDUNDANCY), 2016, : 125 - 128
[28] Spectral Entropies as Information-Theoretic Tools for Complex Network Comparison
De Domenico, Manlio
Biamonte, Jacob
PHYSICAL REVIEW X, 2016, 6 (04):
[29] INTEGRATION OF INFORMATION-THEORETIC TOOLS FOR POLSAR IMAGE PROCESSING AND ANALYSIS
Sant'Anna, Sidnei
Freitas, Corina da C.
Torres, Leonardo
Frery, Alejandro C.
2015 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2015, : 239 - 242
[30] Information-Theoretic Tools to Understand Distributed Source Coding in Neuroscience
Feldman, Ariel K.
Venkatesh, Praveen
Weber, Douglas J.
Grover, Pulkit
IEEE JOURNAL ON SELECTED AREAS IN INFORMATION THEORY, 2024, 5 : 509 - 519

← 1 2 3 4 5 →