How to Gauge the Quality of a Multi-Class Classification When Ground Truth Is Known with Uncertainty

Authors

Ricardo Mendez, The University of Texas at El PasoFollow
Osagumwenro Osaretin, The University of Texas at El PasoFollow
Vladik Kreinovich, The University of Texas at El PasoFollow

Publication Date

11-1-2021

Comments

Technical Report: UTEP-CS-21-99

Abstract

The usual formulas for gauging the quality of a classification method assume that we know the ground truth, i.e., that for several objects, we know for sure to which class they belong. In practice, we often only know this with some degree of certainty. In this paper, we explain how to take this uncertainty into account when gauging the quality of a classification method.