How to Gauge the Quality of a Testing Method When Ground Truth Is Known with Uncertainty

Authors

Nicholas Gray, University of LiverpoolFollow
Scott Ferson, The University of Texas at El PasoFollow
Vladik Kreinovich, The University of Texas at El PasoFollow

Publication Date

2-2020

Comments

Technical Report: UTEP-CS-20-10

Abstract

The quality of a testing method is usually measured by using sensitivity, specificity, and/or precision. To compute each of these three characteristics, we need to know the ground truth, i.e., we need to know which objects actually have the tested property. In many applications (e.g., in medical diagnostics), the information about the objects comes from experts, and this information comes with uncertainty. In this paper, we show how to take this uncertainty into account when gauging the quality of testing methods.