Publication Date
1-1-2022
Abstract
In many practical situations when we need to select the best submission -- the best paper, the best candidate, etc. -- there are so few experts that we cannot simply dismiss all the experts who have conflict of interest: we do not want them to judge their own submissions, but we would like to take into account their opinions of all other submissions. How can we take these opinions into account? In this paper, we show that a seemingly reasonable idea can actually lead to bias, and we explain how to take these opinions into account without biasing the final decision.
Comments
Technical Report: UTEP-CS-22-02