Challenges in the real world use of classification accuracy metrics: From recall and precision to the Matthews correlation coefficient.

ABSTRACT: The accuracy of a classification is fundamental to its interpretation, use and ultimately decision making. Unfortunately, the apparent accuracy assessed can differ greatly from the true accuracy. Mis-estimation of classification accuracy metrics and associated mis-interpretations are often due to variations in prevalence and the use of an imperfect reference standard. The fundamental issues underlying the problems associated with variations in prevalence and reference standard quality are revisited here for binary classifications with particular attention focused on the use of the Matthews correlation coefficient (MCC). A key attribute claimed of the MCC is that a high value can only be attained when the classification performed well on both classes in a binary classification. However, it

SUBMITTER: Foody GM 

PROVIDER: S-EPMC10550141 | biostudies-literature | 2023

REPOSITORIES: biostudies-literature