G4 & the balanced metric family - a novel approach to solving binary classification problems in medical device validation & verification studies.

ABSTRACT:

Background

In medical device validation and verification studies, the area under the receiver operating characteristic curve (AUROC) is often used as a primary endpoint despite multiple reports showing its limitations. Hence, researchers are encouraged to consider alternative metrics as primary endpoints. A new metric called G4 is presented, which is the geometric mean of sensitivity, specificity, the positive predictive value, and the negative predictive value. G4 is part of a balanced metric family which includes the Unified Performance Measure (also known as P4) and the Matthews' Correlation Coefficient (MCC). The purpose of this manuscript is to unveil the benefits of using G4 together with the balanced metric family when analyzing the overall performance of binary classifiers.

SUBMITTER: Marra A 

PROVIDER: S-EPMC11515465 | biostudies-literature | 2024 Oct

REPOSITORIES: biostudies-literature