Evaluation of polygenic risk models using multiple performance measures: a critical assessment of discordant results.

ABSTRACT:

Purpose

The area under the receiver operating characteristic curve (AUC) is commonly used for evaluating the improvement of polygenic risk models and increasingly assessed together with the net reclassification improvement (NRI) and integrated discrimination improvement (IDI). We evaluated how researchers described and interpreted AUC, NRI, and IDI when simultaneously assessed.

Methods

We reviewed how researchers described definitions of AUC, NRI, and IDI and how they computed each metric. Next, we reviewed how the increment in AUC, NRI, and IDI were interpreted, and how the overall conclusion about the improvement of the risk model was reached.

Results

AUC, NRI, and IDI were correctly defined in 63, 70, and 0% of the articles. All statistically significant values and

SUBMITTER: Martens FK 

PROVIDER: S-EPMC6169739 | biostudies-literature | 2019 Feb

REPOSITORIES: biostudies-literature