Assessing Discriminative Performance at External Validation of Clinical Prediction Models.

ABSTRACT:

Introduction

External validation studies are essential to study the generalizability of prediction models. Recently a permutation test, focusing on discrimination as quantified by the c-statistic, was proposed to judge whether a prediction model is transportable to a new setting. We aimed to evaluate this test and compare it to previously proposed procedures to judge any changes in c-statistic from development to external validation setting.

Methods

We compared the use of the permutation test to the use of benchmark values of the c-statistic following from a previously proposed framework to judge transportability of a prediction model. In a simulation study we developed a prediction model with logistic regression on a development set and validated them in the validation set.

SUBMITTER: Nieboer D 

PROVIDER: S-EPMC4755533 | biostudies-literature | 2016

REPOSITORIES: biostudies-literature