Reproducible variability: assessing investigator discordance across 9 research teams attempting to reproduce the same observational study.

ABSTRACT:

Objective

Observational studies can impact patient care but must be robust and reproducible. Nonreproducibility is primarily caused by unclear reporting of design choices and analytic procedures. This study aimed to: (1) assess how the study logic described in an observational study could be interpreted by independent researchers and (2) quantify the impact of interpretations' variability on patient characteristics.

Materials and methods

Nine teams of highly qualified researchers reproduced a cohort from a study by Albogami et al. The teams were provided the clinical codes and access to the tools to create cohort definitions such that the only variable part was their logic choices. We executed teams' cohort definitions against the database and compared the number of subjects

SUBMITTER: Ostropolets A 

PROVIDER: S-EPMC10114120 | biostudies-literature | 2023 Apr

REPOSITORIES: biostudies-literature