Are replication rates the same across academic fields? Community forecasts from the DARPA SCORE programme.

ABSTRACT: The Defense Advanced Research Projects Agency (DARPA) programme 'Systematizing Confidence in Open Research and Evidence' (SCORE) aims to generate confidence scores for a large number of research claims from empirical studies in the social and behavioural sciences. The confidence scores will provide a quantitative assessment of how likely a claim will hold up in an independent replication. To create the scores, we follow earlier approaches and use prediction markets and surveys to forecast replication outcomes. Based on an initial set of forecasts for the overall replication rate in SCORE and its dependence on the academic discipline and the time of publication, we show that participants expect replication rates to increase over time. Moreover, they expect replication rates to differ betwee

SUBMITTER: Gordon M 

PROVIDER: S-EPMC7428244 | biostudies-literature | 2020 Jul

REPOSITORIES: biostudies-literature