Unknown

Dataset Information

Error rates of human reviewers during abstract screening in systematic reviews.


ABSTRACT:

Background

Automated approaches to improve the efficiency of systematic reviews are greatly needed. When testing any of these approaches, the criterion standard of comparison (gold standard) is usually human reviewers. Yet, human reviewers make errors in inclusion and exclusion of references.

Objectives

To determine citation false inclusion and false exclusion rates during abstract screening by pairs of independent reviewers. These rates can help in designing, testing and implementing automated approaches.

Methods

We identified all systematic reviews conducted between 2010 and 2017 by an evidence-based practice center in the United States. Eligible reviews had to follow standard systematic review procedures with dual independent screening of abstracts and full texts,

SUBMITTER: Wang Z 

PROVIDER: S-EPMC6959565 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature