Abstract screening using the automated tool Rayyan: results of effectiveness in three diagnostic test accuracy systematic reviews.

ABSTRACT:

Objective

To evaluate the performance of the automated abstract screening tool Rayyan.

Methods

The records obtained from the search for three systematic reviews were manually screened in four stages. At the end of each stage, Rayyan was used to predict the eligibility score for the remaining records. At two different thresholds (≤2.5 and < 2.5 for exclusion of a record) Rayyan-generated ratings were compared with the decisions made by human reviewers in the manual screening process and the tool's accuracy metrics were calculated.

Results

Two thousand fifty-four records were screened manually, of which 379 were judged to be eligible for full-text assessment, and 112 were eventually included in the final review. For finding records eligible for full-text assessment, at

SUBMITTER: Valizadeh A 

PROVIDER: S-EPMC9161508 | biostudies-literature | 2022 Jun

REPOSITORIES: biostudies-literature