Agreement testing of AMSTAR-PF, a tool for quality appraisal of systematic reviews of prognostic factor studies.

ABSTRACT:

Objectives

To test the agreement and usability of a novel quality appraisal tool: A MeaSurement Tool to Assess systematic Reviews of Prognostic Factor studies (AMSTAR-PF).

Design

Observational study.

Participants

14 appraisers of varied experience levels and backgrounds, including undergraduate, master's and PhD students, postgraduate researchers, research fellows and clinicians.

Study procedure

Eight systematic reviews were rated by all reviewers using AMSTAR-PF.

Outcome measures

Planned measures included intrapair and inter-pair agreement using Cohen's and Fleiss' kappa, time of use and time to reach consensus. Interrater agreement was an added measure, and Gwet's agreement coefficient was calculated and presented due to its greater stability across ag

SUBMITTER: Henry ML 

PROVIDER: S-EPMC12853518 | biostudies-literature | 2026 Jan

REPOSITORIES: biostudies-literature