Evaluating the reliability of gestalt quality ratings of medical education podcasts: A METRIQ study.

ABSTRACT:

Introduction

Podcasts are increasingly being used for medical education. Studies have found that the assessment of the quality of online resources can be challenging. We sought to determine the reliability of gestalt quality assessment of education podcasts in emergency medicine.

Methods

An international, interprofessional sample of raters was recruited through social media, direct contact, and the extended personal network of the study team. Each participant listened to eight podcasts (selected to include a variety of accents, number of speakers, and topics) and rated the quality of that podcast on a seven-point Likert scale. Phi coefficients were calculated within each group and overall. Decision studies were conducted using a phi of 0.8.

Results

A total of 240 coll

SUBMITTER: Woods JM 

PROVIDER: S-EPMC7550476 | biostudies-literature | 2020 Oct

REPOSITORIES: biostudies-literature