Education research: Bias and poor interrater reliability in evaluating the neurology clinical skills examination.

ABSTRACT:

Objective

The American Board of Psychiatry and Neurology (ABPN) has recently replaced the traditional, centralized oral examination with the locally administered Neurology Clinical Skills Examination (NEX). The ABPN postulated the experience with the NEX would be similar to the Mini-Clinical Evaluation Exercise, a reliable and valid assessment tool. The reliability and validity of the NEX has not been established.

Methods

NEX encounters were videotaped at 4 neurology programs. Local faculty and ABPN examiners graded the encounters using 2 different evaluation forms: an ABPN form and one with a contracted rating scale. Some NEX encounters were purposely failed by residents. Cohen's kappa and intraclass correlation coefficients (ICC) were calculated for local vs ABPN examiners

SUBMITTER: Schuh LA 

PROVIDER: S-EPMC2839551 | biostudies-literature | 2009 Sep

REPOSITORIES: biostudies-literature