Detecting cheating in written medical examinations by statistical analysis of similarity of answers: pilot study.

ABSTRACT:

Objective

To assess whether a computer program using a variant of Angoff's method can detect anomalous behaviour indicative of cheating in multiple choice medical examinations.

Design

Statistical analysis of 11 examinations held by the Royal College of Paediatrics and Child Health.

Setting

UK postgraduate medical examination.

Participants

Examination candidates.

Main outcome measures

Detection of anomalous candidate pairs by regression of similarity of correct answers in all possible pairs of candidates on the overall proportion of correct answers. Anomalous pairs were subsequently assessed in terms of examination centres and the seating plan of candidates, to assess adjacency.

Results

The 11 examinations were taken by a total of 11,518 candidates

SUBMITTER: McManus IC 

PROVIDER: S-EPMC557229 | biostudies-literature | 2005 May

REPOSITORIES: biostudies-literature