Log-Linear Modeling of Agreement among Expert Exposure Assessors.

ABSTRACT:

Background

Evaluation of expert assessment of exposure depends, in the absence of a validation measurement, upon measures of agreement among the expert raters. Agreement is typically measured using Cohen's Kappa statistic, however, there are some well-known limitations to this approach. We demonstrate an alternate method that uses log-linear models designed to model agreement. These models contain parameters that distinguish between exact agreement (diagonals of agreement matrix) and non-exact associations (off-diagonals). In addition, they can incorporate covariates to examine whether agreement differs across strata.

Methods

We applied these models to evaluate agreement among expert ratings of exposure to sensitizers (none, likely, high) in a study of occupational asthma.

SUBMITTER: Hunt PR 

PROVIDER: S-EPMC4506313 | biostudies-literature | 2015 Jul

REPOSITORIES: biostudies-literature