Homogeneity score test of AC₁ statistics and estimation of common AC₁ in multiple or stratified inter-rater agreement studies.

ABSTRACT:

Background

Cohen's κ coefficient is often used as an index to measure the agreement of inter-rater determinations. However, κ varies greatly depending on the marginal distribution of the target population and overestimates the probability of agreement occurring by chance. To overcome these limitations, an alternative and more stable agreement coefficient was proposed, referred to as Gwet's AC₁. When it is desired to combine results from multiple agreement studies, such as in a meta-analysis, or to perform stratified analysis with subject covariates that affect agreement, it is of interest to compare several agreement coefficients and present a common agreement index. A homogeneity test of κ was developed; however, there are no reports on homogeneity tests for AC₁

SUBMITTER: Honda C 

PROVIDER: S-EPMC7001312 | biostudies-literature | 2020 Feb

REPOSITORIES: biostudies-literature