The impact of grey zones on the accuracy of agreement measures for ordinal tables.

ABSTRACT:

Background

In an inter-rater agreement study, if two raters tend to rate considering different aspects of the subject of interest or have different experience levels, a grey zone occurs among the levels of a square contingency table showing the inter-rater agreement. These grey zones distort the degree of agreement between raters and negatively impact the decisions based on the inter-rater agreement tables. In this sense, it is important to know how the existence of a grey zone impacts the inter-rater agreement coefficients to choose the most reliable agreement coefficient against the grey zones to reach out with more reliable decisions.

Methods

In this article, we propose two approaches to create grey zones in simulations setting and conduct an extensive Monte Carlo simulat

SUBMITTER: Tran QD 

PROVIDER: S-EPMC8048180 | biostudies-literature | 2021 Apr

REPOSITORIES: biostudies-literature