How to Make Sense of Reliability? Common Language Interpretation of Reliability and the Relation of Reliability to Effect Size.

ABSTRACT: Communicating the factual meaning of a particular reliability estimate is sometimes difficult. What does a specific reliability estimate of 0.80 or 0.95 mean in common language? Deflation-corrected estimates of reliability (DCER) using Somers' D or Goodman-Kruskal G as the item-score correlations are transformed into forms where specific estimates from the family of common language effect sizes are visible. This makes it possible to communicate reliability estimates using a common language and to evaluate the magnitude of a particular reliability estimate in the same way and with the same metric as we do with effect size estimates. Using a DCER, we can say that with k = 40 items, if the reliability is 0.95, in 80 out of 100 random pairs of test takers from different su

SUBMITTER: Metsamuuronen J 

PROVIDER: S-EPMC12187714 | biostudies-literature | 2025 Jun

REPOSITORIES: biostudies-literature