Meta-Analysis of Interrater Reliability of Supervisory Performance Ratings: Effects of Appraisal Purpose, Scale Type, and Range Restriction.

ABSTRACT: Objectives: This reliability generalization study aimed to estimate the mean and variance of the interrater reliability coefficients (r yy ) of supervisory ratings of overall, task, contextual, and positive job performance. The moderating effect of the appraisal purpose and the scale type was examined. It was hypothesized that the ratings collected for research purposes and multi-item scales have higher r yy . It was also examined whether r yy was similar for the four performance dimensions. Method: A database consisting of 224 independent samples was created and hierarchical sub-grouping meta-analyses were conducted. Results: The appraisal purpose was a moderator of r yy for the four performance dimensions. Scale type was a moderator of r yy for overall and task performance collected for

SUBMITTER: Salgado JF 

PROVIDER: S-EPMC6813221 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature