Split-sample reliability estimation in health care quality measurement: Once is not enough.

ABSTRACT:

Objective

To examine the sensitivity of split-sample reliability estimates to the random split of the data and propose alternative methods for improving the stability of the split-sample method.

Data sources and study setting

Data were simulated to reflect a variety of real-world quality measure distributions and scenarios. There is no date range to report as the data are simulated.

Study design

Simulation studies of split-sample reliability estimation were conducted under varying practical scenarios.

Data collection/extraction methods

All data were simulated using functions in R.

Principal findings

Single split-sample reliability estimates can be very dependent on the random split of the data, especially in low sample size and low variability settings.

SUBMITTER: Nieser KJ 

PROVIDER: S-EPMC11250135 | biostudies-literature | 2024 Aug

REPOSITORIES: biostudies-literature