Dataset Information

Measurement Error in Public Health Insurance Reporting in the American Community Survey: Evidence from Record Linkage.

ABSTRACT:

Objective

Examine measurement error to public health insurance in the American Community Survey (ACS).

Data sources/study setting

The ACS and the Medicaid Statistical Information System (MSIS).

Study design

We tabulated the two data sources separately and then merged the data and examined health insurance reports among ACS cases known to be enrolled in Medicaid or expansion Children's Health Insurance Program (CHIP) benefits.

Data collection/extraction methods

The two data sources were merged using protected identification keys. ACS respondents were considered enrolled if they had full benefit Medicaid or expansion CHIP coverage on the date of interview.

Principal findings

On an aggregated basis, the ACS overcounts the MSIS. After merging the data, we estimate a false-negative rate in the 2009 ACS of 21.6 percent. The false-negative rate varies across states, demographic groups, and year. Of known Medicaid and expansion CHIP enrollees, 12.5 percent were coded to some other coverage and 9.1 percent were coded as uninsured.

Conclusions

The false-negative rate in the ACS is on par with other federal surveys. However, unlike other surveys, the ACS overcounts the MSIS on an aggregated basis. Future work is needed to disentangle the causes of the ACS overcount.

SUBMITTER: Boudreaux MH

PROVIDER: S-EPMC4693849 | biostudies-literature | 2015 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Measurement Error in Public Health Insurance Reporting in the American Community Survey: Evidence from Record Linkage.

Boudreaux Michel H MH Call Kathleen Thiede KT Turner Joanna J Fried Brett B O'Hara Brett B

Health services research 20150412 6

<h4>Objective</h4>Examine measurement error to public health insurance in the American Community Survey (ACS).<h4>Data sources/study setting</h4>The ACS and the Medicaid Statistical Information System (MSIS).<h4>Study design</h4>We tabulated the two data sources separately and then merged the data and examined health insurance reports among ACS cases known to be enrolled in Medicaid or expansion Children's Health Insurance Program (CHIP) benefits.<h4>Data collection/extraction methods</h4>The tw ...[more]

PMID: 25865628

Similar Datasets

Project description:BackgroundMany public health departments use record linkage between surveillance data and external data sources to inform public health interventions. However, little guidance is available to inform these activities, and many health departments rely on deterministic algorithms that may miss many true matches. In the context of public health action, these missed matches lead to missed opportunities to deliver interventions and may exacerbate existing health inequities.ObjectiveThis study aimed to compare the performance of record linkage algorithms commonly used in public health practice.MethodsWe compared five deterministic (exact, Stenger, Ocampo 1, Ocampo 2, and Bosh) and two probabilistic record linkage algorithms (fastLink and beta record linkage [BRL]) using simulations and a real-world scenario. We simulated pairs of datasets with varying numbers of errors per record and the number of matching records between the two datasets (ie, overlap). We matched the datasets using each algorithm and calculated their recall (ie, sensitivity, the proportion of true matches identified by the algorithm) and precision (ie, positive predictive value, the proportion of matches identified by the algorithm that were true matches). We estimated the average computation time by performing a match with each algorithm 20 times while varying the size of the datasets being matched. In a real-world scenario, HIV and sexually transmitted disease surveillance data from King County, Washington, were matched to identify people living with HIV who had a syphilis diagnosis in 2017. We calculated the recall and precision of each algorithm compared with a composite standard based on the agreement in matching decisions across all the algorithms and manual review.ResultsIn simulations, BRL and fastLink maintained a high recall at nearly all data quality levels, while being comparable with deterministic algorithms in terms of precision. Deterministic algorithms typically failed to identify matches in scenarios with low data quality. All the deterministic algorithms had a shorter average computation time than the probabilistic algorithms. BRL had the slowest overall computation time (14 min when both datasets contained 2000 records). In the real-world scenario, BRL had the lowest trade-off between recall (309/309, 100.0%) and precision (309/312, 99.0%).ConclusionsProbabilistic record linkage algorithms maximize the number of true matches identified, reducing gaps in the coverage of interventions and maximizing the reach of public health action.

Project description:ImportanceDespite billions spent in public investment, electronic health records (EHRs) have not delivered on the promise of large quality and safety improvement. Simultaneously, there is debate on whether public quality reporting is a useful tool to incentivize quality improvement.ObjectiveTo evaluate whether publicly reported feedback was associated with hospital improvement in an evaluation of medication-related clinical decision support (CDS) safety performance.Design, settings, and participantsThis nonrandomized controlled trial included US hospitals that participated in the Computerized Provider Order Entry (CPOE) Evaluation Tool in the Leapfrog Hospital Survey, a national quality reporting program that evaluates safety performance of hospital CDS using simulated orders and patients, in 2017 to 2018. A sharp regression discontinuity design was used to identify the association of receiving negative feedback with hospital performance improvement in the subsequent year. Data were analyzed from January through September 2020.ExposuresPublicly reported quality feedback.Main outcomes and measuresThe main outcome was improvement from 2017 to 2018 on the Leapfrog CPOE Evaluation Tool, using regression discontinuity model estimates of the association of receiving negative publicly reported feedback with quality improvement.ResultsA total of 1183 hospitals were included, with a mean (SD) CPOE score of 59.3% (16.3%) at baseline. Hospitals receiving negative feedback improved 8.44 (95% CI, 0.09 to 16.80) percentage points more in the subsequent year compared with hospitals that received positive feedback on the same evaluation. This change was driven by differences in improvement in basic CDS capabilities (β = 8.71 [95%CI, 1.67 to 18.73]) rather than advanced CDS (β = 6.15 [95% CI, -9.11 to 26.83]).Conclusions and relevanceIn this nonrandomized controlled trial, publicly reported feedback was associated with quality improvement, suggesting targeted measurement and reporting of process quality may be an effective policy lever to encourage improvement in specific areas. Clinical decision support represents an important tool in ensuring patient safety and decreasing adverse drug events, especially for complex patients and those with multiple chronic conditions who often receive several different drugs during an episode of care.

Project description:BackgroundIn Brazil, both the Civil Registry (CR) and Ministry of Health (MoH) Mortality Information System (SIM) are sources of routine mortality data, but neither is 100% complete. Deaths from these two sources can be linked to facilitate estimation of completeness of mortality reporting and measurement of adjusted mortality indicators using generalized linear modeling (GLM).MethodsThe 2015 and 2016 CR and SIM data were linked using deterministic methods. GLM with covariates of the deceased's sex, age, state of residence, cause of death and place of death, and municipality-level education decile and population density decile, was used to estimate total deaths and completeness nationally, subnationally and by population sub-group, and to identify the characteristics of unreported deaths. The empirical completeness method and Global Burden of Disease (GBD) 2017 estimates were comparators at the national and state level.ResultsCompleteness was 98% for SIM and 95% for CR. The vast majority of deaths in Brazil were captured by either system and 94% were reported by both sources. For each source, completeness was lowest in the north. SIM completeness was consistently high across all sub-groups while CR completeness was lowest for deaths at younger ages, outside facilities, and in the lowest deciles of municipality education and population density. There was no clear municipality-level relationship in SIM and CR completeness, suggesting minimal dependence between sources. The empirical completeness method model 1 and GBD completeness estimates were each, on average, less than three percentage points different from GLM estimates at the state level. Life expectancy was lowest in the northeast and 7.5 years higher in females than males.ConclusionsGLM using socio-economic and demographic covariates is a valuable tool to accurately estimate completeness from linked data sources. Close scrutiny of the quality of variables used to link deaths, targeted identification of unreported deaths in poorer, northern states, and closer coordination of the two systems will help Brazil achieve 100% death reporting completeness. The results also confirm the validity of the empirical completeness method.

Dataset Information

Measurement Error in Public Health Insurance Reporting in the American Community Survey: Evidence from Record Linkage.

Objective

Data sources/study setting

Study design

Data collection/extraction methods

Principal findings

Conclusions

Publications

Measurement Error in Public Health Insurance Reporting in the American Community Survey: Evidence from Record Linkage.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets