Dataset Information

The impact of multimorbidity level and functional limitations on the accuracy of using self-reported survey data compared to administrative data to measure general practitioner and specialist visits in community-living adults.

ABSTRACT:

Background

Researchers often use survey data to study the effect of health and social variables on physician use, but how self-reported physician use compares to administrative data, the gold standard, in particular within the context of multimorbidity and functional limitations remains unclear. We examine whether multimorbidity and functional limitations are related to agreement between self-reported and administrative data for physician use.

Methods

Cross-sectional data from 52,854 Ontario participants of the Canadian Community Health Survey linked to administrative data were used to assess agreement on physician use. The number of general practitioner (GP) and specialist visits in the previous year was assessed using both data sources; multimorbidity and functional limitation were from self-report.

Results

Fewer participants self-reported GP visits (84.8%) compared to administrative data (89.1%), but more self-reported specialist visits (69.2% vs. 64.9%). Sensitivity was higher for GP visits (≥90% for all multimorbidity levels) compared to specialist visits (approximately 75% for 0 to 90% for 4+ chronic conditions). Specificity started higher for GP than specialist visits but decreased more swiftly with multimorbidity level; in both cases, specificity levels fell below 50%. Functional limitations, age and sex did not impact the patterns of sensitivity and specificity seen across level of multimorbidity.

Conclusions

Countries around the world collect health surveys to inform health policy and planning, but the extent to which these are linked with administrative, or similar, data are limited. Our study illustrates the potential for misclassification of physician use in self-report data and the need for sensitivity analyses or other corrections.

SUBMITTER: Griffith LE

PROVIDER: S-EPMC8527741 | biostudies-literature | 2021 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The impact of multimorbidity level and functional limitations on the accuracy of using self-reported survey data compared to administrative data to measure general practitioner and specialist visits in community-living adults.

Griffith Lauren E LE Gruneir Andrea A Fisher Kathryn A KA Aljied Rumaisa R Perez Richard R Nguyen Francis F Patterson Christopher C Markle-Reid Maureen M Ploeg Jenny J Upshur Ross R

BMC health services research 20211019 1

<h4>Background</h4>Researchers often use survey data to study the effect of health and social variables on physician use, but how self-reported physician use compares to administrative data, the gold standard, in particular within the context of multimorbidity and functional limitations remains unclear. We examine whether multimorbidity and functional limitations are related to agreement between self-reported and administrative data for physician use.<h4>Methods</h4>Cross-sectional data from 52, ...[more]

PMID: 34666745

Similar Datasets

Project description:BackgroundQuantifying the burden of multimorbidity for healthcare research using administrative data has been constrained. Existing measures incompletely capture chronic conditions of relevance and are narrowly focused on risk-adjustment for mortality, healthcare cost or utilization. Moreover, the measures have not undergone a rigorous review for how accurately the components, specifically the International Classification of Diseases, Ninth Revision (ICD-9) codes, represent the chronic conditions that comprise the measures. We performed a comprehensive, structured literature review of research studies on the accuracy of ICD-9 codes validated using external sources across an inventory of 81 chronic conditions. The conditions as a weighted measure set have previously been demonstrated to impact not only mortality but also physical and mental health-related quality of life.MethodsFor each of 81 conditions we performed a structured literature search with the goal to identify 1) studies that externally validate ICD-9 codes mapped to each chronic condition against an external source of data, and 2) the accuracy of ICD-9 codes reported in the identified validation studies. The primary measure of accuracy was the positive predictive value (PPV). We also reported negative predictive value (NPV), sensitivity, specificity, and kappa statistics when available. We searched PubMed and Google Scholar for studies published before June 2019.ResultsWe identified studies with validation statistics of ICD-9 codes for 51 (64%) of 81 conditions. Most of the studies (47/51 or 92%) used medical chart review as the external reference standard. Of the validated using medical chart review, the median (range) of mean PPVs was 85% (39-100%) and NPVs was 91% (41-100%). Most conditions had at least one validation study reporting PPV ≥70%.ConclusionsTo help facilitate the use of patient-centered measures of multimorbidity in administrative data, this review provides the accuracy of ICD-9 codes for chronic conditions that impact a universally valued patient-centered outcome: health-related quality of life. These findings will assist health services studies that measure chronic disease burden and risk-adjust for comorbidity and multimorbidity using patient-centered outcomes in administrative data.

Project description:BackgroundEstimating multimorbidity (presence of two or more chronic conditions) using administrative data is becoming increasingly common. We investigated (1) the concordance of identification of chronic conditions and multimorbidity using self-report survey and administrative datasets; (2) characteristics of people with multimorbidity ascertained using different data sources; and (3) whether the same individuals are classified as multimorbid using different data sources.MethodsBaseline survey data for 90,352 participants of the 45 and Up Study-a cohort study of residents of New South Wales, Australia, aged 45 years and over-were linked to prior two-year pharmaceutical claims and hospital admission records. Concordance of eight self-report chronic conditions (reference) with claims and hospital data were examined using sensitivity (Sn), positive predictive value (PPV), and kappa (κ).The characteristics of people classified as multimorbid were compared using logistic regression modelling.ResultsAgreement was found to be highest for diabetes in both hospital and claims data (κ = 0.79, 0.78; Sn = 79%, 72%; PPV = 86%, 90%). The prevalence of multimorbidity was highest using self-report data (37.4%), followed by claims data (36.1%) and hospital data (19.3%). Combining all three datasets identified a total of 46 683 (52%) people with multimorbidity, with half of these identified using a single dataset only, and up to 20% identified on all three datasets. Characteristics of persons with and without multimorbidity were generally similar. However, the age gradient was more pronounced and people speaking a language other than English at home were more likely to be identified as multimorbid by administrative data.ConclusionsDifferent individuals, with different combinations of conditions, are identified as multimorbid when different data sources are used. As such, caution should be applied when ascertaining morbidity from a single data source as the agreement between self-report and administrative data is generally poor. Future multimorbidity research exploring specific disease combinations and clusters of diseases that commonly co-occur, rather than a simple disease count, is likely to provide more useful insights into the complex care needs of individuals with multiple chronic conditions.

Project description:Background and objectivesBilling codes are frequently used to identify AKI events in epidemiologic research. The goals of this study were to validate billing code-identified AKI against the current AKI consensus definition and to ascertain whether sensitivity and specificity vary by patient characteristic or over time.Design, setting, participants, & measurementsThe study population included 10,056 Atherosclerosis Risk in Communities study participants hospitalized between 1996 and 2008. Billing code-identified AKI was compared with the 2012 Kidney Disease Improving Global Outcomes (KDIGO) creatinine-based criteria (AKIcr) and an approximation of the 2012 KDIGO creatinine- and urine output-based criteria (AKIcr_uop) in a subset with available outpatient data. Sensitivity and specificity of billing code-identified AKI were evaluated over time and according to patient age, race, sex, diabetes status, and CKD status in 546 charts selected for review, with estimates adjusted for sampling technique.ResultsA total of 34,179 hospitalizations were identified; 1353 had a billing code for AKI. The sensitivity of billing code-identified AKI was 17.2% (95% confidence interval [95% CI], 13.2% to 21.2%) compared with AKIcr (n=1970 hospitalizations) and 11.7% (95% CI, 8.8% to 14.5%) compared with AKIcr_uop (n=1839 hospitalizations). Specificity was >98% in both cases. Sensitivity was significantly higher in the more recent time period (2002-2008) and among participants aged 65 years and older. Billing code-identified AKI captured a more severe spectrum of disease than did AKIcr and AKIcr_uop, with a larger proportion of patients with stage 3 AKI (34.9%, 19.7%, and 11.5%, respectively) and higher in-hospital mortality (41.2%, 18.7%, and 12.8%, respectively).ConclusionsThe use of billing codes to identify AKI has low sensitivity compared with the current KDIGO consensus definition, especially when the urine output criterion is included, and results in the identification of a more severe phenotype. Epidemiologic studies using billing codes may benefit from a high specificity, but the variation in sensitivity may result in bias, particularly when trends over time are the outcome of interest.

Project description:ContextMany of the publicly available health quality report cards are based on administrative data. ICD-9-CM codes in administrative data are not date stamped to distinguish between medical conditions present at the time of hospital admission and complications, which occur after hospital admission. Treating complications as preexisting conditions gives poor-performing hospitals "credit" for their complications and may cause some hospitals that are delivering low-quality care to be misclassified as average- or high-performing hospitals.ObjectiveTo determine whether hospital quality assessment based on administrative data is impacted by the inclusion of condition present at admission (CPAA) modifiers in administrative data as a date stamp indicator.Design, setting, and patientsRetrospective cohort study based on 648,866 inpatient admissions between 1998 and 2000 for coronary artery bypass graft (CABG) surgery, coronary angioplasty (PTCA), carotid endarterectomy (CEA), abdominal aortic aneurysm (AAA) repair, total hip replacement (THR), acute MI (AMI), and stroke using the California State Inpatient Database which includes CPAA modifiers. Hierarchical logistic regression was used to create separate condition-specific risk adjustment models. For each study population, one model was constructed using only secondary diagnoses present at admission based on the CPAA modifier: "date stamp" model. The second model was constructed using all secondary diagnoses, ignoring the information present in the CPAA modifier: the "no date stamp model." Hospital quality was assessed separately using the "date stamp" and the "no date stamp" risk-adjustment models.ResultsForty percent of the CABG hospitals, 33 percent of the PTCA hospitals, 40 percent of the THR hospitals, and 33 percent of the AMI hospitals identified as low-performance hospitals by the "date stamp" models were not classified as low-performance hospitals by the "no date stamp" models. Fifty percent of the CABG hospitals, 33 percent of the PTCA hospitals, 50 percent of the CEA hospitals, and 36 percent of the AMI hospitals identified as low-performance hospitals by the "no date stamp" models were not identified as low-performance hospitals by the "date stamp" models. The inclusion of the CPAA modifier had a minor impact on hospital quality assessment for AAA repair, stroke, and CEA.ConclusionThis study supports the hypothesis that the use of routine administrative data without date stamp information to construct hospital quality report cards may result in the mis-identification of hospital quality outliers. However, the CPAA modifier will need to be further validated before date stamped administrative data can be used as the basis for health quality report cards.

Project description:ObjectiveTo develop an algorithm using administrative data to measure adverse childhood experiences (ADM-ACE) within routinely collected health insurance claims and enrollment data.Data sourcesWe used claims and enrollment data from Tennessee's Medicaid program (TennCare) in 2018.Study designWe studied five types of ACEs: maltreatment and peer violence, foster care and family disruption, maternal mental illness, maternal substance use disorder, and abuse of the mother. We used diagnosis and procedure codes, prescription drug fills, and enrollment files to develop the ADM-ACE, which we applied to measure the prevalence of ACEs and to examine prevalence by demographic characteristics among our sample of children in TennCare. We compared ADM-ACE prevalence to child welfare records and survey results from Tennessee.Data collection/extraction methodsOur study sample included children aged 0-17 years who were linked to their mothers if also enrolled in TennCare in 2018 (N = 763,836 children).Principal findingsApproximately 19.2% of children in TennCare had indicators for ADM-ACEs. The prevalence of ACEs was higher among children who were younger (p < 0.001), non-Hispanic white or black (compared to Hispanic) (p < 0.001), and children residing in rural versus urban counties (p < 0.001). The prevalence of maltreatment identified through the ADM-ACE (1.6%) falls between the percent of children in Tennessee who were reported to child welfare authorities and the percent for whom reports of maltreatment were substantiated. Comparison with survey reports from Tennessee parents suggests an advantage in measuring maternal mental illness with the ADM-ACE using health insurance claims data.ConclusionsThe ADM-ACE can be applied to health encounter data to study and monitor the prevalence of certain ACEs, their association with health conditions, and the effects of policies on reducing exposure to ACEs or improving health outcomes for children with ACEs.

Project description:BackgroundThere are concerns that alternate payment plans for physicians may be associated with erosion of data quality, given that physicians are paid regardless of whether claims are submitted. Our objective was to determine the proportion of claims submitted by physician specialists using fee-for-service and alternative payment plans, and to identify and compare the validity of information coded in physician billing claims submitted by these specialists in Calgary.MethodsWe conducted a survey of physician specialists to determine their plan status and obtained consent to use physicians' claims data from 4 acute care hospitals in Calgary. Inpatient and emergency department services were identified from the Discharge Abstract Database for Alberta (Canadian Institute for Health Information) and the Alberta Ambulatory Care Classification System database. We linked services to claims by Alberta physicians from 2002 to 2009 by using unique patient and physician identifiers. After identifying the proportion of claims submitted, we reviewed inpatient charts to determine the completeness of submissions as defined by positive predictive value.ResultsOf 182 physicians who responded to the survey, 94 (51.6%) used fee-for-service plans exclusively and 51 (28.0%) used alternative payment plans exclusively. Overall completeness of physician submissions for claims was 91.8% for physicians using fee-for-service plans and 90.0% for physicians using alternative payment plans. Submission rate varied by medical specialty (surgery: 92.4% for fee for service v. 88.6% for alternative payment; internal medicine: 94.1% v. 91.3%; neurology: 95.1% v. 91.0%; and pediatrics: 95.1% v. 89.3%). Among claims submitted, the physician accuracies for billing of medical conditions were 87.8% for fee-for-service and 85.0% for alternative payment.InterpretationOverall submission rates and accuracy in recording diagnoses by physicians who used both plans were high. These findings show that the implementation of alternative payment plan programs in Alberta may not have an impact on the quality of physician claims data.

Dataset Information

The impact of multimorbidity level and functional limitations on the accuracy of using self-reported survey data compared to administrative data to measure general practitioner and specialist visits in community-living adults.

Background

Methods

Results

Conclusions

Publications

The impact of multimorbidity level and functional limitations on the accuracy of using self-reported survey data compared to administrative data to measure general practitioner and specialist visits in community-living adults.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets