Dataset Information

Development and validation of case-finding algorithms for recurrence of breast cancer using routinely collected administrative data.

ABSTRACT:

Background

Recurrence is not explicitly documented in cancer registry data that are widely used for research. Patterns of events after initial treatment such as oncology visits, re-operation, and receipt of subsequent chemotherapy or radiation may indicate recurrence. This study aimed to develop and validate algorithms for identifying breast cancer recurrence using routinely collected administrative data.

Methods

The study cohort included all young (≤ 40 years) breast cancer patients (2007-2010), and all patients receiving neoadjuvant chemotherapy (2012-2014) in Alberta, Canada. Health events (including mastectomy, chemotherapy, radiation, biopsy and specialist visits) were obtained from provincial administrative data. The algorithms were developed using classification and regression tree (CART) models and validated against primary chart review.

Results

Among 598 patients, 121 (20.2%) had recurrence after a median follow-up of 4 years. The high sensitivity algorithm achieved 94.2% (95% CI: 90.1-98.4%) sensitivity, 93.7% (91.5-95.9%) specificity, 79.2% (72.5-85.8%) positive predictive value (PPV), and 98.5% (97.3-99.6%) negative predictive value (NPV). The high PPV algorithm had 75.2% (67.5-82.9%) sensitivity, 98.3% (97.2-99.5%) specificity, 91.9% (86.6-97.3%) PPV, and 94% (91.9-96.1%) NPV. Combining high PPV and high sensitivity algorithms with additional (7.5%) chart review to resolve discordant cases resulted in 94.2% (90.1-98.4%) sensitivity, 98.3% (97.2-99.5%) specificity, 93.4% (89.1-97.8%) PPV, and 98.5% (97.4-99.6%) NPV.

Conclusion

The proposed algorithms based on routinely collected administrative data achieved favorably high validity for identifying breast cancer recurrences in a universal healthcare system in Canada.

SUBMITTER: Xu Y

PROVIDER: S-EPMC6408837 | biostudies-literature | 2019 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development and validation of case-finding algorithms for recurrence of breast cancer using routinely collected administrative data.

Xu Yuan Y Kong Shiying S Cheung Winson Y WY Bouchard-Fortier Antoine A Dort Joseph C JC Quan Hude H Buie Elizabeth M EM McKinnon Geoff G Quan May Lynn ML

BMC cancer 20190308 1

<h4>Background</h4>Recurrence is not explicitly documented in cancer registry data that are widely used for research. Patterns of events after initial treatment such as oncology visits, re-operation, and receipt of subsequent chemotherapy or radiation may indicate recurrence. This study aimed to develop and validate algorithms for identifying breast cancer recurrence using routinely collected administrative data.<h4>Methods</h4>The study cohort included all young (≤ 40 years) breast cancer patie ...[more]

PMID: 30849954

Similar Datasets

Project description:ObjectiveThe purpose of this study was to evaluate the performance of algorithms for identifying cases of severe hypoglycemia in Japanese hospital administrative data.MethodsThis was a multicenter, retrospective, observational study conducted at 3 acute-care hospitals in Japan. The study population included patients aged ≥18 years with diabetes who had an outpatient visit or hospital admission for possible hypoglycemia. Possible cases of severe hypoglycemia were identified using health insurance claims data and Diagnosis Procedure Combination data. Sixty-one algorithms using combinations of diagnostic codes and prescription of high concentration (≥20% mass/volume) injectable glucose were used to define severe hypoglycemia. Independent manual chart reviews by 2 physicians at each hospital were used as the reference standard. Algorithm validity was evaluated using standard performance metrics.ResultsIn total, 336 possible cases of severe hypoglycemia were identified, and 260 were consecutively sampled for validation. The best performing algorithms included 6 algorithms that had sensitivity ≥0.75, and 6 algorithms that had positive predictive values ≥0.75 with sensitivity ≥0.30. The best-performing algorithm with sensitivity ≥0.75 included any diagnoses for possible hypoglycemia or prescription of high-concentration glucose but excluded suspected diagnoses (sensitivity: 0.986 [95% confidence interval 0.959-1.013]; positive predictive value: 0.345 [0.280-0.410]). Restricting the algorithm definition to those with both a diagnosis of possible hypoglycemia and a prescription of high-concentration glucose improved the performance of the algorithm to correctly classify cases as severe hypoglycemia but lowered sensitivity (sensitivity: 0.375 [0.263-0.487]; positive predictive value: 0.771 [0.632-0.911]).ConclusionThe case-identifying algorithms in this study showed moderate positive predictive value and sensitivity for identification of severe hypoglycemia in Japanese healthcare data and can be employed by future pharmacoepidemiological studies using Japanese hospital administrative databases.

Project description:BackgroundIn recent years, there has been a growing trend in the utilization of observational studies that make use of routinely collected healthcare data (RCD). These studies rely on algorithms to identify specific health conditions (e.g. diabetes or sepsis) for statistical analyses. However, there has been substantial variation in the algorithm development and validation, leading to frequently suboptimal performance and posing a significant threat to the validity of study findings. Unfortunately, these issues are often overlooked.MethodsWe systematically developed guidance for the development, validation, and evaluation of algorithms designed to identify health status (DEVELOP-RCD). Our initial efforts involved conducting both a narrative review and a systematic review of published studies on the concepts and methodological issues related to algorithm development, validation, and evaluation. Subsequently, we conducted an empirical study on an algorithm for identifying sepsis. Based on these findings, we formulated specific workflow and recommendations for algorithm development, validation, and evaluation within the guidance. Finally, the guidance underwent independent review by a panel of 20 external experts who then convened a consensus meeting to finalize it.ResultsA standardized workflow for algorithm development, validation, and evaluation was established. Guided by specific health status considerations, the workflow comprises four integrated steps: assessing an existing algorithm's suitability for the target health status; developing a new algorithm using recommended methods; validating the algorithm using prescribed performance measures; and evaluating the impact of the algorithm on study results. Additionally, 13 good practice recommendations were formulated with detailed explanations. Furthermore, a practical study on sepsis identification was included to demonstrate the application of this guidance.ConclusionsThe establishment of guidance is intended to aid researchers and clinicians in the appropriate and accurate development and application of algorithms for identifying health status from RCD. This guidance has the potential to enhance the credibility of findings from observational studies involving RCD.

Project description:BackgroundHeart failure (HF), affecting 1-4% of adults in industrialized countries, is a major public health priority. Several algorithms based on administrative health data (HAD) have been developed to detect patients with HF in a timely and inexpensive manner, in order to perform real-world studies at the population level. However, their reported diagnostic accuracy is highly variable.ObjectiveTo assess the diagnostic accuracy of validated HAD-based algorithms for detecting HF, compared to clinical diagnosis, and to investigate causes of heterogeneity.MethodsWe included all diagnostic accuracy studies that utilized HAD for the diagnosis of congestive HF in the general adult population, using clinical examination or chart review as the reference standard. A systematic search of MEDLINE (1946-2023) and Embase (1947-2023) was conducted, without restrictions. The QUADAS-2 tool was employed to assess the risk of bias and concerns regarding applicability. Due to low-quality issues of the primary studies, associated with both the index test and the reference standard definition and conduct, and to the high level of clinical heterogeneity, a quantitative synthesis was not performed. Measures of diagnostic accuracy of the included algorithms were summarized narratively and presented graphically, by population subgroups.ResultsWe included 24 studies (161,524 patients) and extracted 36 algorithms. Algorithm selection was based on type of administrative data and DOR. Six studies (103,018 patients, 14 algorithms) were performed in the general outpatient population, with sensitivities ranging from 24.8 to 97.3% and specificities ranging from 35.6 to 99.5%. Eight studies (14,957 patients, 10 algorithms) included hospitalized patients with sensitivities ranging from 29.0 to 96.0% and specificities ranging from 65.8 to 99.2%. The remaining studies included subgroups of the general population or hospitalized patients with cardiologic conditions and were analyzed separately. Fourteen studies had one or more domains at high risk of bias, and there were concerns regarding applicability in 9 studies.DiscussionThe considerable percentage of studies with a high risk of bias, together with the high clinical heterogeneity among different studies, did not allow to generate a pooled estimate of diagnostic accuracy for HAD-based algorithms to be used in an unselected general adult population.Systematic review registrationPROSPERO CRD42023487565.

Dataset Information

Development and validation of case-finding algorithms for recurrence of breast cancer using routinely collected administrative data.

Background

Methods

Results

Conclusion

Publications

Development and validation of case-finding algorithms for recurrence of breast cancer using routinely collected administrative data.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets