Dataset Information

How Well Does TSTin3D Predict Risk of Active Tuberculosis in the Canadian Immigrant Population? An External Validation Study.

ABSTRACT:

Background

The online Tuberculin Skin Test/Interferon Gamma Release Assay (TST/IGRA) Interpreter V3.0 (TSTin3D), a tool for estimating the risk of active tuberculosis (TB) in individuals with latent TB infection (LTBI), has been in use for more than a decade, but its predictive performance has never been evaluated.

Methods

People with a positive TST or IGRA result from 1985 to 2015 were identified using a health data linkage that involved migrants to British Columbia, Canada. Comorbid conditions at the time of LTBI testing were identified from physician claims, hospitalizations, vital statistics, outpatient prescriptions, and kidney and HIV databases. The risk of developing active TB within 2 and 5 years was estimated using TSTin3D. The discrimination and calibration of these estimates were evaluated.

Results

A total of 37 163 individuals met study inclusion criteria; 10.4% were tested by IGRA. Generally, the TSTin3D algorithm assigned higher risks to demographic and clinical groups known to have higher active TB risks. Concordance estimates ranged from 0.66 to 0.68 in 2- and 5-year time frames. Comparing predicted to observed counts suggests that TSTin3D overestimates active TB risks and that overestimation increases over time (with relative bias of 3% and 12% in 2- and 5-year periods, respectively). Calibration plots also suggest that overestimation increases toward the upper end of the risk spectrum.

Conclusions

TSTin3D can discriminate adequately between people who developed and did not develop active TB in this linked database of migrants with predominately positive skin tests. Further work is needed to improve TSTin3D's calibration.

SUBMITTER: Puyat JH

PROVIDER: S-EPMC8631069 | biostudies-literature | 2021 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

How Well Does TSTin3D Predict Risk of Active Tuberculosis in the Canadian Immigrant Population? An External Validation Study.

Puyat Joseph H JH Shulha Hennady P HP Balshaw Robert R Campbell Jonathon R JR Law Stephanie S Menzies Richard R Johnston James C JC

Clinical infectious diseases : an official publication of the Infectious Diseases Society of America 20211101 9

<h4>Background</h4>The online Tuberculin Skin Test/Interferon Gamma Release Assay (TST/IGRA) Interpreter V3.0 (TSTin3D), a tool for estimating the risk of active tuberculosis (TB) in individuals with latent TB infection (LTBI), has been in use for more than a decade, but its predictive performance has never been evaluated.<h4>Methods</h4>People with a positive TST or IGRA result from 1985 to 2015 were identified using a health data linkage that involved migrants to British Columbia, Canada. Como ...[more]

PMID: 32556316

Similar Datasets

Project description:BackgroundContacts of tuberculosis index cases are at increased risk of developing tuberculosis. Screening, preventive therapy, and surveillance for tuberculosis are underused interventions in contacts, particularly adults. We developed a score to predict risk of tuberculosis in adult contacts of tuberculosis index cases.MethodsIn 2002-06, we recruited contacts aged 15 years or older of index cases with pulmonary tuberculosis who lived in desert shanty towns in Ventanilla, Peru. We followed up contacts for tuberculosis until February, 2016. We used a Cox proportional hazards model to identify index case, contact, and household risk factors for tuberculosis from which to derive a score and classify contacts as low, medium, or high risk. We validated the score in an urban community recruited in Callao, Peru, in 2014-15.FindingsIn the derivation cohort, we identified 2017 contacts of 715 index cases, and median follow-up was 10·7 years (IQR 9·5-11·8). 178 (9%) of 2017 contacts developed tuberculosis during 19 147 person-years of follow-up (incidence 0·93 per 100 person-years, 95% CI 0·80-1·08). Risk factors for tuberculosis were body-mass index, previous tuberculosis, age, sustained exposure to the index case, the index case being in a male patient, lower community household socioeconomic position, indoor air pollution, previous tuberculosis among household members, and living in a household with a low number of windows per room. The 10-year risks of tuberculosis in the low-risk, medium-risk, and high-risk groups were, respectively, 2·8% (95% CI 1·7-4·4), 6·2% (4·8-8·1), and 20·6% (17·3-24·4). The 535 (27%) contacts classified as high risk accounted for 60% of the tuberculosis identified during follow-up. The score predicted tuberculosis independently of tuberculin skin test and index-case drug sensitivity results. In the external validation cohort, 65 (3%) of 1910 contacts developed tuberculosis during 3771 person-years of follow-up (incidence 1·7 per 100 person-years, 95% CI 1·4-2·2). The 2·5-year risks of tuberculosis in the low-risk, medium-risk, and high-risk groups were, respectively, 1·4% (95% CI 0·7-2·8), 3·9% (2·5-5·9), and 8·6%· (5·9-12·6).InterpretationOur externally validated risk score could predict and stratify 10-year risk of developing tuberculosis in adult contacts, and could be used to prioritise tuberculosis control interventions for people most likely to benefit.FundingWellcome Trust, Department for International Development Civil Society Challenge Fund, Joint Global Health Trials consortium, Bill & Melinda Gates Foundation, Imperial College National Institutes of Health Research Biomedical Research Centre, Foundation for Innovative New Diagnostics, Sir Halley Stewart Trust, WHO, TB REACH, and Innovation for Health and Development.

Project description:BackgroundThe epidemiological impact and cost-effectiveness of social protection and biomedical interventions for tuberculosis-affected households might be improved by risk stratification. We therefore derived and externally validated a household-level risk score to predict tuberculosis among contacts of patients with tuberculosis.MethodsIn this prospective cohort study, we recruited tuberculosis-affected households from 15 desert shanty towns in Ventanilla and 17 urban communities in Callao, Lima, Peru. Tuberculosis-affected households included index patients with a new diagnosis of tuberculosis and their contacts who reported being in the same house as the index patient for more than 6 h per week in the 2 weeks preceding index patient diagnosis. Tuberculosis-affected households were not included if the index patient had no eligible contacts or lived alone. We followed contacts until 2018 and defined household tuberculosis, the primary outcome, as any contact having any form of tuberculosis within 3 years. We used logistic regression to identify characteristics of index patients, contacts, and households that were predictive of household tuberculosis, and used these to derive and externally validate a household-level score.FindingsBetween Dec 12, 2007, and Dec 31, 2015, 16 505 contacts from 3 301 households in Ventanilla were included in a derivation cohort. During the 3-year follow-up, tuberculosis occurred in contacts of index patients in 430 (13%, 95% CI 12-14) households. Index patient predictors were pulmonary tuberculosis and sputum smear grade, age, and the maximum number of hours any contact had spent with the index patient while they had any cough. Household predictors were drug use, schooling of the female head of a household, and lower food spending. Contact predictors were if any of the contacts were children, number of lower-weight (body-mass index [BMI] <20·0 kg/m2) adult contacts, number of normal-weight (BMI 20·0-24·9 kg/m2) adult contacts, and number of past or present household members who previously had tuberculosis. In this derivation cohort, the score c statistic was 0·77 and the risk of household tuberculosis in the highest scoring quintile was 31% (95% CI 25-38; 65 of 211) versus 2% (95% CI 0-4; four of 231) in the lowest scoring quintile. We externally validated the risk score in a cohort of 4248 contacts from 924 households in Callao recruited between April 23, 2014, and Dec 31, 2015. During follow-up, tuberculosis occurred in contacts of index patients in 120 (13%, 95% CI 11-15) households. The score c statistic in this cohort was 0·75 and the risk of household tuberculosis in the highest scoring quintile was 28% (95% CI 21-36; 43 of 154) versus 1% (95% CI 0-5; two of 148) in the lowest scoring quintile. The highest-scoring third of households captured around 70% of all tuberculosis among contacts. A simplified risk score including only five variables performed similarly, with only a small reduction in performance.InterpretationThis externally validated score will enable comprehensive biosocial, household-level interventions to be targeted to tuberculosis-affected households that are most likely to benefit.FundingWellcome Trust, Medical Research Council, Department of Health and Social Care, Department for International Development, Joint Global Health Trials consortium, Bill & Melinda Gates Foundation, Innovation for Health and Development.

Project description:BackgroundPrediction of lifetime cardiovascular disease (CVD) risk is recommended in many clinical guidelines, but lifetime risk models are rarely externally validated. The aim of this study was to externally validate the QRiskLifetime incident CVD risk prediction tool.MethodsIndependent external validation of QRiskLifetime using Clinical Practice Research Datalink data, examining discrimination and calibration in the whole population and stratified by age, and reclassification compared to QRISK3. Since lifetime CVD risk is unobservable, performance was evaluated at 10-years' follow-up, and lifetime performance inferred in terms of performance for in the different age-groups from which lifetime predictions are derived.ResultsOne million, two hundreds sixty thousand and three hundreds twenty nine women and 1,223,265 men were included in the analysis. Discrimination was excellent in the whole population (Harrell's-C = 0.844 in women, 0.808 in men), but moderate to poor stratified by age-group (Harrell's C in people aged 30-44 0.714 for both men and women, in people aged 75-84 0.578 in women and 0.556 in men). Ten-year CVD risk was under-predicted in the whole population, and in all age-groups except women aged 45-64, with worse under-prediction in older age-groups. Compared to those at highest QRISK3 estimated 10-year risk, those with highest lifetime risk were younger (mean age: women 50.5 vs. 71.3 years; men 46.3 vs. 63.8 years) and had lower systolic blood pressure and prevalence of treated hypertension, but had more family history of premature CVD, and were more commonly minority ethnic. Over 10-years, the estimated number needed to treat (NNT) with a statin to prevent one CVD event in people with QRISK3 ≥ 10% was 34 in women and 37 in men, compared to 99 and 100 for those at highest lifetime risk.ConclusionsQRiskLifetime underpredicts 10-year CVD risk in nearly all age-groups, so is likely to also underpredict lifetime risk. Treatment based on lifetime risk has considerably lower medium-term benefit than treatment based on 10-year risk.

Project description:Background & aimsThe Toronto hepatocellular carcinoma (HCC) risk index (THRI) is a predictive model to determine the risk of HCC in patients with cirrhosis. This study aimed to externally validate the THRI in a Swedish setting to investigate whether it could identify patients not requiring HCC surveillance.MethodsFrom 2004-2017, 2,491 patients with cirrhosis at the Karolinska University Hospital were evaluated. Patients were classified into low-, intermediate- and high-risk groups for future HCC according to the THRI. Harrell's C-index, calibration-in-the-large, calibration slope and goodness-of-fit estimates were calculated to assess model discrimination and calibration. Cox proportional hazards regression was used to determine the risk of HCC.ResultsMost patients were male (n = 1,638, 66%). The most common etiologies of cirrhosis were steatohepatitis (n = 1,182, 48%) followed by viral hepatitis (n = 987, 40%). In all, 131 patients (5.3%) were designated as low risk for HCC. Harrell's C-index was 0.69. Calibration-in-the-large (0.11), calibration slope (1.24, not different from 1, p = 0.66) and goodness-of-fit showed good model calibration. Patients in the high-risk group had a 7.1-fold (95% CI 2.9-17.2) higher risk of HCC and patients in the intermediate-risk group had a 2.5-fold (95% CI 1.0-6.3) higher risk compared to the low-risk group.ConclusionsIn a Swedish setting, the THRI could differentiate between low- and high-risk of HCC development. However, because the low-risk group was relatively small (5.3%), the clinical applicability of the THRI could be limited.Lay summaryThe Toronto hepatocellular carcinoma (HCC) risk index (THRI) is a novel prediction model used to stratify patients with cirrhosis based on future risk of HCC. In this study, the THRI was validated in an external cohort using the TRIPOD guidance. Few patients were identified as low-risk, and the THRI had a modest discriminative ability, limiting its clinical applicability.

Project description:ObjectivesEvaluate the accuracy of the Breast Cancer Risk Assessment Tool (BCRAT), International Breast Cancer Intervention Study risk evaluation tool (IBIS), Polygenic Risk Scores (PRS) and combined scores (BCRAT+PRS and IBIS +PRS) to predict the occurrence of invasive breast cancers at 5 years in a French-Canadian population.DesignPopulation-based cohort study.SettingWe used the population-based cohort CARTaGENE, composed of 43 037 Quebec residents aged between 40 and 69 years and broadly representative of the population recorded on the Quebec administrative health insurance registries.Participants10 200 women recruited in 2009-2010 were included for validating BCRAT and IBIS and 4555 with genetic information for validating the PRS and combined scores.Outcome measuresWe computed the absolute risks of breast cancer at 5 years using BCRAT, IBIS, four published PRS and combined models. We reported the overall calibration performance, goodness-of-fit test and discriminatory accuracy.Results131 (1.28%) women developed a breast cancer at 5 years for validating BCRAT and IBIS and 58 (1.27%) for validating PRS and combined scores. Median follow-up was 5 years. BCRAT and IBIS had an overall expected-to-observed ratio of 1.01 (0.85-1.19) and 1.02 (0.86-1.21) but with significant differences when partitioning by risk groups (p<0.05). IBIS' c-index was significantly higher than BCRAT (63.42 (59.35-67.49) vs 58.63 (54.05-63.21), p=0.013). PRS scores had a global calibration around 0.82, with a CI including one, and non-significant goodness-of-fit tests. PRS' c-indexes were non-significantly higher than BCRAT and IBIS, the highest being 64.43 (58.23-70.63). Combined models did not improve the results.ConclusionsIn this French-Canadian population-based cohort, BCRAT and IBIS have good mean calibration that could be improved for risk subgroups, and modest discriminatory accuracy. Despite this modest discriminatory power, these tools can be of interest for primary care physicians for delivering a personalised message to their high-risk patients, regarding screening and lifestyle counselling.

Project description:ImportanceThe risk for low-trauma fracture is increased by more than 30% after ischemic stroke, but existing fracture risk scores do not account for history of stroke as a high-risk condition.ObjectiveTo derive a risk score to predict the probability of fracture within 1 year after ischemic stroke and validate it in a separate cohort.Design, setting, and participantsPrognostic study of a cohort from the Ontario Stroke Registry, a population-based sample of adults in Ontario, Canada, who were hospitalized with ischemic stroke from July 1, 2003, to March 31, 2012, with 1 year of follow-up. A population-based validation cohort consisted of a sample of 13 698 consecutive stroke admissions captured across 5 years: April 2002 to March 2003, April 2004 to March 2005, April 2008 to March 2009, April 2010 to March 2011, and April 2012 to March 2013.ExposuresPredictor variables were selected based on biological plausibility and association with fracture risk. Age, sex, and modified Rankin score were abstracted from the medical records part of the Ontario Stroke Audit, and other characteristics were abstracted from administrative health data.Main outcomes and measuresIncidence of low-trauma fracture within 1 year of discharge, based on administrative health data.ResultsThe Fracture Risk after Ischemic Stroke (FRAC-Stroke) Score was derived in 20 435 patients hospitalized for ischemic stroke (mean [SD] age, 71.6 [14.0] years; 9564 [46.8%] women) from the Ontario Stroke Registry discharged from July 1, 2003, to March 31, 2012, using Fine-Gray competing risk regression. Low-trauma fracture occurred within 1 year of discharge in 741 of the 20 435 patients (3.6%) in the derivation cohort. Age, discharge modified Rankin score (mRS), and history of rheumatoid arthritis, osteoporosis, falls, and previous fracture were associated with the cumulative incidence of low trauma fracture in the derivation cohort. Model discrimination in the validation cohort (n = 13 698) was good (C statistic, 0.70). Discharge mRS was an important discriminator of risk (relative integrated discrimination improvement, 8.7%), with highest risk in patients with mRS 3 and 4 but lowest in bedbound patients (mRS 5). From the lowest to the highest FRAC-Stroke quintile, the cumulative incidence of 1-year low-trauma fracture increased from 1.3% to 9.0% in the validation cohort. Predicted and observed rates of fracture were similar in the external validation cohort. Analysis was conducted from July 2016 to January 2019.Conclusions and relevanceThe FRAC-Stroke score allows the clinician to identify ischemic stroke survivors at higher risk of low-trauma fracture within 1 year of hospital discharge. This information might be used to select patients for interventions to prevent fractures.

Dataset Information

How Well Does TSTin3D Predict Risk of Active Tuberculosis in the Canadian Immigrant Population? An External Validation Study.

Background

Methods

Results

Conclusions

Publications

How Well Does TSTin3D Predict Risk of Active Tuberculosis in the Canadian Immigrant Population? An External Validation Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets