Dataset Information

Accuracy of composite diagnostic standards for pneumococcal pneumonia in vaccine trials.

ABSTRACT: Because of a lack of gold standard diagnostics, a combination of multiple diagnostic tests, or composite diagnostic standard, has been used to measure pneumococcal pneumonia (PP) in pneumococcal vaccine trials. We estimated the accuracy of composite diagnostic standards for PP used in previous randomised controlled trials by simple formulas. A systematic literature review identified five eligible trials and all trials had used different combinations of diagnostic tests for PP. The estimated values of sensitivity and minimum specificity of composite diagnostic standards varied substantially between trials: 48.4% to 98.1% and 71.0% to 97.3%, respectively. Without standardizing the outcome measurements, pneumococcal vaccine efficacy estimates against PP are not comparable between trials and their pooled estimates are biased.

SUBMITTER: Suzuki M

PROVIDER: S-EPMC9134358 | biostudies-literature | 2018 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Accuracy of composite diagnostic standards for pneumococcal pneumonia in vaccine trials.

Suzuki M M Katoh S S Miyahara R R Ariyoshi K K Morimoto K K

Epidemiology and infection 20180402 6

Because of a lack of gold standard diagnostics, a combination of multiple diagnostic tests, or composite diagnostic standard, has been used to measure pneumococcal pneumonia (PP) in pneumococcal vaccine trials. We estimated the accuracy of composite diagnostic standards for PP used in previous randomised controlled trials by simple formulas. A systematic literature review identified five eligible trials and all trials had used different combinations of diagnostic tests for PP. The estimated valu ...[more]

PMID: 29606164

Similar Datasets

Project description:BackgroundEvaluating the accuracy of extrapulmonary tuberculosis (TB) tests is challenging due to lack of a gold standard. Latent class analysis (LCA), a statistical modeling approach, can adjust for reference tests' imperfect accuracies to produce less biased test accuracy estimates than those produced by commonly used methods like composite reference standards (CRSs). Our objective is to illustrate how Bayesian LCA can address the problem of an unavailable gold standard and demonstrate how it compares to using CRSs for extrapulmonary TB tests.MethodsWe re-analyzed a dataset of presumptive extrapulmonary TB cases in New Delhi, India, for three forms of extrapulmonary TB. Results were available for culture, smear microscopy, Xpert MTB/RIF, and a non-microbiological test, cytopathology/histopathology, or adenosine deaminase (ADA). A diagram was used to define assumed relationships between observed tests and underlying latent variables in the Bayesian LCA with input from an inter-disciplinary team. We compared the results to estimates obtained from a sequence of CRSs defined by increasing numbers of positive reference tests necessary for positive disease status.ResultsData were available from 298, 388, and 230 individuals with presumptive TB lymphadenitis, meningitis, and pleuritis, respectively. Using Bayesian LCA, estimates were obtained for accuracy of all tests and for extrapulmonary TB prevalence. Xpert sensitivity neared that of culture for TB lymphadenitis and meningitis but was lower for TB pleuritis, and specificities of all microbiological tests approached 100%. Non-microbiological tests' sensitivities were high, but specificities were only moderate, preventing disease rule-in. CRSs' only provided estimates of Xpert and these varied widely per CRS definition. Accuracy of the CRSs also varied by definition, and no CRS was 100% accurate.ConclusionUnlike CRSs, Bayesian LCA takes into account known information about test performance resulting in accuracy estimates that are easier to interpret. LCA should receive greater consideration for evaluating extrapulmonary TB diagnostic tests.

Project description:BackgroundResearch has shown a modest adherence of diagnostic test accuracy (DTA) studies in glaucoma to the Standards for Reporting of Diagnostic Accuracy Studies (STARD). We have applied the updated 30-item STARD 2015 checklist to a set of studies included in a Cochrane DTA systematic review of imaging tools for diagnosing manifest glaucoma.MethodsThree pairs of reviewers, including one senior reviewer who assessed all studies, independently checked the adherence of each study to STARD 2015. Adherence was analyzed on an individual-item basis. Logistic regression was used to evaluate the effect of publication year and impact factor on adherence.ResultsWe included 106 DTA studies, published between 2003-2014 in journals with a median impact factor of 2.6. Overall adherence was 54.1% for 3,286 individual rating across 31 items, with a mean of 16.8 (SD: 3.1; range 8-23) items per study. Large variability in adherence to reporting standards was detected across individual STARD 2015 items, ranging from 0 to 100%. Nine items (1: identification as diagnostic accuracy study in title/abstract; 6: eligibility criteria; 10: index test (a) and reference standard (b) definition; 12: cut-off definitions for index test (a) and reference standard (b); 14: estimation of diagnostic accuracy measures; 21a: severity spectrum of diseased; 23: cross-tabulation of the index and reference standard results) were adequately reported in more than 90% of the studies. Conversely, 10 items (3: scientific and clinical background of the index test; 11: rationale for the reference standard; 13b: blinding of index test results; 17: analyses of variability; 18; sample size calculation; 19: study flow diagram; 20: baseline characteristics of participants; 28: registration number and registry; 29: availability of study protocol; 30: sources of funding) were adequately reported in less than 30% of the studies. Only four items showed a statistically significant improvement over time: missing data (16), baseline characteristics of participants (20), estimates of diagnostic accuracy (24) and sources of funding (30).ConclusionsAdherence to STARD 2015 among DTA studies in glaucoma research is incomplete, and only modestly increasing over time.

Project description:BackgroundVaccination with the 23-valent pneumococcal polysaccharide vaccine (PPV23) is available in the United Kingdom to adults aged 65 years or older and those in defined clinical risk groups. We evaluated the vaccine effectiveness (VE) of PPV23 against vaccine-type pneumococcal pneumonia in a cohort of adults hospitalised with community-acquired pneumonia (CAP).Methods and findingsUsing a case-control test-negative design, a secondary analysis of data was conducted from a prospective cohort study of adults (aged ≥16 years) with CAP hospitalised at 2 university teaching hospitals in Nottingham, England, from September 2013 to August 2018. The exposure of interest was PPV23 vaccination at any time point prior to the index admission. A case was defined as PPV23 serotype-specific pneumococcal pneumonia and a control as non-PPV23 serotype pneumococcal pneumonia or nonpneumococcal pneumonia. Pneumococcal serotypes were identified from urine samples using a multiplex immunoassay or from positive blood cultures. Multivariable logistic regression was used to derive adjusted odds of case status between vaccinated and unvaccinated individuals; VE estimates were calculated as (1 - odds ratio) × 100%. Of 2,357 patients, there were 717 PPV23 cases (48% vaccinated) and 1,640 controls (54.5% vaccinated). The adjusted VE (aVE) estimate against PPV23 serotype disease was 24% (95% CI 5%-40%, p = 0.02). Estimates were similar in analyses restricted to vaccine-eligible patients (n = 1,768, aVE 23%, 95% CI 1%-40%) and patients aged ≥65 years (n = 1,407, aVE 20%, 95% CI -5% to 40%), but not in patients aged ≥75 years (n = 905, aVE 5%, 95% CI -37% to 35%). The aVE estimate in relation to PPV23/non-13-valent pneumococcal conjugate vaccine (PCV13) serotype pneumonia (n = 417 cases, 43.7% vaccinated) was 29% (95% CI 6%-46%). Key limitations of this study are that, due to high vaccination rates, there was a lack of power to reject the null hypothesis of no vaccine effect, and that the study was not large enough to allow robust subgroup analysis in the older age groups.ConclusionsIn the setting of an established national childhood PCV13 vaccination programme, PPV23 vaccination of clinical at-risk patient groups and adults aged ≥65 years provided moderate long-term protection against hospitalisation with PPV23 serotype pneumonia. These findings suggest that PPV23 vaccination may continue to have an important role in adult pneumococcal vaccine policy, including the possibility of revaccination of older adults.

Dataset Information

Accuracy of composite diagnostic standards for pneumococcal pneumonia in vaccine trials.

Publications

Accuracy of composite diagnostic standards for pneumococcal pneumonia in vaccine trials.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets