The cost-effectiveness of reclassification sampling for prevalence estimation.
Ontology highlight
ABSTRACT: Background
Typically, a two-phase (double) sampling strategy is employed when classifications are subject to error and there is a gold standard (perfect) classifier available. Two-phase sampling involves classifying the entire sample with an imperfect classifier, and a subset of the sample with the gold-standard.Methodology/principal findings
In this paper we consider an alternative strategy termed reclassification sampling, which involves classifying individuals using the imperfect classifier more than one time. Estimates of sensitivity, specificity and prevalence are provided for reclassification sampling, when either one or two binary classifications of each individual using the imperfect classifier are available. Robustness of estimates and design decisions to model assumptions are considered. Software is provided to compute estimates and provide advice on the optimal sampling strategy.Conclusions/significance
Reclassification sampling is shown to be cost-effective (lower standard error of estimates for the same cost) for estimating prevalence as compared to two-phase sampling in many practical situations.
SUBMITTER: Bekmetjev A
PROVIDER: S-EPMC3278465 | biostudies-literature | 2012
REPOSITORIES: biostudies-literature
Publications
The cost-effectiveness of reclassification sampling for prevalence estimation.
Bekmetjev Airat A VanBruggen Dirk D McLellan Brian B DeWinkle Benjamin B Lunderberg Eric E Tintle Nathan N
PloS one 20120213 2
<h4>Background</h4>Typically, a two-phase (double) sampling strategy is employed when classifications are subject to error and there is a gold standard (perfect) classifier available. Two-phase sampling involves classifying the entire sample with an imperfect classifier, and a subset of the sample with the gold-standard.<h4>Methodology/principal findings</h4>In this paper we consider an alternative strategy termed reclassification sampling, which involves classifying individuals using the imperf ...[more]
Similar Datasets
Project description:In the last decades diseases have changed coral communities' structure and function in reefs worldwide. Studies conducted to evaluate the effect of diseases on corals frequently use modified adaptations of sampling designs that were developed to study ecological aspects of coral reefs. Here we evaluate how efficient these sampling protocols are by generating virtual data for a coral population parameterized with mean coral density and disease prevalence estimates from the Caribbean scleractinian Orbicella faveolata at the Mexican Caribbean. Six scenarios were tested consisting of three patterns of coral colony distribution (random, randomly clustered and randomly over-dispersed) and two disease transmission modes (random and contagious). The virtual populations were sampled with the commonly used method of belt-transects with variable sample-unit sizes (10 × 1, 10 × 2, 25 × 2, 50 × 2 m). Results showed that the probability of obtaining a mean coral disease prevalence estimate of ±5% of the true prevalence value was low (range: 11-48%) and that two-sample comparisons achieved rather low power, unless very large effect sizes existed. Such results imply low statistical confidence to assess differences or changes in coral disease prevalence. The main problem identified was insufficient sample size because local mean colony size, density and spatial distribution of targeted coral species was not taken into consideration to properly adjust the sampling protocols.
| S-EPMC6282945 | biostudies-literature
Project description:HPV self-sampling (HPV-SS) can increase cervical cancer screening participation by addressing barriers in high- and low- and middle-income settings. Successful implementation of HPV-SS programs will depend on understanding potential costs and health effects. Our objectives were to summarize the methods and results of published HPV-SS cost and cost-effectiveness studies, present implications of these results for HPV-SS program implementation, and identify knowledge gaps. We followed the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines. One reviewer searched online databases for articles published through June 12, 2019, identified eligible studies, and extracted data; a second reviewer checked extracted data for accuracy. Eligible studies used an economic model to compare HPV-SS outreach strategies to standard-of-care tests. Of 16 eligible studies, 14 reported HPV-SS could be a cost-effective strategy. Studies differed in model type, HPV-SS delivery methods, triage strategies for positive results, and target populations. Most (9/16) modeled HPV-SS in European screening programs, 6/16 targeted women who were underscreened for cervical cancer, and 5/16 modeled HPV-SS in low- and middle-income countries. The most commonly identified driver of HPV-SS cost-effectiveness was the level of increase in cervical cancer screening attendance. Lower HPV-SS material and testing costs, higher sensitivity to detect cervical precancer, and longer duration of underscreening among HPV-SS users were also associated with increased cost-effectiveness. Future HPV-SS models in high-income settings should explore the effect of widespread vaccination and new triage strategies such as partial HPV genotyping. Knowledge gaps remain about the cost-effectiveness of HPV-SS in low- and middle-income settings.
| S-EPMC7219564 | biostudies-literature
Project description:BackgroundThe number of confirmed COVID-19 cases divided by population size is used as a coarse measurement for the burden of disease in a population. However, this fraction depends heavily on the sampling intensity and the various test criteria used in different jurisdictions, and many sources indicate that a large fraction of cases tend to go undetected.MethodsEstimates of the true prevalence of COVID-19 in a population can be made by random sampling and pooling of RT-PCR tests. Here I use simulations to explore how experiment sample size and degrees of sample pooling impact precision of prevalence estimates and potential for minimizing the total number of tests required to get individual-level diagnostic results.ResultsSample pooling can greatly reduce the total number of tests required for prevalence estimation. In low-prevalence populations, it is theoretically possible to pool hundreds of samples with only marginal loss of precision. Even when the true prevalence is as high as 10% it can be appropriate to pool up to 15 samples. Sample pooling can be particularly beneficial when the test has imperfect specificity by providing more accurate estimates of the prevalence than an equal number of individual-level tests.ConclusionSample pooling should be considered in COVID-19 prevalence estimation efforts.
| S-EPMC7376319 | biostudies-literature
Project description:Two-phase sampling design is a common practice in many medical studies. Generally, the first-phase classification is fallible but relatively cheap, while the accurate second phase state-of-the-art medical diagnosis is complex and rather expensive to perform. When constructed efficiently it offers great potential for higher true case detection as well as for higher precision at a limited cost. In this article, we consider epidemiological studies with two-phase sampling design. However, instead of a single two-phase study, we consider a scenario where a series of two-phase studies are done in a longitudinal fashion on a cohort of interest. Another major design issue is non-curable pattern of certain disease (e.g. Dementia, Alzheimer's etc.). Thus often the identified disease positive subjects are removed from the original population under observation, as they require clinical attention, which is quite different from the yet unidentified group. In this article, we motivated our methodology development from two real-life studies. We consider efficient and simultaneous estimation of prevalence as well incidence at multiple time points from a sampling design-based approach. We have explicitly shown the benefit of our developed methodology for an elderly population with significant burden of home-health care usage and at the high risk of major depressive disorder.
| S-EPMC7868051 | biostudies-literature
Project description:IntroductionThe propensity for influenza viruses to mutate and recombine makes them both a familiar threat and a prototype emerging infectious disease. Emerging evidence suggests that the use of MF59-adjuvanted vaccines in older adults and young children enhances protection against influenza infection and reduces adverse influenza-attributable outcomes compared to unadjuvanted vaccines. The health and economic impact of such vaccines in the Canadian population are uncertain.MethodsWe constructed an age-structured compartmental model simulating the transmission of influenza in the Canadian population over a ten-year period. We compared projected health outcomes (quality-adjusted life years (QALY) lost), costs, and incremental cost-effectiveness ratios (ICERs) for three strategies: (i) current use of unadjuvanted trivalent influenza vaccine; (ii) use of MF59-adjuvanted influenza vaccine adults ≥65 in the Canadian population, and (iii) adjuvanted vaccine used in both older adults and children aged < 6.ResultsIn the base case analysis, use of adjuvanted vaccine in older adults was highly cost-effective (ICER = $2111/QALY gained), but such a program was "dominated" by a program that extended the use of adjuvanted vaccine to include young children (ICER = $1612/QALY). Results were similar whether or not a universal influenza immunization program was used in other age groups; projections were robust in the face of wide-ranging sensitivity analyses.InterpretationBased on the best available data, it is projected that replacement of traditional trivalent influenza vaccines with MF59-adjuvanted vaccines would confer substantial benefits to vaccinated and unvaccinated individuals, and would be economically attractive relative to other widely-used preventive interventions.
| S-EPMC3215749 | biostudies-literature
Project description:Considerations regarding clinical effectiveness and cost are essential in comparing the overall value of two treatments. There has been growing interest in methodology to integrate cost and effectiveness measures in order to inform policy and promote adequate resource allocation. The net monetary benefit aggregates information on differences in mean cost and clinical outcomes; the cost-effectiveness acceptability curve was developed to characterize the extent to which the strength of evidence regarding net monetary benefit changes with fluctuations in the willingness-to-pay threshold. Methods to derive insights from characteristics of the cost/clinical outcomes besides mean differences remain undeveloped but may also be informative. We propose a novel probabilistic measure of cost-effectiveness based on the stochastic ordering of the individual net benefit distribution under each treatment. Our approach is able to accommodate features frequently encountered in observational data including confounding and censoring, and complements the net monetary benefit in the insights it provides. We conduct a range of simulations to evaluate finite-sample performance and illustrate our proposed approach using simulated data based on a study of endometrial cancer patients.
| S-EPMC8211369 | biostudies-literature
Project description:ImportanceVariant reclassification is an important component of hereditary cancer genetic testing; however, there are few published data quantifying the prevalence of reclassification.ObjectiveRetrospective cohort study of individuals who had genetic testing from 2006 through 2016 at a single commercial laboratory.Design, setting, and participantsA retrospective cohort of individuals who had genetic testing between 2006 and 2016 at a single commercial laboratory was assessed. Variants were classified as benign, likely benign, variant of uncertain significance, likely pathogenic, or pathogenic. Retrospective chart reviews were conducted for patients from the University of Texas Southwestern (UTSW) Medical Center.ExposuresHereditary cancer genetic testing.Main outcomes and measuresFrequency of and time to amended reports; frequency and types of variant reclassification.ResultsFrom 2006 through 2018, 1.45 million individuals (median [interquartile range] age at testing, 49 years [40.69-58.31 years], 95.6% women) had genetic testing, and 56.6% (n = 821 724) had a personal history of cancer. A total of 1.67 million initial tests were reported and 59 955 amended reports were issued due to variant reclassification. Overall, 6.4% (2868 of 44 777) of unique variants were reclassified. Reclassification to a different clinical category was rare among unique variants initially classified as pathogenic or likely pathogenic (0.7%, 61 of 9112) or benign or likely benign (0.2%, 15 of 8995). However, 7.7% (2048 of 26 670) of unique variants of uncertain significance were reclassified: 91.2% (1867 of 2048) were downgraded to benign or likely benign (median time to amended report, 1.17 years), 8.7% (178 of 2048) were upgraded to pathogenic or likely pathogenic variants (median time to amended report, 1.86 years). Because most variants were observed in more than 1 individual, 24.9% (46 890 of 184 327) of all reported variants of uncertain significance were reclassified.Conclusions and relevanceFollowing hereditary cancer genetic testing at a single commercial laboratory, 24.9% of variants of uncertain significance were reclassified, which included both downgrades and upgrades. Further research is needed to assess generalizability of the findings for other laboratories, as well as the clinical consequences of the reclassification as a component of a genetic testing program.
| S-EPMC6233618 | biostudies-literature
Project description:BackgroundPharmacotherapies remain a central focus of successful tobacco control, but uptake remains very low.ObjectiveTo estimate the cost effectiveness of a primary care nicotine replacement therapy (NRT) sampling intervention.DesignA Markov cohort simulation model was constructed to conduct cost-effectiveness analyses. Clinical trial results were used to initialize the Markov model. All other model parameters were derived from the literature. The study was conducted over a lifetime horizon, from the payers' budgetary perspective.ParticipantsSmokers with a primary care visit.InterventionMedication sampling, which provided short, starter packets of NRT (nicotine patch and lozenge) to smokers in the primary care setting.Main measuresLifetime healthcare expenditures, quality-adjusted life years, and life years.Key resultsMedication sampling was the dominant strategy compared to standard care. Our intervention cost $75, yielding a discounted lifetime savings of $1065 in healthcare expenditures, and increased both discounted quality-adjusted life years and discounted life years by 0.01. One-way sensitivity analyses showed that medication sampling remained dominant in plausible ranges except when it failed to increase cessation relative to standard care. Probabilistic sensitivity analyses confirmed that medication sampling was dominant in 94.1% of the simulated cases, with an implementation cost of $74 (95% CI $73-$76) and discounted lifetime savings in health expenditures of $1061 (- $1106 to - $1,017), increasing quality-adjusted life years by 0.008 (0.0085-0.0093) and life years by 0.008 (0.0081-0.0089).ConclusionMedication sampling, an easily implementable, scalable and low-cost intervention to encourage smoking cessation, is cost saving and improves quality of life.
| S-EPMC9585132 | biostudies-literature
Project description:Researchers are increasingly studying carbon (C) storage by natural ecosystems for climate mitigation, including coastal 'blue carbon' ecosystems. Unfortunately, little guidance on how to achieve robust, cost-effective estimates of blue C stocks to inform inventories exists. We use existing data (492 cores) to develop recommendations on the sampling effort required to achieve robust estimates of blue C. Using a broad-scale, spatially explicit dataset from Victoria, Australia, we applied multiple spatial methods to provide guidelines for reducing variability in estimates of soil C stocks over large areas. With a separate dataset collected across Australia, we evaluated how many samples are needed to capture variability within soil cores and the best methods for extrapolating C to 1 m soil depth. We found that 40 core samples are optimal for capturing C variance across 1000's of kilometres but higher density sampling is required across finer scales (100-200 km). Accounting for environmental variation can further decrease required sampling. The within core analyses showed that nine samples within a core capture the majority of the variability and log-linear equations can accurately extrapolate C. These recommendations can help develop standardized methods for sampling programmes to quantify soil C stocks at national scales.
| S-EPMC6170757 | biostudies-literature
Project description:ImportanceCommercial epicutaneous peanut immunotherapy (EPIT) and peanut oral immunotherapy (POIT) may offer significant quality-of-life improvements for patients with peanut allergy, but the cost-effectiveness of commercial peanut immunotherapies is uncharacterized.ObjectiveTo evaluate critical inputs associated with the cost-effectiveness of EPIT and POIT from a societal perspective.Design, setting, and participantsEconomic evaluation in which microsimulations with Markov modeling were performed evaluating virtual children aged 4 years over an 80-year time horizon. The base-case costs included a caregiver-reported willingness to pay of $3839 annually for safe and effective food allergy treatment. Estimates of predictive biomarkers or oral challenges were incorporated after the first year of therapy with additional analyses of immunotherapy risk reduction of anaphylaxis and probability of sustained unresponsiveness (SU) to peanut after 4 years.ExposuresChildren received EPIT, POIT, or no immunotherapy treatment (n = 10 000 per treatment strategy).Main outcomes and measuresRates of therapy-associated adverse reactions and quality-of-life improvements associated with changes in eliciting or tolerated peanut doses were modeled along with quality-adjusted life-years (QALYs), anaphylaxis, therapy-associated anaphylaxis, and fatalities.ResultsIn the base-case analysis without SU to peanut, the EPIT strategy cost less than POIT (mean [SD] cost, $154 662 [$46 716] vs $163 524 [$56 800]) and had fewer total episodes of anaphylaxis (mean [SD], 1.33 [1.55] vs 3.83 [5.02] episodes) and fewer episodes of therapy-associated anaphylaxis (mean [SD], 0.62 [1.30] vs 3.10 [4.94] episodes) but had lower QALY accumulation (mean [SD], 26.932 [2.241] vs 26.945 [2.320] QALYs). The incremental cost-effectiveness ratio was $216 061 for EPIT and $255 431 for POIT. Models were sensitive to therapy cost, SU rates, health state utility, and risk reduction of anaphylaxis. With health state utility sensitivity analyses, the ceiling value-based cost (willingness-to-pay threshold $100 000/QALY) was between $1568 and $6568 for EPIT and between $1235 and $5235 for POIT. If high rates of SU to peanut can be achieved in longer-term models, EPIT and POIT could produce savings in terms of both cost and QALY.Conclusions and relevanceIn this simulated analysis, findings showed that EPIT and POIT may be cost-effective under some assumptions. Further research is needed to understand the degree of health state utility improvement associated with each therapy, degree of protection against anaphylaxis, and rates of SU.
| S-EPMC6503512 | biostudies-literature