RE: "RECEIVER OPERATING CHARACTERISTIC CURVE INFERENCE FROM A SAMPLE WITH A LIMIT OF DETECTION".
Ontology highlight
ABSTRACT:
SUBMITTER: Wang M
PROVIDER: S-EPMC5860001 | biostudies-literature | 2016 Oct
REPOSITORIES: biostudies-literature
Publications
RE: "RECEIVER OPERATING CHARACTERISTIC CURVE INFERENCE FROM A SAMPLE WITH A LIMIT OF DETECTION".
Wang Ming M Li Zheng Z Reeves Brian B
American journal of epidemiology 20160912 7
Similar Datasets
Project description:The area under the receiver operating characteristic curve is a widely used measure for evaluating the performance of a diagnostic test. Common approaches for inference on area under the receiver operating characteristic curve are usually based upon approximation. For example, the normal approximation based inference tends to suffer from the problem of low accuracy for small sample size. Frequentist empirical likelihood based approaches for area under the receiver operating characteristic curve estimation may perform better, but are usually conducted through approximation in order to reduce the computational burden, thus the inference is not exact. By contrast, we proposed an exact inferential procedure by adapting the empirical likelihood into a Bayesian framework and draw inference from the posterior samples of the area under the receiver operating characteristic curve obtained via a Gibbs sampler. The full conditional distributions within the Gibbs sampler only involve empirical likelihoods with linear constraints, which greatly simplify the computation. To further enhance the applicability and flexibility of the Bayesian empirical likelihood, we extend our method to the estimation of partial area under the receiver operating characteristic curve, comparison of multiple tests, and the doubly robust estimation of area under the receiver operating characteristic curve in the presence of missing test results. Simulation studies confirm the desirable performance of the proposed methods, and a real application is presented to illustrate its usefulness.
| S-EPMC9241147 | biostudies-literature
Project description:Time-dependent receiver operating characteristic curves are often used to evaluate the classification performance of continuous measures when considering time-to-event data. When one is interested in evaluating the predictive performance of multiple covariates, it is common to use the Cox proportional hazards model to obtain risk scores; however, previous work has shown that when the model is mis-specified, the estimand corresponding to the partial likelihood estimator depends on the censoring distribution. In this manuscript, we show that when the risk score model is mis-specified, the AUC will also depend on the censoring distribution, leading to either over- or under-estimation of the risk score's predictive performance. We propose the use of censoring-robust estimators to remove the dependence on the censoring distribution and provide empirical results supporting the use of censoring-robust risk scores.
| S-EPMC8671363 | biostudies-literature
Project description:The matched case-control design is frequently used in the study of complex disorders and can result in significant gains in efficiency, especially in the context of measuring biomarkers; however, risk prediction in this setting is not straightforward. We propose an inverse-probability weighting approach to estimate the predictive ability associated with a set of covariates. In particular, we propose an algorithm for estimating the summary index, area under the curve corresponding to the Receiver Operating Characteristic curve associated with a set of pre-defined covariates for predicting a binary outcome. By combining data from the parent cohort with that generated in a matched case control study, we describe methods for estimation of the population parameters of interest and the corresponding area under the curve. We evaluate the bias associated with the proposed methods in simulations by considering a range of parameter settings. We illustrate the methods in two data applications: (1) a prospective cohort study of cardiovascular disease in women, the Women's Health Study, and (2) a matched case-control study nested within the Nurses' Health Study aimed at risk prediction of invasive breast cancer.
| S-EPMC6768691 | biostudies-literature
Project description:Receiver operating characteristic analysis provides an important methodology for assessing traditional (e.g., imaging technologies and clinical practices) and new (e.g., genomic studies, biomarker development) diagnostic problems. The area under the clinically/practically relevant part of the receiver operating characteristic curve (partial area or partial area under the receiver operating characteristic curve) is an important performance index summarizing diagnostic accuracy at multiple operating points (decision thresholds) that are relevant to actual clinical practice. A robust estimate of the partial area under the receiver operating characteristic curve is provided by the area under the corresponding part of the empirical receiver operating characteristic curve. We derive a closed-form expression for the jackknife variance of the partial area under the empirical receiver operating characteristic curve. Using the derived analytical expression, we investigate the differences between the jackknife variance and a conventional variance estimator. The relative properties in finite samples are demonstrated in a simulation study. The developed formula enables an easy way to estimate the variance of the empirical partial area under the receiver operating characteristic curve, thereby substantially reducing the computation burden, and provides important insight into the structure of the variability. We demonstrate that when compared with the conventional approach, the jackknife variance has substantially smaller bias, and leads to a more appropriate type I error rate of the Wald-type test. The use of the jackknife variance is illustrated in the analysis of a data set from a diagnostic imaging study.
| S-EPMC5133195 | biostudies-literature
Project description:Current ongoing genome-wide association (GWA) studies represent a powerful approach to uncover common unknown genetic variants causing common complex diseases. The discovery of these genetic variants offers an important opportunity for early disease prediction, prevention, and individualized treatment. We describe here a method of combining multiple genetic variants for early disease prediction, based on the optimality theory of the likelihood ratio (LR). Such theory simply shows that the receiver operating characteristic (ROC) curve based on the LR has maximum performance at each cutoff point and that the area under the ROC curve so obtained is highest among that of all approaches. Through simulations and a real data application, we compared it with the commonly used logistic regression and classification tree approaches. The three approaches show similar performance if we know the underlying disease model. However, for most common diseases we have little prior knowledge of the disease model and in this situation the new method has an advantage over logistic regression and classification tree approaches. We applied the new method to the type 1 diabetes GWA data from the Wellcome Trust Case Control Consortium. Based on five single nucleotide polymorphisms, the test reaches medium level classification accuracy. With more genetic findings to be discovered in the future, we believe a predictive genetic test for type 1 diabetes can be successfully constructed and eventually implemented for clinical use.
| S-EPMC3039874 | biostudies-literature
Project description:Disorders of self-regulatory behavior are common reasons for referral to child and adolescent clinicians. Here, the authors sought to compare 2 methods of empirically based assessment of children with problems in self-regulatory behavior. Using parental reports on 2,028 children (53% boys) from a U.S. national probability sample of the Child Behavior Checklist (CBCL; T. M. Achenbach & L. A. Rescorla, 2001), the receiver operating characteristic curve analysis was applied to compare scores on the Posttraumatic Stress Problems Scale (PTSP) of the CBCL with the CBCL Dysregulation Profile (DP), identified using latent class analysis of the Attention Problems, Aggressive Behavior, and Anxious/Depressed scales of the CBCL. The CBCL-PTSP score demonstrated an area under the curve of between .88 and .91 for predicting membership in the CBCL-DP profile for boys and for girls. These findings suggest that the CBCL-PTSP, which others have shown does not uniquely identify children who have been traumatized, does identify the same profile of behavior as the CBCL-DP. Therefore, the authors recommend renaming the CBCL-PTSP the Dysregulation Short Scale and provide some guidelines for the use of the CBCL-DP scale and the CBCL-PTSP in clinical practice.
| S-EPMC2936710 | biostudies-literature
Project description:This study investigates the heterogeneity of a biomarker's discriminative performance for predicting subsequent time-to-event outcomes across different patient subgroups. While the area under the curve (AUC) for the time-dependent receiver operating characteristic curve is commonly used to assess biomarker performance, the partial time-dependent AUC (PAUC) provides insights that are often more pertinent for population screening and diagnostic testing. To achieve this objective, we propose a regression model tailored for PAUC and develop two distinct estimation procedures for discrete and continuous covariates, employing a pseudo-partial likelihood method. Simulation studies are conducted to assess the performance of these procedures across various scenarios. We apply our model and inference procedure to the Alzheimer's Disease Neuroimaging Initiative data set to evaluate potential heterogeneities in the discriminative performance of biomarkers for early Alzheimer's disease diagnosis based on patients' characteristics.
| S-EPMC11449645 | biostudies-literature
Project description:The Alcohol Use Disorders Identification Test (AUDIT) is the gold standard screening measure. Recently, there has been increasing call to update the measure to reflect harmful drinking standards in the United States. The purpose of this study was to use receiver operating characteristic curve analysis to evaluate the AUDIT and the United States version (AUDIT-US). Participants were 382 traditional age (M = 20.2, SD = 1.5) college students (68.7% female, 64.9% White) who had consumed alcohol at least once in the 30 days prior to participating. Although results provide evidence for the AUDIT and the AUDIT-US as valid screening tools, the Consumption subscale of the AUDIT-US performed the best in predicting at-risk college drinkers. The Consumption subscale of the AUDIT-US with a single cutoff score of four appears to be the optimal and most parsimonious method of identifying at-risk college drinkers.
| S-EPMC7163156 | biostudies-literature
Project description:Convergence insufficiency (CI) is a dysfunction of binocular vision that is associated with various signs and symptoms in near work. However, CI screening is performed less frequently in adults than in children. We aimed to evaluate the ability of screening tests to discriminate CI from other binocular vision anomalies and normal binocular vision in young adults. One hundred eighty-four university students (age, 18-28 years) who underwent an eye examination due to ocular discomfort were included. Near point of convergence (NPC), phoria, accommodative amplitude, fusional vergence, the ratio of accommodative convergence to accommodation, relative accommodation, binocular accommodative facility, vergence facility, and the values corresponding to Sheard's and Percival's criteria were evaluated. Receiver operating characteristic (ROC) curve analysis for each test was also performed. The prevalence of CI ranged from 10.3% to 21.2%, depending on the signs and the presence of CI associated with accommodative disorders. Assessments based on NPC, Sheard's criterion, and Percival's criterion showed high discriminative ability, with the ability being higher between the CI and normal binocular vision groups than between the CI and non-CI groups. Sheard's criterion showed the highest diagnostic performance in discriminating CI with three signs from the non-CI group. The cut-off values were 7.2 cm for NPC, -0.23 to 1.00 for Sheard's criterion, and -4.00 to -2.33 for Percival's criterion. Our results suggest that the use of Sheard's criterion with NPC shows high performance for screening of CI.
| S-EPMC6980576 | biostudies-literature
Project description:Binary test outcomes typically result from dichotomizing a continuous test variable, observable or latent. The effect of the threshold for test positivity on test sensitivity and specificity has been studied extensively in receiver operating characteristic (ROC) analysis. However, considerably less attention has been given to the study of the effect of the positivity threshold on the predictive value of a test. In this paper we present methods for the joint study of the positive (PPV) and negative predictive values (NPV) of diagnostic tests. We define the predictive receiver operating characteristic (PROC) curve that consists of all possible pairs of PPV and NPV as the threshold for test positivity varies. Unlike the simple trade-off between sensitivity and specificity exhibited in the ROC curve, the PROC curve displays what is often a complex interplay between PPV and NPV as the positivity threshold changes. We study the monotonicity and other geometric properties of the PROC curve and propose summary measures for the predictive performance of tests. We also formulate and discuss regression models for the estimation of the effects of covariates.
| S-EPMC3227148 | biostudies-literature