Biomarker Discovery and Validation: Statistical Considerations.
Ontology highlight
ABSTRACT:
SUBMITTER: Ou FS
PROVIDER: S-EPMC8012218 | biostudies-literature | 2021 Apr
REPOSITORIES: biostudies-literature
Publications
Biomarker Discovery and Validation: Statistical Considerations.
Ou Fang-Shu FS Michiels Stefan S Shyr Yu Y Adjei Alex A AA Oberg Ann L AL
Journal of thoracic oncology : official publication of the International Association for the Study of Lung Cancer 20210202 4
Biomarkers have various applications including disease detection, diagnosis, prognosis, prediction of response to intervention, and disease monitoring. In this era of precision medicine, having validated biomarkers to inform clinical decision making is more important than ever. In this article, we discuss best the practices and potential issues in biomarker discovery and validation. We encourage team science partnerships to bring cutting-edge discovery from bench to bedside, leading to improved ...[more]
Similar Datasets
Project description:A mass spectrometry-based plasma biomarker discovery workflow was developed to facilitate biomarker discovery. Plasma from either healthy volunteers or patients with pancreatic cancer was 8-plex iTRAQ labeled, fractionated by 2-dimensional reversed phase chromatography and subjected to MALDI ToF/ToF mass spectrometry. Data were processed using a q-value based statistical approach to maximize protein quantification and identification. Technical (between duplicate samples) and biological variance (between and within individuals) were calculated and power analysis was thereby enabled. An a priori power analysis was carried out using samples from healthy volunteers to define sample sizes required for robust biomarker identification. The result was subsequently validated with a post hoc power analysis using a real clinical setting involving pancreatic cancer patients. This demonstrated that six samples per group (e.g., pre- vs post-treatment) may provide sufficient statistical power for most proteins with changes>2 fold. A reference standard allowed direct comparison of protein expression changes between multiple experiments. Analysis of patient plasma prior to treatment identified 29 proteins with significant changes within individual patient. Changes in Peroxiredoxin II levels were confirmed by Western blot. This q-value based statistical approach in combination with reference standard samples can be applied with confidence in the design and execution of clinical studies for predictive, prognostic, and/or pharmacodynamic biomarker discovery. The power analysis provides information required prior to study initiation.
| S-EPMC3320746 | biostudies-literature
Project description:With the emergence of genomic profiling technologies and selective molecular targeted therapies, biomarkers play an increasingly important role in the clinical management of cancer patients. Single gene/protein or multi-gene "signature"-based assays have been introduced to measure specific molecular pathway deregulations that guide therapeutic decision-making as predictive biomarkers. Genome-based prognostic biomarkers are also available for several cancer types for potential incorporation into clinical prognostic staging systems or practice guidelines. However, there is still a large gap between initial biomarker discovery studies and their clinical translation due to the challenges in the process of cancer biomarker development. In this review we summarize the steps of biomarker development, highlight key issues in successful validation and implementation, and overview representative examples in the oncology field. We also discuss regulatory issues and future perspectives in the era of big data analysis and precision medicine.
| S-EPMC4511498 | biostudies-literature
Project description:The Integrative Analysis of Lung Cancer Etiology and Risk (INTEGRAL) program is an NCI-funded initiative with an objective to develop tools to optimize low-dose CT (LDCT) lung cancer screening. Here, we describe the rationale and design for the Risk Biomarker and Nodule Malignancy projects within INTEGRAL. The overarching goal of these projects is to systematically investigate circulating protein markers to include on a panel for use (i) pre-LDCT, to identify people likely to benefit from screening, and (ii) post-LDCT, to differentiate benign versus malignant nodules. To identify informative proteins, the Risk Biomarker project measured 1161 proteins in a nested-case control study within 2 prospective cohorts (n = 252 lung cancer cases and 252 controls) and replicated associations for a subset of proteins in 4 cohorts (n = 479 cases and 479 controls). Eligible participants had a current or former history of smoking and cases were diagnosed up to 3 years following blood draw. The Nodule Malignancy project measured 1078 proteins among participants with a heavy smoking history within four LDCT screening studies (n = 425 cases diagnosed up to 5 years following blood draw, 430 benign-nodule controls, and 398 nodule-free controls). The INTEGRAL panel will enable absolute quantification of 21 proteins. We will evaluate its performance in the Risk Biomarker project using a case-cohort study including 14 cohorts (n = 1696 cases and 2926 subcohort representatives), and in the Nodule Malignancy project within five LDCT screening studies (n = 675 cases, 680 benign-nodule controls, and 648 nodule-free controls). Future progress to advance lung cancer early detection biomarkers will require carefully designed validation, translational, and comparative studies.
| S-EPMC9835888 | biostudies-literature
Project description:Aim: Amyotrophic lateral sclerosis (ALS) is a heterogeneous neurodegenerative disease with limited therapeutic options. A key factor limiting the development of effective therapeutics is the lack of disease biomarkers. We sought to assess whether biomarkers for diagnosis, prognosis or cohort stratification could be identified by RNA sequencing (RNA-seq) of ALS patient peripheral blood. Methods: Whole blood RNA-seq data were generated for 96 Australian sporadic ALS (sALS) cases and 48 healthy controls (NCBI GEO accession GSE234297). Differences in sALS-control gene expression, transcript usage and predicted leukocyte proportions were assessed, with pathway analysis used to predict the activity state of biological processes. Weighted Gene Co-expression Network Analysis (WGCNA) and machine learning algorithms were applied to search for diagnostic and prognostic gene expression patterns. Unsupervised clustering analysis was employed to determine whether sALS patient subgroups could be detected. Results: 245 differentially expressed genes were identified in sALS patients relative to controls, with enrichment of immune, metabolic and stress related pathways. sALS patients also demonstrated switches in transcript usage across a small set of genes. We established a classification model that distinguished sALS from controls with an accuracy of 78% (sensitivity: 79%, specificity: 75%) using the expression of 20 genes. Clustering analysis identified four patient subgroups with gene expression signatures and immune cell proportions reflective of distinct peripheral effects. Conclusions: Our findings suggest that peripheral blood RNA-seq can identify diagnostic biomarkers and distinguish molecular subtypes of sALS patients however, its prognostic value requires further investigation.
2023-10-12 | GSE234297 | GEO
Project description:Non-invasive techniques to monitor and diagnose neonates, particularly those born prematurely, are a long-sought out goal of Newborn Medicine. In recent years, technical advances, combined with increased assay sensitivity, have permitted the high-throughput analysis of multiple biomarkers simultaneously from a single sample source. Multiplexed transcriptomic and proteomic platforms, along with more comprehensive assays such as RNASeq, allow for interrogation of ongoing physiology and pathology in unprecedented ways. In the fragile neonatal population, saliva is an ideal biofluid to assess clinical status serially and offers many advantages over more invasively obtained blood samples. Importantly, saliva samples are amenable to analysis on emerging proteomic and transcriptomic platforms, even at quantitatively limited volumes. However, biomarker targets are often degraded in human saliva, and as a mixed source biofluid containing both human and microbial targets, saliva presents unique challenges for the investigator. Here, we provide insight into technical considerations and protocol optimizations developed in our laboratory to quantify and discover neonatal salivary biomarkers with improved reproducibility and reliability. We will detail insights learned from years of experimentation on neonatal saliva within our laboratory ranging from salivary collection techniques to processing to downstream analyses, highlighting the need for consistency in approach and a global understanding of both the potential benefits and limitations of neonatal salivary biomarker analyses. Importantly, we will highlight the need for robust and stringent research in this population to provide the field with standardized approaches and workflows to impact neonatal care successfully.
| S-EPMC7870796 | biostudies-literature
Project description:Referral strategies based on risk scores and medical tests are commonly proposed. Direct assessment of their clinical utility requires implementing the strategy and is not possible in the early phases of biomarker research. Prior to late-phase studies, net benefit measures can be used to assess the potential clinical impact of a proposed strategy. Validation studies, in which the biomarker defines a prespecified referral strategy, are a gold standard approach to evaluating biomarker potential. Uncertainty, quantified by a confidence interval, is important to consider when deciding whether a biomarker warrants an impact study, does not demonstrate clinical potential, or that more data are needed. We establish distribution theory for empirical estimators of net benefit and propose empirical estimators of variance. The primary results are for the most commonly employed estimators of net benefit: from cohort and unmatched case-control samples, and for point estimates and net benefit curves. Novel estimators of net benefit under stratified two-phase and categorically matched case-control sampling are proposed and distribution theory developed. Results for common variants of net benefit and for estimation from right-censored outcomes are also presented. We motivate and demonstrate the methodology with examples from lung cancer research and highlight its application to study design.
| S-EPMC7228830 | biostudies-literature
Project description:MotivationMetabolomics is the study of the complement of small molecule metabolites in cells, biofluids and tissues. Many metabolomic experiments are designed to compare changes observed over time under two experimental conditions or groups (e.g. a control and drug-treated group) with the goal of identifying discriminatory metabolites or biomarkers that characterize each condition. A common study design consists of repeated measurements taken on each experimental unit thus producing time courses of all metabolites. We describe a statistical framework for estimating time-varying metabolic profiles and their within-group variability and for detecting between-group differences. Specifically, we propose (i) a smoothing splines mixed effects (SME) model that treats each longitudinal measurement as a smooth function of time and (ii) an associated functional test statistic. Statistical significance is assessed by a non-parametric bootstrap procedure.ResultsThe methodology has been extensively evaluated using simulated data and has been applied to real nuclear magnetic resonance spectroscopy data collected in a preclinical toxicology study as part of a larger project lead by the COMET (Consortium for Metabonomic Toxicology). Our findings are compatible with the previously published studies.AvailabilityAn R script is freely available for download at http://www2.imperial.ac.uk/~gmontana/sme.htm.
| S-EPMC3129523 | biostudies-literature
Project description:Circulating extracellular vesicles (EVs) have gained significant attention for discovering tumor biomarkers. However, isolating EVs with well-defined homogeneous populations from complex biological samples is challenging. Different methods have been found to derive different EV populations carrying different biomolecules, which significantly confound biomarker discovery for developing clinical diagnostics. Building a rigorous EV isolation and standardizing assessment platform associated with -omics is essential to overcome this challenge. We introduced a novel isolation approach using a pH-responsive peptide conjugated with NanoPom magnetic beads (ExCy) for homogeneous EV isolation. Additionally, we introduced the first statistical algorithm for EV quality assessment (ExoQuality Index, EQI), which enables multi-assay quantification to provide a consistent and accurate definition of EV purity and quality; ExoQuality’s algorithm intakes multi-assay information to deconvolute complex EV heterogeneity. We analyzed our next generation sequencing on EV RNAs from pancreatic cancer patient plasma using four isolation methods; results highlighting ExCy’s isolation and EQI assessment improved biomarker identification. We identified a novel EV tumor biomarker, ATP6V0B, validated with Quantitative PCR (qPCR) by screening a pilot cohort of 23 individuals. With random forest modeling the ATP6V0B cycling threshold, we reported an AUC of 0.91, showcasing an enabling and clinically translatable liquid biopsy approach using circulating EVs.
2024-01-31 | GSE246925 | GEO
Project description:BackgroundThe low five-year survival rate of pancreatic ductal adenocarcinoma (PDAC) and the low diagnostic rate of early-stage PDAC via imaging highlight the need to discover novel biomarkers and improve the current screening procedures for early diagnosis. Familial pancreatic cancer (FPC) describes the cases of PDAC that are present in two or more individuals within a circle of first-degree relatives. Using innovative high-throughput proteomics, we were able to quantify the protein profiles of individuals at risk from FPC families in different potential pre-cancer stages. However, the high-dimensional proteomics data structure challenges the use of traditional statistical analysis tools. Hence, we applied advanced statistical learning methods to enhance the analysis and improve the results' interpretability.MethodsWe applied model-based gradient boosting and adaptive lasso to deal with the small, unbalanced study design via simultaneous variable selection and model fitting. In addition, we used stability selection to identify a stable subset of selected biomarkers and, as a result, obtain even more interpretable results. In each step, we compared the performance of the different analytical pipelines and validated our approaches via simulation scenarios.ResultsIn the simulation study, model-based gradient boosting showed a more accurate prediction performance in the small, unbalanced, and high-dimensional datasets than adaptive lasso and could identify more relevant variables. Furthermore, using model-based gradient boosting, we discovered a subset of promising serum biomarkers that may potentially improve the current screening procedure of FPC.ConclusionAdvanced statistical learning methods helped us overcome the shortcomings of an unbalanced study design in a valuable clinical dataset. The discovered serum biomarkers provide us with a clear direction for further investigations and more precise clinical hypotheses regarding the development of FPC and optimal strategies for its early detection.
| S-EPMC9879447 | biostudies-literature
Project description:Interindividual variability in drug efficacy and toxicity is a major challenge in clinical practice. Variations in drug pharmacokinetics (PKs) and pharmacodynamics (PDs) can be, in part, explained by polymorphic variants in genes encoding drug metabolizing enzymes and transporters (absorption, distribution, metabolism, and excretion) or in genes encoding drug receptors. Pharmacogenomics (PGx) has allowed the identification of predictive biomarkers of drug PKs and PDs and the current knowledge of genome-disease and genome-drug interactions offers the opportunity to optimize tailored drug therapy. High-throughput PGx genotyping, from targeted to more comprehensive strategies, allows the identification of PK/PD genotypes to be developed as clinical predictive biomarkers. However, a biomarker needs a robust process of validation followed by clinical-grade assay development and must comply to stringent regulatory guidelines. We here discuss the methodological challenges and the emerging technological tools in PGx biomarker discovery and validation, at the crossroad among molecular genetics, bioinformatics, and clinical medicine.
| S-EPMC7877857 | biostudies-literature