Elastic integrative analysis of randomised trial and real-world data for treatment heterogeneity estimation.
Ontology highlight
ABSTRACT:
SUBMITTER: Yang S
PROVIDER: S-EPMC10376438 | biostudies-literature | 2023 Jul
REPOSITORIES: biostudies-literature
Publications
Elastic integrative analysis of randomised trial and real-world data for treatment heterogeneity estimation.
Yang Shu S Gao Chenyin C Zeng Donglin D Wang Xiaofei X
Journal of the Royal Statistical Society. Series B, Statistical methodology 20230406 3
We propose a test-based elastic integrative analysis of the randomised trial and real-world data to estimate treatment effect heterogeneity with a vector of known effect modifiers. When the real-world data are not subject to bias, our approach combines the trial and real-world data for efficient estimation. Utilising the trial design, we construct a test to decide whether or not to use real-world data. We characterise the asymptotic distribution of the test-based estimator under local alternativ ...[more]
Similar Datasets
Project description:Increasing availability of real-world data (RWD) generated from patient care enables the generation of evidence to inform clinical decisions for subpopulations of patients and perhaps even individuals. There is growing opportunity to identify important heterogeneity of treatment effects (HTE) in these subgroups. Thus, HTE is relevant to all with interest in patients' responses to interventions, including regulators who must make decisions about products when signals of harms arise postapproval and payers who make coverage decisions based on expected net benefit to their beneficiaries. Prior work discussed HTE in randomized studies. Here, we address methodological considerations when investigating HTE in observational studies. We propose 4 primary goals of HTE analyses and the corresponding approaches in the context of RWD: to confirm subgroup effects, to describe the magnitude of HTE, to discover clinically important subgroups, and to predict individual effects. We discuss other possible goals including exploring prognostic score- and propensity score-based treatment effects, and testing the transportability of trial results to populations different from trial participants. Finally, we outline methodological needs for enhancing real-world HTE analysis.
| S-EPMC10273137 | biostudies-literature
Project description:Reference intervals are essential for the interpretation of laboratory test results in medicine. We propose a novel indirect approach to estimate reference intervals from real-world data as an alternative to direct methods, which require samples from healthy individuals. The presented refineR algorithm separates the non-pathological distribution from the pathological distribution of observed test results using an inverse approach and identifies the model that best explains the non-pathological distribution. To evaluate its performance, we simulated test results from six common laboratory analytes with a varying location and fraction of pathological test results. Estimated reference intervals were compared to the ground truth, an alternative indirect method (kosmic), and the direct method (N = 120 and N = 400 samples). Overall, refineR achieved the lowest mean percentage error of all methods (2.77%). Analyzing the amount of reference intervals within ± 1 total error deviation from the ground truth, refineR (82.5%) was inferior to the direct method with N = 400 samples (90.1%), but outperformed kosmic (70.8%) and the direct method with N = 120 (67.4%). Additionally, reference intervals estimated from pediatric data were comparable to published direct method studies. In conclusion, the refineR algorithm enables precise estimation of reference intervals from real-world data and represents a viable complement to the direct method.
| S-EPMC8346497 | biostudies-literature
Project description:Evidence to support clinical decision making must be based on safety data that have been captured, analysed and interpreted in a robust and reliable way. Randomised real-world evidence (RRWE) studies provide the opportunity to evaluate the use of medicines in patients and settings representative of routine clinical practice. However, elements that underpin the design of RRWE studies can have a significant impact upon the analysis, interpretation and implications of safety data. In this narrative review, we use data from the Salford Lung Study; two prospective, 12-month, open-label, parallel-group, phase III randomised controlled trials conducted in primary care in the UK; to highlight the importance of capturing treatment modifications when attempting to evaluate safety events according to actual treatment exposure. We demonstrate that analysing safety data by actual treatment received (i.e. accounting for the treatment modifications that occur routinely in the primary care setting) provides additional insight beyond analysing according to randomised treatment strategy only. It is therefore proposed that understanding of safety data from RRWE trials can be optimised by analysing both by randomised group and by actual treatment received.
| S-EPMC8165374 | biostudies-literature
Project description:The present study aimed to investigate temporal trends in treatment patterns and prognostic factors for overall survival (OS) among patients with metastatic pancreatic cancer. From the Tokushukai REAl-world Data project, 1,093 patients with metastatic pancreatic cancer treated with gemcitabine, tegafur/gimeracil/oteracil (S-1), gemcitabine plus S-1, gemcitabine plus nab-paclitaxel, or fluorouracil, folic acid, oxaliplatin and irinotecan (FOLFIRINOX) between April 2010 and March 2020 were identified. Stratified/conventional Cox regression analyses were conducted to examine associations between patient- and tumor-related factors, study period, hospital volume, hospital type and first-line chemotherapy regimens. Overall, 846 patients were selected (503 male patients; median age, 70 years) after excluding ineligible patients. Over a median follow-up of 5.4 months, the median OS was 6.8 months (95% confidence interval, 6.3-7.4). The median OS for gemcitabine, S-1, gemcitabine plus S-1, gemcitabine plus nab-paclitaxel and FOLFIRINOX regimens was 5.9, 5.3, 7.7, 9.0 and 9.5 months, respectively. The median OS for 2010-2013, 2014-2017 and 2017-2020 was 6.2, 7.1 and 7.8 months, respectively. Performance status, body mass index and first-line chemotherapy regimens were identified to be significant prognostic factors. In summary, the real-world data indicated that standard care, including chemotherapy, for metastatic pancreatic cancer was widely used in hospitals throughout Japan and verified the survival benefits of gemcitabine plus nab-paclitaxel and FOLFIRINOX observed in prior clinical trials. This trial has been registered in the University Hospital Medical Information Network Clinical Trials Registry as UMIN000050590 on April 1, 2023.
| S-EPMC10636700 | biostudies-literature
Project description:Different computational approaches are employed to efficiently identify novel repositioning possibilities utilizing different sources of information and algorithms. It is critical to propose high-valued candidate-repositioning possibilities before conducting lengthy in vivo validation studies that consume significant resources. Here we report a novel multi-methodological approach to identify opportunities for drug repositioning. We performed analyses of real-world data (RWD) acquired from the United States Food and Drug Administration's Adverse Event Reporting System (FAERS) and the claims database maintained by the Japan Medical Data Center (JMDC). These analyses were followed by cross-validation through bioinformatics analyses of gene expression data. Inverse associations revealed using disproportionality analysis (DPA) and sequence symmetry analysis (SSA) were used to detect potential drug-repositioning signals. To evaluate the validity of the approach, we conducted a feasibility study to identify marketed drugs with the potential for treating inflammatory bowel disease (IBD). Primary analyses of the FAERS and JMDC claims databases identified psycholeptics such as haloperidol, diazepam, and hydroxyzine as candidates that may improve the treatment of IBD. To further investigate the mechanistic relevance between hit compounds and disease pathology, we conducted bioinformatics analyses of the associations of the gene expression profiles of these compounds with disease. We identified common biological features among genes differentially expressed with or without compound treatment as well as disease-perturbation data available from open sources, which strengthened the mechanistic rationale of our initial findings. We further identified pathways such as cytokine signaling that are influenced by these drugs. These pathways are relevant to pathologies and can serve as alternative targets of therapy. Integrative analysis of RWD such as those available from adverse-event databases, claims databases, and transcriptome analyses represent an effective approach that adds value to efficiently identifying potential novel therapeutic opportunities.
| S-EPMC6177143 | biostudies-literature
Project description:Reference intervals are essential for interpreting laboratory test results. Continuous reference intervals precisely capture physiological age-specific dynamics that occur throughout life, and thus have the potential to improve clinical decision-making. However, established approaches for estimating continuous reference intervals require samples from healthy individuals, and are therefore substantially restricted. Indirect methods operating on routine measurements enable the estimation of one-dimensional reference intervals, however, no automated approach exists that integrates the dependency on a continuous covariate like age. We propose an integrated pipeline for the fully automated estimation of continuous reference intervals expressed as a generalized additive model for location, scale and shape based on discrete model estimates using an indirect method (refineR). The results are free of subjective user-input, enable conversion of test results into z-scores and can be integrated into laboratory information systems. Comparison of our results to established and validated reference intervals from the CALIPER and PEDREF studies and manufacturers' package inserts shows good agreement of reference limits, indicating that the proposed pipeline generates high-quality results. In conclusion, the developed pipeline enables the generation of high-precision percentile charts and continuous reference intervals. It represents the first parameter-less and fully automated solution for the indirect estimation of continuous reference intervals.
| S-EPMC10439150 | biostudies-literature
Project description:ImportanceAlthough randomized clinical trials are considered to be the criterion standard for generating clinical evidence, the use of real-world evidence to evaluate the efficacy and safety of medical interventions is gaining interest. Whether observational data can be used to address the same clinical questions being answered by traditional clinical trials is still unclear.ObjectiveTo identify the number of clinical trials published in high-impact journals in 2017 that could be feasibly replicated using observational data from insurance claims and/or electronic health records (EHRs).Design, setting, and participantsIn this cross-sectional analysis, PubMed was searched to identify all US-based clinical trials, regardless of randomization, published between January 1, 2017, and December 31, 2017, in the top 7 highest-impact general medical journals of 2017. Trials were excluded if they did not involve human participants, did not use end points that represented clinical outcomes among patients, were not characterized as clinical trials, and had no recruitment sites in the United States.Main outcomes and measuresThe primary outcomes were the number and percentage of trials for which the intervention, indication, trial inclusion and exclusion criteria, and primary end points could be ascertained from insurance claims and/or EHR data.ResultsOf the 220 US-based trials analyzed, 33 (15.0%) could be replicated using observational data because their intervention, indication, inclusion and exclusion criteria, and primary end points could be routinely ascertained from insurance claims and/or EHR data. Of the 220 trials, 86 (39.1%) had an intervention that could be ascertained from insurance claims and/or EHR data. Among the 86 trials, 62 (72.1%) had an indication that could be ascertained. Forty-five (72.6%) of 62 trials had at least 80% of inclusion and exclusion criteria data that could be ascertained. Of these 45 studies, 33 (73.3%) had at least 1 primary end point that could be ascertained.Conclusions and relevanceThis study found that only 15% of the US-based clinical trials published in high-impact journals in 2017 could be feasibly replicated through analysis of administrative claims or EHR data. This finding suggests the potential for real-world evidence to complement clinical trials, both by examining the concordance between randomized experiments and observational studies and by comparing the generalizability of the trial population with the real-world population of interest.
| S-EPMC6802419 | biostudies-literature
Project description:Hemophilia B is a bleeding disorder caused by a deficiency of coagulation factor IX (FIX). Treatment with FIX replacement products can increase FIX activity levels to minimize or prevent bleeding events. However, frequent dosing with standard-acting FIX products can create a high treatment burden. Long-acting products have been developed to maintain bleed protection with extended dosing intervals. Recombinant factor IX-albumin fusion protein (rIX-FP) is a long-acting product indicated for the treatment and prophylaxis of bleeding events and perioperative management in adult and pediatric patients. This review outlines data from all previously treated patients in the Prophylaxis and On-Demand Treatment using Longer Half-Life rIX-FP (PROLONG-9FP) clinical trial program and summarizes real-world data evaluating the use of rIX-FP in routine clinical practice. In the PROLONG-9FP program, rIX-FP demonstrated effective hemostasis in all patients at dose regimens of up to 21 days in patients aged ≥ 18 years and up to 14 days in patients aged < 12 years. rIX-FP has a favorable pharmacokinetic profile and an excellent safety and tolerability profile. Extended dosing intervals with rIX-FP led to high levels of adherence and reduced consumption compared with other FIX therapies. Data from real-world practice are encouraging and reflect the results of the clinical trials.
| S-EPMC8875492 | biostudies-literature
Project description: Not available
| S-EPMC11847083 | biostudies-literature
Project description:BackgroundNovel precision medicine therapeutics target increasingly granular, genomically-defined populations. Rare sub-groups make it challenging to study within a clinical trial or single real-world data (RWD) source; therefore, pooling from disparate sources of RWD may be required for feasibility. Heterogeneity assessment for pooled data is particularly complex when contrasting a pooled real-world comparator cohort (rwCC) with a single-arm clinical trial (SAT), because the individual comparisons are not independent as all compare a rwCC to the same SAT. Our objective was to develop a methodological framework for pooling RWD focused on the rwCC use case, and simulate novel approaches of heterogeneity assessment, especially for small datasets.MethodsWe present a framework with the following steps: pre-specification, assessment of dataset eligibility, and outcome analyses (including assessment of outcome heterogeneity). We then simulated heterogeneity assessments for a binary response outcome in a SAT compared to two rwCCs, using standard methods for meta-analysis, and an Adjusted Cochran's Q test, and directly comparing the individual participant data (IPD) from the rwCCs.ResultsWe found identical power to detect a true difference for the adjusted Cochran's Q test and the IPD method, with both approaches superior to a standard Cochran's Q test. When assessing the impact of heterogeneity in the null scenario of no difference between the SAT and rwCCs, a lack of statistical power led to Type 1 error inflation. Similarly, in the alternative scenario of a true difference between SAT and rwCCs, we found substantial Type 2 error, with underpowered heterogeneity testing leading to underestimation of the treatment effect.ConclusionsWe developed a methodological framework for pooling RWD sources in the context of designing a rwCC for a SAT. When testing for heterogeneity during this process, the adjusted Cochran's Q test matches the statistical power of IPD heterogeneity testing. Limitations of quantitative heterogeneity testing in protecting against Type 1 or Type 2 error indicate these tests are best used descriptively, and after careful selection of datasets based on clinical/data considerations. We hope these findings will facilitate the rigorous pooling of RWD to unlock insights to benefit oncology patients.
| S-EPMC10464044 | biostudies-literature