Dataset Information

Machine learning and murine models explain failures of clinical sepsis trials.

ABSTRACT:

Background

Multiple clinical trials failed to demonstrate the efficacy of hydrocortisone, ascorbic acid, and thiamine (HAT) in sepsis. These trials were dominated by patients with pulmonary sepsis and have not accounted for differences in the inflammatory responses across varying etiologies of injury/illness. Hydrocortisone, ascorbic acid, and thiamine have previously revealed tremendous benefits in animal peritonitis sepsis models (cecal ligation and puncture [CLP]) in contradiction to the various clinical trials. The impact of HAT remains unclear in pulmonary sepsis. Our objective was to investigate the impact of HAT in pneumonia, consistent with the predominate etiology in the discordant clinical trials. We hypothesized that, in a pulmonary sepsis model, HAT would act synergistically to reduce end-organ dysfunction by the altering the inflammatory response, in a unique manner compared with CLP.

Methods

Using Pseudomonas aeruginosa pneumonia, a pulmonary sepsis model (pneumonia [PNA]) was compared directly to previously investigated intra-abdominal sepsis models. Machine learning applied to early vital signs stratified animals into those predicted to die (pDie) versus predicted to live (pLive). Animals were then randomized to receive antibiotics and fluids (vehicle [VEH]) vs. HAT). Vitals, cytokines, vitamin C, and markers of liver and kidney function were assessed in the blood, bronchoalveolar lavage, and organ homogenates.

Results

PNA was induced in 119 outbred wild-type Institute of Cancer Research mice (predicted mortality approximately 50%) similar to CLP. In PNA, interleukin 1 receptor antagonist in 72-hour bronchoalveolar lavage was lower with HAT (2.36 ng/mL) compared with VEH (4.88 ng/mL; p = 0.04). The remaining inflammatory cytokines and markers of liver/renal function showed no significant difference with HAT in PNA. PNA vitamin C levels were 0.62 mg/dL (pDie HAT), lower than vitamin C levels after CLP (1.195 mg/dL). Unlike CLP, PNA mice did not develop acute kidney injury (blood urea nitrogen: pDie, 33.5 mg/dL vs. pLive, 27.6 mg/dL; p = 0.17). Furthermore, following PNA, HAT did not significantly reduce microscopic renal oxidative stress (mean gray area: pDie, 16.64 vs. pLive, 6.88; p = 0.93). Unlike CLP where HAT demonstrated a survival benefit, HAT had no impact on survival in PNA.

Conclusion

Hydrocortisone, ascorbic acid, and thiamine therapy has minimal benefits in pneumonia. The inflammatory response induced by pulmonary sepsis is unique compared with the response during intra-abdominal sepsis. Consequently, different etiologies of sepsis respond differently to HAT therapy.

SUBMITTER: Stolarski AE

PROVIDER: S-EPMC9335891 | biostudies-literature | 2022 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Machine learning and murine models explain failures of clinical sepsis trials.

Stolarski Allan E AE Kim Jiyoun J Rop Kevin K Wee Katherine K Zhang Qiuyang Q Remick Daniel G DG

The journal of trauma and acute care surgery 20220520 2

<h4>Background</h4>Multiple clinical trials failed to demonstrate the efficacy of hydrocortisone, ascorbic acid, and thiamine (HAT) in sepsis. These trials were dominated by patients with pulmonary sepsis and have not accounted for differences in the inflammatory responses across varying etiologies of injury/illness. Hydrocortisone, ascorbic acid, and thiamine have previously revealed tremendous benefits in animal peritonitis sepsis models (cecal ligation and puncture [CLP]) in contradiction to ...[more]

PMID: 35881034

Similar Datasets

Project description:IntroductionPatients with sepsis who present to an emergency department (ED) have highly variable underlying disease severity, and can be categorized from low to high risk. Development of a risk stratification tool for these patients is important for appropriate triage and early treatment. The aim of this study was to develop machine learning models predicting 31-day mortality in patients presenting to the ED with sepsis and to compare these to internal medicine physicians and clinical risk scores.MethodsA single-center, retrospective cohort study was conducted amongst 1,344 emergency department patients fulfilling sepsis criteria. Laboratory and clinical data that was available in the first two hours of presentation from these patients were randomly partitioned into a development (n = 1,244) and validation dataset (n = 100). Machine learning models were trained and evaluated on the development dataset and compared to internal medicine physicians and risk scores in the independent validation dataset. The primary outcome was 31-day mortality.ResultsA number of 1,344 patients were included of whom 174 (13.0%) died. Machine learning models trained with laboratory or a combination of laboratory + clinical data achieved an area-under-the ROC curve of 0.82 (95% CI: 0.80-0.84) and 0.84 (95% CI: 0.81-0.87) for predicting 31-day mortality, respectively. In the validation set, models outperformed internal medicine physicians and clinical risk scores in sensitivity (92% vs. 72% vs. 78%;p<0.001,all comparisons) while retaining comparable specificity (78% vs. 74% vs. 72%;p>0.02). The model had higher diagnostic accuracy with an area-under-the-ROC curve of 0.85 (95%CI: 0.78-0.92) compared to abbMEDS (0.63,0.54-0.73), mREMS (0.63,0.54-0.72) and internal medicine physicians (0.74,0.65-0.82).ConclusionMachine learning models outperformed internal medicine physicians and clinical risk scores in predicting 31-day mortality. These models are a promising tool to aid in risk stratification of patients presenting to the ED with sepsis.

Project description:BackgroundData drift can negatively impact the performance of machine learning algorithms (MLAs) that were trained on historical data. As such, MLAs should be continuously monitored and tuned to overcome the systematic changes that occur in the distribution of data. In this paper, we study the extent of data drift and provide insights about its characteristics for sepsis onset prediction. This study will help elucidate the nature of data drift for prediction of sepsis and similar diseases. This may aid with the development of more effective patient monitoring systems that can stratify risk for dynamic disease states in hospitals.MethodsWe devise a series of simulations that measure the effects of data drift in patients with sepsis. We simulate multiple scenarios in which data drift may occur, namely the change in the distribution of the predictor variables (covariate shift), the change in the statistical relationship between the predictors and the target (concept shift), and the occurrence of a major healthcare event (major event) such as the COVID-19 pandemic. We measure the impact of data drift on model performances, identify the circumstances that necessitate model retraining, and compare the effects of different retraining methodologies and model architecture on the outcomes. We present the results for two different MLAs, eXtreme Gradient Boosting (XGB) and Recurrent Neural Network (RNN).ResultsOur results show that the properly retrained XGB models outperform the baseline models in all simulation scenarios, hence signifying the existence of data drift. In the major event scenario, the area under the receiver operating characteristic curve (AUROC) at the end of the simulation period is 0.811 for the baseline XGB model and 0.868 for the retrained XGB model. In the covariate shift scenario, the AUROC at the end of the simulation period for the baseline and retrained XGB models is 0.853 and 0.874 respectively. In the concept shift scenario and under the mixed labeling method, the retrained XGB models perform worse than the baseline model for most simulation steps. However, under the full relabeling method, the AUROC at the end of the simulation period for the baseline and retrained XGB models is 0.852 and 0.877 respectively. The results for the RNN models were mixed, suggesting that retraining based on a fixed network architecture may be inadequate for an RNN. We also present the results in the form of other performance metrics such as the ratio of observed to expected probabilities (calibration) and the normalized rate of positive predictive values (PPV) by prevalence, referred to as lift, at a sensitivity of 0.8.ConclusionOur simulations reveal that retraining periods of a couple of months or using several thousand patients are likely to be adequate to monitor machine learning models that predict sepsis. This indicates that a machine learning system for sepsis prediction will probably need less infrastructure for performance monitoring and retraining compared to other applications in which data drift is more frequent and continuous. Our results also show that in the event of a concept shift, a full overhaul of the sepsis prediction model may be necessary because it indicates a discrete change in the definition of sepsis labels, and mixing the labels for the sake of incremental training may not produce the desired results.

Project description:BackgroundThrombotic microangiopathy-induced thrombocytopenia-associated multiple organ failure and hyperinflammatory macrophage activation syndrome are important causes of late pediatric sepsis mortality that are often missed or have delayed diagnosis. The National Institutes of General Medical Science sepsis research working group recommendations call for application of new research approaches in extant clinical data sets to improve efficiency of early trials of new sepsis therapies. Our objective is to apply machine learning approaches to derive computable 24-h sepsis phenotypes to facilitate personalized enrollment in early anti-inflammatory trials targeting these conditions.MethodsWe applied consensus, k-means clustering analysis to our extant PHENOtyping sepsis-induced Multiple organ failure Study (PHENOMS) dataset of 404 children. 24-hour computable phenotypes are derived using 25 available bedside variables including C-reactive protein and ferritin.ResultsFour computable phenotypes (PedSep-A, B, C, and D) are derived. Compared to all other phenotypes, PedSep-A patients (n = 135; 2% mortality) were younger and previously healthy, with the lowest C-reactive protein and ferritin levels, the highest lymphocyte and platelet counts, highest heart rate, and lowest creatinine (p < 0.05); PedSep-B patients (n = 102; 12% mortality) were most likely to be intubated and had the lowest Glasgow Coma Scale Score (p < 0.05); PedSep-C patients (n = 110; mortality 10%) had the highest temperature and Glasgow Coma Scale Score, least pulmonary failure, and lowest lymphocyte counts (p < 0.05); and PedSep-D patients (n = 56, 34% mortality) had the highest creatinine and number of organ failures, including renal, hepatic, and hematologic organ failure, with the lowest platelet counts (p < 0.05). PedSep-D had the highest likelihood of developing thrombocytopenia-associated multiple organ failure (Adj OR 47.51 95% CI [18.83-136.83], p < 0.0001) and macrophage activation syndrome (Adj OR 38.63 95% CI [13.26-137.75], p < 0.0001).ConclusionsFour computable phenotypes are derived, with PedSep-D being optimal for enrollment in early personalized anti-inflammatory trials targeting thrombocytopenia-associated multiple organ failure and macrophage activation syndrome in pediatric sepsis. A computer tool for identification of individual patient membership ( www.pedsepsis.pitt.edu ) is provided. Reproducibility will be assessed at completion of two ongoing pediatric sepsis studies.

Dataset Information

Machine learning and murine models explain failures of clinical sepsis trials.

Background

Methods

Results

Conclusion

Publications

Machine learning and murine models explain failures of clinical sepsis trials.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets