Dataset Information

Development and Validation of a Nonremission Risk Prediction Model in First-Episode Psychosis: An Analysis of 2 Longitudinal Studies.

ABSTRACT: Psychosis is a major mental illness with first onset in young adults. The prognosis is poor in around half of the people affected, and difficult to predict. The few tools available to predict prognosis have major weaknesses which limit their use in clinical practice. We aimed to develop and validate a risk prediction model of symptom nonremission in first-episode psychosis. Our development cohort consisted of 1027 patients with first-episode psychosis recruited between 2005 and 2010 from 14 early intervention services across the National Health Service in England. Our validation cohort consisted of 399 patients with first-episode psychosis recruited between 2006 and 2009 from a further 11 English early intervention services. The one-year nonremission rate was 52% and 54% in the development and validation cohorts, respectively. Multivariable logistic regression was used to develop a risk prediction model for nonremission, which was externally validated. The prediction model showed good discrimination C-statistic of 0.73 (0.71, 0.75) and adequate calibration with intercept alpha of 0.12 (0.02, 0.22) and slope beta of 0.98 (0.85, 1.11). Our model improved the net-benefit by 15% at a risk threshold of 50% compared to the strategy of treating all, equivalent to 15 more detected nonremitted first-episode psychosis individuals per 100 without incorrectly classifying remitted cases. Once prospectively validated, our first episode psychosis prediction model could help identify patients at increased risk of nonremission at initial clinical contact.

SUBMITTER: Leighton SP

PROVIDER: S-EPMC8458108 | biostudies-literature | 2021 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development and Validation of a Nonremission Risk Prediction Model in First-Episode Psychosis: An Analysis of 2 Longitudinal Studies.

Leighton Samuel P SP Krishnadas Rajeev R Upthegrove Rachel R Marwaha Steven S Steyerberg Ewout W EW Gkoutos Georgios V GV Broome Matthew R MR Liddle Peter F PF Everard Linda L Singh Swaran P SP Freemantle Nicholas N Fowler David D Jones Peter B PB Sharma Vimal V Murray Robin R Wykes Til T Drake Richard J RJ Buchan Iain I Rogers Simon S Cavanagh Jonathan J Lewis Shon W SW Birchwood Max M Mallikarjun Pavan K PK

Schizophrenia bulletin open 20210101 1

Psychosis is a major mental illness with first onset in young adults. The prognosis is poor in around half of the people affected, and difficult to predict. The few tools available to predict prognosis have major weaknesses which limit their use in clinical practice. We aimed to develop and validate a risk prediction model of symptom nonremission in first-episode psychosis. Our development cohort consisted of 1027 patients with first-episode psychosis recruited between 2005 and 2010 from 14 earl ...[more]

PMID: 34568827

Similar Datasets

Project description:ImportanceThere is an absence of mortality risk assessment tools in first-episode psychosis (FEP) that could enable personalized interventions.ObjectiveTo examine the feasibility of machine learning (ML) in discerning mortality risk in FEP and to assess whether such risk predictions can inform pharmacotherapy choices.Design, setting, and participantsIn this prognostic study, Swedish nationwide cohort data (from July 1, 2006, to December 31, 2021) were harnessed for model development and validation. Finnish cohort data (from January 1, 1998, to December 31, 2017) were used for external validation. Data analyses were completed between December 2022 and December 2023.Main outcomes and measuresFifty-one nationwide register variables, encompassing demographics and clinical and work-related histories, were subjected to ML to predict future mortality risk. The ML model's performance was evaluated by calculating the area under the receiver operating characteristic curve (AUROC). The comparative effectiveness of pharmacotherapies in patients was assessed and was stratified by the ML model to those with predicted high mortality risk (vs low risk), using the between-individual hazard ratio (HR). The 5 most important variables were then identified and a model was retrained using these variables in the discovery sample.ResultsThis study included 24 052 Swedish participants (20 000 in the discovery sample and 4052 in the validation sample) and 1490 Finnish participants (in the validation sample). Swedish participants had a mean (SD) age of 29.1 (8.1) years, 62.1% were men, and 418 died with 2 years. Finnish participants had a mean (SD) age of 29.7 (8.0) years, 61.7% were men, and 31 died within 2 years. The discovery sample achieved an AUROC of 0.71 (95% CI, 0.68-0.74) for 2-year mortality prediction. Using the 5 most important variables (ie, the top 10% [substance use comorbidities, first hospitalization duration due to FEP, male sex, prior somatic hospitalizations, and age]), the final model resulted in an AUROC of 0.70 (95% CI, 0.63-0.76) in the Swedish sample and 0.67 (95% CI, 0.56-0.78) in the Finnish sample. Individuals with predicted high mortality risk had an elevated 15-year risk in the Swedish sample (HR, 3.77 [95% CI, 2.92-4.88]) and an elevated 20-year risk in the Finnish sample (HR, 3.72 [95% CI, 2.67-5.18]). For those with predicted high mortality risk, long-acting injectable antipsychotics (HR, 0.45 [95% CI, 0.23-0.88]) and mood stabilizers (HR, 0.64 [95% CI, 0.46-0.90]) were associated with decreased mortality risk. Conversely, for those predicted to survive, only oral aripiprazole (HR, 0.38 [95% CI, 0.20-0.69]) and risperidone (HR, 0.38 [95% CI, 0.18-0.82]) were associated with decreased mortality risk.Conclusions and relevanceIn this prognostic study, an ML-based model was developed and validated to predict mortality risk in FEP. These findings may help to develop personalized interventions to mitigate mortality risk in FEP.

Project description:IntroductionMachine learning models have shown promising potential in individual-level outcome prediction for patients with psychosis, but also have several limitations. To address some of these limitations, we present a model that predicts multiple outcomes, based on longitudinal patient data, while integrating prediction uncertainty to facilitate more reliable clinical decision-making.Material and methodsWe devised a recurrent neural network architecture incorporating long short-term memory (LSTM) units to facilitate outcome prediction by leveraging multimodal baseline variables and clinical data collected at multiple time points. To account for model uncertainty, we employed a novel fuzzy logic approach to integrate the level of uncertainty into individual predictions. We predicted antipsychotic treatment outcomes in 446 first-episode psychosis patients in the OPTiMiSE study, for six different clinical scenarios. The treatment outcome measures assessed at both week 4 and week 10 encompassed symptomatic remission, clinical global remission, and functional remission.ResultsUsing only baseline predictors to predict different outcomes at week 4, leave-one-site-out validation AUC ranged from 0.62 to 0.66; performance improved when clinical data from week 1 was added (AUC = 0.66-0.71). For outcome at week 10, using only baseline variables, the models achieved AUC = 0.56-0.64; using data from more time points (weeks 1, 4, and 6) improved the performance to AUC = 0.72-0.74. After incorporating prediction uncertainties and stratifying the model decisions based on model confidence, we could achieve accuracies above 0.8 for ~50% of patients in five out of the six clinical scenarios.ConclusionWe constructed prediction models utilizing a recurrent neural network architecture tailored to clinical scenarios derived from a time series dataset. One crucial aspect we incorporated was the consideration of uncertainty in individual predictions, which enhances the reliability of decision-making based on the model's output. We provided evidence showcasing the significance of leveraging time series data for achieving more accurate treatment outcome prediction in the field of psychiatry.

Dataset Information

Development and Validation of a Nonremission Risk Prediction Model in First-Episode Psychosis: An Analysis of 2 Longitudinal Studies.

Publications

Development and Validation of a Nonremission Risk Prediction Model in First-Episode Psychosis: An Analysis of 2 Longitudinal Studies.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets