Dataset Information

Identification of delirium from real-world electronic health record clinical notes.

ABSTRACT:

Introduction

We tested the ability of our natural language processing (NLP) algorithm to identify delirium episodes in a large-scale study using real-world clinical notes.

Methods

We used the Rochester Epidemiology Project to identify persons ≥ 65 years who were hospitalized between 2011 and 2017. We identified all persons with an International Classification of Diseases code for delirium within ±14 days of a hospitalization. We independently applied our NLP algorithm to all clinical notes for this same population. We calculated rates using number of delirium episodes as the numerator and number of hospitalizations as the denominator. Rates were estimated overall, by demographic characteristics, and by year of episode, and differences were tested using Poisson regression.

Results

In total, 14,255 persons had 37,554 hospitalizations between 2011 and 2017. The code-based delirium rate was 3.02 per 100 hospitalizations (95% CI: 2.85, 3.20). The NLP-based rate was 7.36 per 100 (95% CI: 7.09, 7.64). Rates increased with age (both p < 0.0001). Code-based rates were higher in men compared to women (p = 0.03), but NLP-based rates were similar by sex (p = 0.89). Code-based rates were similar by race and ethnicity, but NLP-based rates were higher in the White population compared to the Black and Asian populations (p = 0.001). Both types of rates increased significantly over time (both p values < 0.001).

Conclusions

The NLP algorithm identified more delirium episodes compared to the ICD code method. However, NLP may still underestimate delirium cases because of limitations in real-world clinical notes, including incomplete documentation, practice changes over time, and missing clinical notes in some time periods.

SUBMITTER: St Sauver J

PROVIDER: S-EPMC10514685 | biostudies-literature | 2023

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Identification of delirium from real-world electronic health record clinical notes.

St Sauver Jennifer J Fu Sunyang S Sohn Sunghwan S Weston Susan S Fan Chun C Olson Janet J Thorsteinsdottir Bjoerg B LeBrasseur Nathan N Pagali Sandeep S Rocca Walter W Liu Hongfang H

Journal of clinical and translational science 20230824 1

<h4>Introduction</h4>We tested the ability of our natural language processing (NLP) algorithm to identify delirium episodes in a large-scale study using real-world clinical notes.<h4>Methods</h4>We used the Rochester Epidemiology Project to identify persons ≥ 65 years who were hospitalized between 2011 and 2017. We identified all persons with an International Classification of Diseases code for delirium within ±14 days of a hospitalization. We independently applied our NLP algorithm to all clini ...[more]

PMID: 37745932

Similar Datasets

Project description:BackgroundSuicide is an important public health concern in the United States and around the world. There has been significant work examining machine learning approaches to identify and predict intentional self-harm and suicide using existing data sets. With recent advances in computing, deep learning applications in health care are gaining momentum.ObjectiveThis study aimed to leverage the information in clinical notes using deep neural networks (DNNs) to (1) improve the identification of patients treated for intentional self-harm and (2) predict future self-harm events.MethodsWe extracted clinical text notes from electronic health records (EHRs) of 835 patients with International Classification of Diseases (ICD) codes for intentional self-harm and 1670 matched controls who never had any intentional self-harm ICD codes. The data were divided into training and holdout test sets. We tested a number of algorithms on clinical notes associated with the intentional self-harm codes using the training set, including several traditional bag-of-words-based models and 2 DNN models: a convolutional neural network (CNN) and a long short-term memory model. We also evaluated the predictive performance of the DNNs on a subset of patients who had clinical notes 1 to 6 months before the first intentional self-harm event. Finally, we evaluated the impact of a pretrained model using Word2vec (W2V) on performance.ResultsThe area under the receiver operating characteristic curve (AUC) for the CNN on the phenotyping task, that is, the detection of intentional self-harm in clinical notes concurrent with the events was 0.999, with an F1 score of 0.985. In the predictive task, the CNN achieved the highest performance with an AUC of 0.882 and an F1 score of 0.769. Although pretraining with W2V shortened the DNN training time, it did not improve performance.ConclusionsThe strong performance on the first task, namely, phenotyping based on clinical notes, suggests that such models could be used effectively for surveillance of intentional self-harm in clinical text in an EHR. The modest performance on the predictive task notwithstanding, the results using DNN models on clinical text alone are competitive with other reports in the literature using risk factors from structured EHR data.

Project description:The objective of this study is to describe the 2-year real-world clinical outcomes after transition to psychosis in patients at clinical high-risk. The study used the clinical electronic health record cohort study including all patients receiving a first index primary diagnosis of nonorganic International Classification of Diseases (ICD)-10 psychotic disorder within the early psychosis pathway in the South London and Maudsley (SLaM) National Health Service (NHS) Trust from 2001 to 2017. Outcomes encompassed: cumulative probability (at 3, 6, 12, and 24 months) of receiving a first (1) treatment with antipsychotic, (2) informal admission, (3) compulsory admission, and (4) treatment with clozapine and (5) numbers of days spent in hospital (at 12 and 24 months) in patients transitioning to psychosis from clinical high-risk services (Outreach and Support in south London; OASIS) compared to other first-episode groups. Analyses included logistic and 0-inflated negative binomial regressions. In the study, 1561 patients were included; those who had initially been managed by OASIS and had subsequently transitioned to a first episode of psychosis (n = 130) were more likely to receive antipsychotic medication (at 3, 6, and 24 months; all P < .023), to be admitted informally (at all timepoints, all P < .004) and on a compulsory basis (at all timepoints, all P < .013), and to have spent more time in hospital (all timepoints, all P < .007) than first-episode patients who were already psychotic when seen by the OASIS service (n = 310), or presented to early intervention services (n = 1121). The likelihood of receiving clozapine was similar across all groups (at 12/24 months, all P < .101). Transition to psychosis from a clinical high-risk state is associated with severe real-world clinical outcomes. Prevention of transition to psychosis should remain a core target of future research. The study protocol was registered on www.researchregistry.com; researchregistry5039).

Dataset Information

Identification of delirium from real-world electronic health record clinical notes.

Introduction

Methods

Results

Conclusions

Publications

Identification of delirium from real-world electronic health record clinical notes.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets