Dataset Information

Combining K-72 Hepatic Failure with 15 Individual T-Codes to Identify Patients with Idiosyncratic Drug-Induced Liver Injury in the Electronic Medical Record.

ABSTRACT:

Background

The aim of this study was to determine the utility of combining three K72 codes (hepatic failure) with 15 individual T-Codes (drug toxicity/poisoning) to identify potential DILI cases.

Methods

The EMR was searched for encounters that had a K72 code combined with a T-code that also met minimal liver injury laboratory criteria between 10/1/15 and 9/30/18. After manual chart review, a DILIN expert opinion causality score (1-5) was assigned to each case.

Results

Among the 345 patient encounters identified, mean age was 57 years, 53% were male, and 89% Caucasian. Thirty-seven cases (10.7%) were adjudicated as probable DILI with antibiotics being the most frequently identified suspect drugs. Of the 308 non-DILI cases, liver injury was most commonly due to congestive hepatopathy (38%) and hepatic metastases (15%). The probable-DILI cases were significantly more likely to have hepatocellular liver injury (57% vs 32.5%, p = 0.01), higher total bilirubin levels (7.7 vs 4.6 mg/dl, p = 0.03), and more severe liver injury scores (p < 0.01). The K72.0 (acute/ subacute hepatic failure) yielded the most DILI cases (29) compared to K72.9 (13) and K72.1 (0). The positive predictive value of the searching algorithm was 10.7% and improved to 15% when using only the K72.0 codes.

Conclusions

K72 codes combined with drug poisoning T-codes had a low positive predictive value in identifying patients with idiosyncratic DILI. These data support further refinement of ICD-10-based algorithms to detect DILI cases in the EMR.

SUBMITTER: Louissaint J

PROVIDER: S-EPMC10440971 | biostudies-literature | 2022 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Combining K-72 Hepatic Failure with 15 Individual T-Codes to Identify Patients with Idiosyncratic Drug-Induced Liver Injury in the Electronic Medical Record.

Louissaint Jeremy J Kassab Ihab I Yeboah-Korang Amoah A Fontana Robert J RJ

Digestive diseases and sciences 20210824 8

<h4>Background</h4>The aim of this study was to determine the utility of combining three K72 codes (hepatic failure) with 15 individual T-Codes (drug toxicity/poisoning) to identify potential DILI cases.<h4>Methods</h4>The EMR was searched for encounters that had a K72 code combined with a T-code that also met minimal liver injury laboratory criteria between 10/1/15 and 9/30/18. After manual chart review, a DILIN expert opinion causality score (1-5) was assigned to each case.<h4>Results</h4>Amon ...[more]

PMID: 34427818

Similar Datasets

Project description:BackgroundThe use of real-world data to generate evidence requires careful assessment and validation of critical variables before drawing clinical conclusions. Prospective clinical trial data suggest that anatomic origin of colon cancer impacts prognosis and treatment effectiveness. As an initial step in validating this observation in routine clinical settings, we explored the feasibility and accuracy of obtaining information on tumor sidedness from electronic health records (EHR) billing codes.MethodsNine thousand four hundred three patients with metastatic colorectal cancer (mCRC) were selected from the Flatiron Health database, which is derived from de-identified EHR data. This study included a random sample of 200 mCRC patients. Tumor site data derived from International Classification of Diseases (ICD) codes were compared with data abstracted from unstructured documents in the EHR (e.g. surgical and pathology notes). Concordance was determined via observed agreement and Cohen's kappa coefficient (κ). Accuracy of ICD codes for each tumor site (left, right, transverse) was determined by calculating the sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV), and corresponding 95% confidence intervals, using abstracted data as the gold standard.ResultsStudy patients had similar characteristics and side of colon distribution compared with the full mCRC dataset. The observed agreement between the ICD codes and abstracted data for tumor site for all sampled patients was 0.58 (κ = 0.41). When restricting to the 62% of patients with a side-specific ICD code, the observed agreement was 0.84 (κ = 0.79). The specificity (92-98%) of structured data for tumor location was high, with lower sensitivity (49-63%), PPV (64-92%) and NPV (72-97%). Demographic and clinical characteristics were similar between patients with specific and non-specific side of colon ICD codes.ConclusionsICD codes are a highly reliable indicator of tumor location when the specific location code is entered in the EHR. However, non-specific side of colon ICD codes are present for a sizable minority of patients, and structured data alone may not be adequate to support testing of some research hypotheses. Careful assessment of key variables is required before determining the need for clinical abstraction to supplement structured data in generating real-world evidence from EHRs.

Project description:BackgroundPrior suicide attempts are a relatively strong risk factor for future suicide attempts. There is growing interest in using longitudinal electronic health record (EHR) data to derive statistical risk prediction models for future suicide attempts and other suicidal behavior outcomes. However, model performance may be inflated by a largely unrecognized form of "data leakage" during model training: diagnostic codes for suicide attempt outcomes may refer to prior attempts that are also included in the model as predictors.ObjectiveWe aimed to develop an automated rule for determining when documented suicide attempt diagnostic codes identify distinct suicide attempt events.MethodsFrom a large health care system's EHR, we randomly sampled suicide attempt codes for 300 patients with at least one pair of suicide attempt codes documented at least one but no more than 90 days apart. Supervised chart reviewers assigned the clinical settings (ie, emergency department [ED] versus non-ED), methods of suicide attempt, and intercode interval (number of days). The probability (or positive predictive value) that the second suicide attempt code in a given pair of codes referred to a distinct suicide attempt event from its preceding suicide attempt code was calculated by clinical setting, method, and intercode interval.ResultsOf 1015 code pairs reviewed, 835 (82.3%) were nonindependent (ie, the 2 codes referred to the same suicide attempt event). When the second code in a pair was documented in a clinical setting other than the ED, it represented a distinct suicide attempt 3.3% of the time. The more time elapsed between codes, the more likely the second code in a pair referred to a distinct suicide attempt event from its preceding code. Code pairs in which the second suicide attempt code was assigned in an ED at least 5 days after its preceding suicide attempt code had a positive predictive value of 0.90.ConclusionsEHR-based suicide risk prediction models that include International Classification of Diseases codes for prior suicide attempts as a predictor may be highly susceptible to bias due to data leakage in model training. We derived a simple rule to distinguish codes that reflect new, independent suicide attempts: suicide attempt codes documented in an ED setting at least 5 days after a preceding suicide attempt code can be confidently treated as new events in EHR-based suicide risk prediction models. This rule has the potential to minimize upward bias in model performance when prior suicide attempts are included as predictors in EHR-based suicide risk prediction models.

Project description:BACKGROUND:Accurate anesthesiology procedure code data are essential to quality improvement, research, and reimbursement tasks within anesthesiology practices. Advanced data science techniques, including machine learning and natural language processing, offer opportunities to develop classification tools for Current Procedural Terminology codes across anesthesia procedures. METHODS:Models were created using a Train/Test dataset including 1,164,343 procedures from 16 academic and private hospitals. Five supervised machine learning models were created to classify anesthesiology Current Procedural Terminology codes, with accuracy defined as first choice classification matching the institutional-assigned code existing in the perioperative database. The two best performing models were further refined and tested on a Holdout dataset from a single institution distinct from Train/Test. A tunable confidence parameter was created to identify cases for which models were highly accurate, with the goal of at least 95% accuracy, above the reported 2018 Centers for Medicare and Medicaid Services (Baltimore, Maryland) fee-for-service accuracy. Actual submitted claim data from billing specialists were used as a reference standard. RESULTS:Support vector machine and neural network label-embedding attentive models were the best performing models, respectively, demonstrating overall accuracies of 87.9% and 84.2% (single best code), and 96.8% and 94.0% (within top three). Classification accuracy was 96.4% in 47.0% of cases using support vector machine and 94.4% in 62.2% of cases using label-embedding attentive model within the Train/Test dataset. In the Holdout dataset, respective classification accuracies were 93.1% in 58.0% of cases and 95.0% among 62.0%. The most important feature in model training was procedure text. CONCLUSIONS:Through application of machine learning and natural language processing techniques, highly accurate real-time models were created for anesthesiology Current Procedural Terminology code classification. The increased processing speed and a priori targeted accuracy of this classification approach may provide performance optimization and cost reduction for quality improvement, research, and reimbursement tasks reliant on anesthesiology procedure codes.

Project description:ObjectiveTo evaluate the phenotyping performance of three major electronic health record (EHR) components: International Classification of Disease (ICD) diagnosis codes, primary notes, and specific medications.Materials and methodsWe conducted the evaluation using de-identified Vanderbilt EHR data. We preselected ten diseases: atrial fibrillation, Alzheimer's disease, breast cancer, gout, human immunodeficiency virus infection, multiple sclerosis, Parkinson's disease, rheumatoid arthritis, and types 1 and 2 diabetes mellitus. For each disease, patients were classified into seven categories based on the presence of evidence in diagnosis codes, primary notes, and specific medications. Twenty-five patients per disease category (a total number of 175 patients for each disease, 1750 patients for all ten diseases) were randomly selected for manual chart review. Review results were used to estimate the positive predictive value (PPV), sensitivity, andF-score for each EHR component alone and in combination.ResultsThe PPVs of single components were inconsistent and inadequate for accurately phenotyping (0.06-0.71). Using two or more ICD codes improved the average PPV to 0.84. We observed a more stable and higher accuracy when using at least two components (mean ± standard deviation: 0.91 ± 0.08). Primary notes offered the best sensitivity (0.77). The sensitivity of ICD codes was 0.67. Again, two or more components provided a reasonably high and stable sensitivity (0.59 ± 0.16). Overall, the best performance (Fscore: 0.70 ± 0.12) was achieved by using two or more components. Although the overall performance of using ICD codes (0.67 ± 0.14) was only slightly lower than using two or more components, its PPV (0.71 ± 0.13) is substantially worse (0.91 ± 0.08).ConclusionMultiple EHR components provide a more consistent and higher performance than a single one for the selected phenotypes. We suggest considering multiple EHR components for future phenotyping design in order to obtain an ideal result.

Dataset Information

Combining K-72 Hepatic Failure with 15 Individual T-Codes to Identify Patients with Idiosyncratic Drug-Induced Liver Injury in the Electronic Medical Record.

Background

Methods

Results

Conclusions

Publications

Combining K-72 Hepatic Failure with 15 Individual T-Codes to Identify Patients with Idiosyncratic Drug-Induced Liver Injury in the Electronic Medical Record.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets