EHR foundation models improve robustness in the presence of temporal distribution shift.
Ontology highlight
ABSTRACT: Temporal distribution shift negatively impacts the performance of clinical prediction models over time. Pretraining foundation models using self-supervised learning on electronic health records (EHR) may be effective in acquiring informative global patterns that can improve the robustness of task-specific models. The objective was to evaluate the utility of EHR foundation models in improving the in-distribution (ID) and out-of-distribution (OOD) performance of clinical prediction models. Transformer- and gated recurrent unit-based foundation models were pretrained on EHR of up to 1.8 M patients (382 M coded events) collected within pre-determined year groups (e.g., 2009-2012) and were subsequently used to construct patient representations for patients admitted to inpatient units. These rep
SUBMITTER: Guo LL
PROVIDER: S-EPMC9992466 | biostudies-literature | 2023 Mar
REPOSITORIES: biostudies-literature
ACCESS DATA