Using large language models for temporal relation extraction from pediatric clinical reports.

ABSTRACT:

Objectives

To evaluate large language models (LLMs) for extracting temporal relations from pediatric rare disease clinical reports to enable automated patient timeline creation.

Materials and methods

We developed a temporal relation extraction framework for electronic health records, using 25 clinical reports from a pediatric rare disease hospital. We implemented few-shot prompting with 3 different LLMs in secure environments.

Results

Our findings reveal that binary classification significantly outperforms multi-class approaches for temporal relation extraction, with best F1 scores reaching 0.70 for simpler relations while more complex relations remain challenging (F1: 0.03-0.40). Mistral 22B emerged as the strongest overall performer, though model superiority varied

SUBMITTER: Andrew JJ 

PROVIDER: S-EPMC12640238 | biostudies-literature | 2025 Dec

REPOSITORIES: biostudies-literature