Unknown

Dataset Information

0

Clinical entity augmented retrieval for clinical information extraction.


ABSTRACT: Large language models (LLMs) with retrieval-augmented generation (RAG) have improved information extraction over previous methods, yet their reliance on embeddings often leads to inefficient retrieval. We introduce CLinical Entity Augmented Retrieval (CLEAR), a RAG pipeline that retrieves information using entities. We compared CLEAR to embedding RAG and full-note approaches for extracting 18 variables using six LLMs across 20,000 clinical notes. Average F1 scores were 0.90, 0.86, and 0.79; inference times were 4.95, 17.41, and 20.08 s per note; average model queries were 1.68, 4.94, and 4.18 per note; and average input tokens were 1.1k, 3.8k, and 6.1k per note for CLEAR, embedding RAG, and full-note approaches, respectively. In conclusion, CLEAR utilizes clinical entities for information retrieval and achieves >70% reduction in token usage and inference time with improved performance compared to modern methods.

SUBMITTER: Lopez I 

PROVIDER: S-EPMC11743751 | biostudies-literature | 2025 Jan

REPOSITORIES: biostudies-literature

altmetric image

Publications


Large language models (LLMs) with retrieval-augmented generation (RAG) have improved information extraction over previous methods, yet their reliance on embeddings often leads to inefficient retrieval. We introduce CLinical Entity Augmented Retrieval (CLEAR), a RAG pipeline that retrieves information using entities. We compared CLEAR to embedding RAG and full-note approaches for extracting 18 variables using six LLMs across 20,000 clinical notes. Average F1 scores were 0.90, 0.86, and 0.79; infe  ...[more]

Similar Datasets

| S-EPMC10857783 | biostudies-literature
| S-EPMC10403195 | biostudies-literature
| S-EPMC10919922 | biostudies-literature
| S-EPMC12616094 | biostudies-literature
| S-EPMC12034796 | biostudies-literature
| S-EPMC6824517 | biostudies-literature