Test collections for electronic health record-based clinical information retrieval.

ABSTRACT:

Objectives

To create test collections for evaluating clinical information retrieval (IR) systems and advancing clinical IR research.

Materials and methods

Electronic health record (EHR) data, including structured and free-text data, from 45 000 patients who are a part of the Mayo Clinic Biobank cohort was retrieved from the clinical data warehouse. The clinical IR system indexed a total of 42 million free-text EHR documents. The search queries consisted of 56 topics developed through a collaboration between Mayo Clinic and Oregon Health & Science University. We described the creation of test collections, including a to-be-evaluated document pool using five retrieval models, and human assessment guidelines. We analyzed the relevance judgment results in terms of human agreemen

SUBMITTER: Wang Y 

PROVIDER: S-EPMC6824517 | biostudies-literature | 2019 Oct

REPOSITORIES: biostudies-literature