Literature search sandbox: a large language model that generates search queries for systematic reviews.

ABSTRACT:

Objectives

Development of search queries for systematic reviews (SRs) is time-consuming. In this work, we capitalize on recent advances in large language models (LLMs) and a relatively large dataset of natural language descriptions of reviews and corresponding Boolean searches to generate Boolean search queries from SR titles and key questions.

Materials and methods

We curated a training dataset of 10 346 SR search queries registered in PROSPERO. We used this dataset to fine-tune a set of models to generate search queries based on Mistral-Instruct-7b. We evaluated the models quantitatively using an evaluation dataset of 57 SRs and qualitatively through semi-structured interviews with 8 experienced medical librarians.

Results

The model-generated search queries had medi

SUBMITTER: Adam GP 

PROVIDER: S-EPMC11424077 | biostudies-literature | 2024 Oct

REPOSITORIES: biostudies-literature