Assessing the performance of generative artificial intelligence in retrieving information against manually curated genetic and genomic data.

ABSTRACT: Curated resources at centralized repositories provide high-value service to users by enhancing data veracity. Curation, however, comes with a cost, as it requires dedicated time and effort from personnel with deep domain knowledge. In this paper, we investigate the performance of a large language model (LLM), specifically generative pre-trained transformer (GPT)-3.5 and GPT-4, in extracting and presenting data against a human curator. In order to accomplish this task, we used a small set of journal articles on wheat and barley genetics, focusing on traits, such as salinity tolerance and disease resistance, which are becoming more important. The 36 papers were then curated by a professional curator for the GrainGenes database (https://wheat.pw.usda.gov). In parallel, we developed a GPT-base

SUBMITTER: Poretsky E 

PROVIDER: S-EPMC11833239 | biostudies-literature | 2025 Feb

REPOSITORIES: biostudies-literature