GeneGPT: Augmenting Large Language Models with Domain Tools for Improved Access to Biomedical Information.

ABSTRACT: While large language models (LLMs) have been successfully applied to various tasks, they still face challenges with hallucinations. Augmenting LLMs with domain-specific tools such as database utilities can facilitate easier and more precise access to specialized knowledge. In this paper, we present GeneGPT, a novel method for teaching LLMs to use the Web APIs of the National Center for Biotechnology Information (NCBI) for answering genomics questions. Specifically, we prompt Codex to solve the GeneTuring tests with NCBI Web APIs by in-context learning and an augmented decoding algorithm that can detect and execute API calls. Experimental results show that GeneGPT achieves state-of-the-art performance on eight tasks in the GeneTuring benchmark with an average score of 0.83, largely surpassi

SUBMITTER: Jin Q 

PROVIDER: S-EPMC10153281 | biostudies-literature | 2023 May

REPOSITORIES: biostudies-literature