Taiyi: a bilingual fine-tuned large language model for diverse biomedical tasks.

ABSTRACT:

Objective

Most existing fine-tuned biomedical large language models (LLMs) focus on enhancing performance in monolingual biomedical question answering and conversation tasks. To investigate the effectiveness of the fine-tuned LLMs on diverse biomedical natural language processing (NLP) tasks in different languages, we present Taiyi, a bilingual fine-tuned LLM for diverse biomedical NLP tasks.

Materials and methods

We first curated a comprehensive collection of 140 existing biomedical text mining datasets (102 English and 38 Chinese datasets) across over 10 task types. Subsequently, these corpora were converted to the instruction data used to fine-tune the general LLM. During the supervised fine-tuning phase, a 2-stage strategy is proposed to optimize the model performance ac

SUBMITTER: Luo L 

PROVIDER: S-EPMC11339499 | biostudies-literature | 2024 Sep

REPOSITORIES: biostudies-literature