Me-LLaMA: Medical Foundation Large Language Models for Comprehensive Text Analysis and Beyond.

ABSTRACT: Recent advancements in large language models (LLMs) like ChatGPT and LLaMA have shown significant potential in medical applications, but their effectiveness is limited by a lack of specialized medical knowledge due to general-domain training. In this study, we developed Me-LLaMA, a new family of open-source medical LLMs that uniquely integrate extensive domain-specific knowledge with robust instruction-following capabilities. Me-LLaMA comprises foundation models (Me-LLaMA 13B and 70B) and their chat-enhanced versions, developed through comprehensive continual pretraining and instruction tuning of LLaMA2 models using both biomedical literature and clinical notes. Me-LLaMA utilized the largest and most comprehensive medical data, including 129B pre-training tokens and 214K instruction tuning

SUBMITTER: Xie Q 

PROVIDER: S-EPMC11702801 | biostudies-literature | 2024 Dec

REPOSITORIES: biostudies-literature