Development and evaluation of a large language model of ophthalmology in Chinese.

ABSTRACT:

Background

Large language models (LLMs), such as ChatGPT, have considerable implications for various medical applications. However, ChatGPT's training primarily draws from English-centric internet data and is not tailored explicitly to the medical domain. Thus, an ophthalmic LLM in Chinese is clinically essential for both healthcare providers and patients in mainland China.

Methods

We developed an LLM of ophthalmology (MOPH) using Chinese corpora and evaluated its performance in three clinical scenarios: ophthalmic board exams in Chinese, answering evidence-based medicine-oriented ophthalmic questions and diagnostic accuracy for clinical vignettes. Additionally, we compared MOPH's performance to that of human doctors.

Results

In the ophthalmic exam, MOPH's average sco

SUBMITTER: Zheng C 

PROVIDER: S-EPMC11503135 | biostudies-literature | 2024 Sep

REPOSITORIES: biostudies-literature