Evaluating AI in medicine: a comparative analysis of expert and ChatGPT responses to colorectal cancer questions.

ABSTRACT: Colorectal cancer (CRC) is a global health challenge, and patient education plays a crucial role in its early detection and treatment. Despite progress in AI technology, as exemplified by transformer-like models such as ChatGPT, there remains a lack of in-depth understanding of their efficacy for medical purposes. We aimed to assess the proficiency of ChatGPT in the field of popular science, specifically in answering questions related to CRC diagnosis and treatment, using the book "Colorectal Cancer: Your Questions Answered" as a reference. In general, 131 valid questions from the book were manually input into ChatGPT. Responses were evaluated by clinical physicians in the relevant fields based on comprehensiveness and accuracy of information, and scores were standardized for comparison. N

SUBMITTER: Peng W 

PROVIDER: S-EPMC10838275 | biostudies-literature | 2024 Feb

REPOSITORIES: biostudies-literature