Performance of Multimodal Artificial Intelligence Chatbots Evaluated on Clinical Oncology Cases.

ABSTRACT:

Importance

Multimodal artificial intelligence (AI) chatbots can process complex medical image and text-based information that may improve their accuracy as a clinical diagnostic and management tool compared with unimodal, text-only AI chatbots. However, the difference in medical accuracy of multimodal and text-only chatbots in addressing questions about clinical oncology cases remains to be tested.

Objective

To evaluate the utility of prompt engineering (zero-shot chain-of-thought) and compare the competency of multimodal and unimodal AI chatbots to generate medically accurate responses to questions about clinical oncology cases.

Design, setting, and participants

This cross-sectional study benchmarked the medical accuracy of multiple-choice and free-text responses gen

SUBMITTER: Chen D 

PROVIDER: S-EPMC11581577 | biostudies-literature | 2024 Oct

REPOSITORIES: biostudies-literature