Ontology highlight
ABSTRACT: Objectives
To assess the quality and alignment of ChatGPT's cancer treatment recommendations (RECs) with National Comprehensive Cancer Network (NCCN) guidelines and expert opinions.Methods
Three urologists performed quantitative and qualitative assessments in October 2023 analyzing responses from ChatGPT-4 and ChatGPT-3.5 to 108 prostate, kidney, and bladder cancer prompts using two zero-shot prompt templates. Performance evaluation involved calculating five ratios: expert-approved/expert-disagreed and NCCN-aligned RECs against total ChatGPT RECs plus coverage and adherence rates to NCCN. Experts rated the response's quality on a 1-5 scale considering correctness, comprehensiveness, specificity, and appropriateness.Results
ChatGPT-4 outperformed ChatGPT-3.5 in prost
SUBMITTER: Tsai CY
PROVIDER: S-EPMC11325467 | biostudies-literature | 2024 Jan-Dec
REPOSITORIES: biostudies-literature