Accuracy of Artificial Intelligence Detection Software for Residency Personal Statements.

ABSTRACT: Background The improvement of generative artificial intelligence (AI) has led to concerns about residency applicants using AI to write personal statements. Because some program directors may value fully human-generated personal statements, they may be inclined to use commercially available AI detection tools. However, the accuracy of AI detection in personal statements is uncertain. Objective To evaluate the accuracy of AI detection tools in identifying AI-generated content within residency personal statements. Methods In 2024, 25 human-generated personal statements were collected from residents in the fields of internal medicine, psychiatry, neurology, and surgery at a single institution. The authors made 25 AI-generated statements with ChatGPT-4o, and 25 personal sta

SUBMITTER: Pak T 

PROVIDER: S-EPMC12710379 | biostudies-literature | 2025 Dec

REPOSITORIES: biostudies-literature