ChatGPT's performance in sample size estimation: a preliminary study on the capabilities of artificial intelligence.

ABSTRACT:

Background

Artificial intelligence tools, including large language models such as ChatGPT, are increasingly integrated into clinical and primary care research. However, their ability to assist with specialized statistical tasks, such as sample size estimation, remains largely unexplored.

Methods

We evaluated the accuracy and reproducibility of ChatGPT-4.0 and ChatGPT-4o in estimating sample sizes across 24 standard statistical scenarios. Examples were selected from a statistical textbook and an educational website, covering basic methods such as estimating means, proportions, and correlations. Each example was tested twice per model. Models were accessed through the ChatGPT web interface, with a new independent chat session initiated for each round. Accuracy was assessed usi

SUBMITTER: Sebo P 

PROVIDER: S-EPMC12411907 | biostudies-literature | 2025 Aug

REPOSITORIES: biostudies-literature