AI-driven abstract generating: evaluating LLMs with a tailored prompt under the PRISMA-A framework.

ABSTRACT:

Background

This study aimed to assess and compare ChatGPT-4o and Gemini Pro's ability to generate structured abstracts from full-text systematic reviews and meta-analyses in orthodontics, based on adherence to the PRISMA Abstract (PRISMA-A) Checklist, using a customised prompt developed for this purpose.

Materials and methods

A total of 162 full-text systematic reviews and meta-analyses published in Q1-ranked orthodontic journals since January 2019 were included. Each full-text article was processed by ChatGPT-4o and Gemini Pro, using a PRISMA-A Checklist-aligned structured prompt. Outputs were scored using a tailored Overall quality Score OQS derived from 11 PRISMA-A checklist. Inter-rater and time-dependent reliability were assessed with Intraclass Correlation Coefficients

SUBMITTER: Demir GB 

PROVIDER: S-EPMC12512598 | biostudies-literature | 2025 Oct

REPOSITORIES: biostudies-literature