ChatGPT's quality: Reliability and validity of concept inventory items.

ABSTRACT:

Introduction

The recent advances of large language models (LLMs) have opened a wide range of opportunities, but at the same time, they pose numerous challenges and questions that research needs to answer. One of the main challenges are the quality and correctness of the output of LLMs as well as the overreliance of students on the output without critically reflecting on it. This poses the question of the quality of the output of LLMs in educational tasks and what students and teachers need to consider when using LLMs for creating educational items. In this work, we focus on the quality and characteristics of conceptual items developed using ChatGPT without user-generated improvements.

Methods

For this purpose, we optimized prompts and created 30 conceptual items in kinematic

SUBMITTER: Kuchemann S 

PROVIDER: S-EPMC11493723 | biostudies-literature | 2024

REPOSITORIES: biostudies-literature