Discovering unknown response patterns in progress test data to improve the estimation of student performance.

ABSTRACT:

Background

The Progress Test Medizin (PTM) is a 200-question formative test that is administered to approximately 11,000 students at medical universities (Germany, Austria, Switzerland) each term. Students receive feedback on their knowledge (development) mostly in comparison to their own cohort. In this study, we use the data of the PTM to find groups with similar response patterns.

Methods

We performed k-means clustering with a dataset of 5,444 students, selected cluster number k = 5, and answers as features. Subsequently, the data was passed to XGBoost with the cluster assignment as target enabling the identification of cluster-relevant questions for each cluster with SHAP. Clusters were examined by total scores, response patterns, and confidence level. Relevant questions

SUBMITTER: Sieg M 

PROVIDER: S-EPMC10053036 | biostudies-literature | 2023 Mar

REPOSITORIES: biostudies-literature