Dataset Information

The ZuCo benchmark on cross-subject reading task classification with EEG and eye-tracking data.

ABSTRACT: We present a new machine learning benchmark for reading task classification with the goal of advancing EEG and eye-tracking research at the intersection between computational language processing and cognitive neuroscience. The benchmark task consists of a cross-subject classification to distinguish between two reading paradigms: normal reading and task-specific reading. The data for the benchmark is based on the Zurich Cognitive Language Processing Corpus (ZuCo 2.0), which provides simultaneous eye-tracking and EEG signals from natural reading of English sentences. The training dataset is publicly available, and we present a newly recorded hidden testset. We provide multiple solid baseline methods for this task and discuss future improvements. We release our code and provide an easy-to-use interface to evaluate new approaches with an accompanying public leaderboard: www.zuco-benchmark.com.

SUBMITTER: Hollenstein N

PROVIDER: S-EPMC9878684 | biostudies-literature | 2022

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The ZuCo benchmark on cross-subject reading task classification with EEG and eye-tracking data.

Hollenstein Nora N Tröndle Marius M Plomecka Martyna M Kiegeland Samuel S Özyurt Yilmazcan Y Jäger Lena A LA Langer Nicolas N

Frontiers in psychology 20230112

We present a new machine learning benchmark for reading task classification with the goal of advancing EEG and eye-tracking research at the intersection between computational language processing and cognitive neuroscience. The benchmark task consists of a cross-subject classification to distinguish between two reading paradigms: normal reading and task-specific reading. The data for the benchmark is based on the Zurich Cognitive Language Processing Corpus (ZuCo 2.0), which provides simultaneous ...[more]

PMID: 36710838

Similar Datasets

Project description:Scientific illustrations play an important role in scientific texts, however, young readers show limited ability to use illustration information and integrate it with the text in multimedia learning. The primary goal of the present study was to investigate if strategy instructions for illustrated text reading focused on scientific illustration reading and text-illustration integration can help young readers overcome their deficiencies and change their reading processes, learning outcomes, and subjective perceptions of article difficulty and enjoyment, illustration enjoyment, and self-evaluation of learning. Besides, is subjective perception of the article related to reading behavior? Sixty-two fourth-grade students read an illustrated science text while their eye movements were recorded, and then completed a reading test and questionnaire. The instruction group outperformed the control group on the reading test, but subjective perceptions of the article did not differ between groups. Eye-movements analysis showed that the instruction group spent twice as much time reading the illustrations and made more saccades between relevant text and illustration sections than the control group. These findings indicate that strategy instructions for reading illustrated text promoted reading comprehension and changed learning processes, not subjective perceptions. In addition, the result of this study showed that there was no relationship between subjective perception (article difficulty or illustrations enjoyment) of the article and reading time (total reading time on the illustrated science text and on the science illustrations). This study had empirical and practical contributions. Empirically, this study developed the instruction methods in multimedia learning and further examined their effect on learning processes in young readers. Practically, this study can help elementary school teachers understand the processes used by young readers when reading illustrated texts and provide them with evidence-based instructions to teach science reading effectively.

Project description:Abnormal eye movements occur early in the course of disease in many ataxias. However, clinical assessments of oculomotor function lack precision, limiting sensitivity for measuring progression and the ability to detect subtle early signs. Quantitative assessment of eye movements during everyday behaviors such as reading has potential to overcome these limitations and produce functionally relevant measures. In this study, we analyze eye movements in individuals with ataxia during passage reading. Binocular gaze sampled at 1000 Hz was collected from 102 individuals with ataxia diagnoses (including 36 spinocerebellar ataxias, 12 Friedreich's ataxia, and 5 multiple system atrophy among other conditions) and 70 healthy controls participating in the Neurobooth study. Longitudinal data were available for 26 participants with ataxia. Saccades were categorized as progressive (rightward) saccades, regressive saccades, or sweeps (large displacement saccades primarily generated when scanning to the beginning of the next line) based on their direction and displacement. Saccade and fixation kinematics were summarized using 28 statistical features. A linear model was trained to estimate clinician-performed ataxia rating scale scores. Model scores were reliable (ICC=0.96, p<0.001) and demonstrated convergent validity with Brief Ataxia Rating Scale total (r=0.82, p<0.001), oculomotor (r=0.52, p<0.001), and speech (r=0.73, p<0.001) scores, as well as patient surveys. The scores were also sensitive to disease progression (d=0.36, p=0.03), demonstrated strong separability between healthy controls and participants with ataxias (AUC=0.89, p<0.001), and showed evidence of the ability to detect subclinical oculomotor patterns (AUC=0.69, p=0.02). Several kinematic saccade and fixation features demonstrated strong differences across disease severity groups. Notable features included the mean angular displacement of fixations (η 2=0.44, p<0.001), the number (η 2=0.27, p<0.001) and frequency of saccades (η 2=0.25, p<0.001), and the proportion of regressive saccades (η 2=0.11, p<0.001). Quantitative assessment of eye movements during passage reading were highly informative of ataxia severity, were sensitive to disease progression, and enabled detection of subclinical signs. These properties support the inclusion of video-oculography-based measures of reading in natural history studies and clinical trials. Furthermore, this study demonstrates the feasibility of integration of oculomotor assessments in clinical workflows.

Dataset Information

The ZuCo benchmark on cross-subject reading task classification with EEG and eye-tracking data.

Publications

The ZuCo benchmark on cross-subject reading task classification with EEG and eye-tracking data.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets