Dataset Information

Classification of Targets and Distractors in an Audiovisual Attention Task Based on Electroencephalography.

ABSTRACT: Within the broader context of improving interactions between artificial intelligence and humans, the question has arisen regarding whether auditory and rhythmic support could increase attention for visual stimuli that do not stand out clearly from an information stream. To this end, we designed an experiment inspired by pip-and-pop but more appropriate for eliciting attention and P3a-event-related potentials (ERPs). In this study, the aim was to distinguish between targets and distractors based on the subject's electroencephalography (EEG) data. We achieved this objective by employing different machine learning (ML) methods for both individual-subject (IS) and cross-subject (CS) models. Finally, we investigated which EEG channels and time points were used by the model to make its predictions using saliency maps. We were able to successfully perform the aforementioned classification task for both the IS and CS scenarios, reaching classification accuracies up to 76%. In accordance with the literature, the model primarily used the parietal-occipital electrodes between 200 ms and 300 ms after the stimulus to make its prediction. The findings from this research contribute to the development of more effective P300-based brain-computer interfaces. Furthermore, they validate the EEG data collected in our experiment.

SUBMITTER: Mortier S

PROVIDER: S-EPMC10708631 | biostudies-literature | 2023 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Classification of Targets and Distractors in an Audiovisual Attention Task Based on Electroencephalography.

Mortier Steven S Turkeš Renata R De Winne Jorg J Van Ransbeeck Wannes W Botteldooren Dick D Devos Paul P Latré Steven S Leman Marc M Verdonck Tim T

Sensors (Basel, Switzerland) 20231203 23

Within the broader context of improving interactions between artificial intelligence and humans, the question has arisen regarding whether auditory and rhythmic support could increase attention for visual stimuli that do not stand out clearly from an information stream. To this end, we designed an experiment inspired by pip-and-pop but more appropriate for eliciting attention and P3a-event-related potentials (ERPs). In this study, the aim was to distinguish between targets and distractors based ...[more]

PMID: 38067961

Similar Datasets

Project description:The intricate relationship between multisensory integration and attention has been extensively researched in the multisensory field; however, the necessity of attention for the binding of multisensory stimuli remains contested. In the current study, we investigated whether diverting attention from well-known multisensory tasks would disrupt integration and whether the complexity of the stimulus and task modulated this interaction. A secondary objective of this study was to investigate individual differences in the interaction of attention and multisensory integration. Participants completed a simple audiovisual speeded detection task and McGurk task under various perceptual load conditions: no load (multisensory task while visual distractors present), low load (multisensory task while detecting the presence of a yellow letter in the visual distractors), and high load (multisensory task while detecting the presence of a number in the visual distractors). Consistent with prior studies, we found that increased perceptual load led to decreased reports of the McGurk illusion, thus confirming the necessity of attention for the integration of speech stimuli. Although increased perceptual load led to longer response times for all stimuli in the speeded detection task, participants responded faster on multisensory trials than unisensory trials. However, the increase in multisensory response times violated the race model for no and low perceptual load conditions only. Additionally, a geometric measure of Miller's inequality showed a decrease in multisensory integration for the speeded detection task with increasing perceptual load. Surprisingly, we found diverging changes in multisensory integration with increasing load for participants who did not show integration for the no load condition: no changes in integration for the McGurk task with increasing load but increases in integration for the detection task. The results of this study indicate that attention plays a crucial role in multisensory integration for both highly complex and simple multisensory tasks and that attention may interact differently with multisensory processing in individuals who do not strongly integrate multisensory information.

Project description:Alzheimer's disease (AD) is a progressive disease leading to cognitive decline, and to prevent it, researchers seek to diagnose mild cognitive impairment (MCI) early. Particularly, non-amnestic MCI (naMCI) is often mistaken for normal aging as the representative symptom of AD, memory decline, is absent. Subjective cognitive decline (SCD), an intermediate step between normal aging and MCI, is crucial for prediction or early detection of MCI, which determines the presence of AD spectrum pathology. We developed a computer-based cognitive task to classify the presence or absence of AD pathology and stage within the AD spectrum, and attempted to perform multi-stage classification through electroencephalography (EEG) during resting and memory encoding state. The resting and memory-encoding states of 58 patients (20 with SCD, 10 with naMCI, 18 with aMCI, and 10 with AD) were measured and classified into four groups. We extracted features that could reflect the phase, spectral, and temporal characteristics of the resting and memory-encoding states. For the classification, we compared nine machine learning models and three deep learning models using Leave-one-subject-out strategy. Significant correlations were found between the existing neurophysiological test scores and performance of our computer-based cognitive task for all cognitive domains. In all models used, the memory-encoding states realized a higher classification performance than resting states. The best model for the 4-class classification was cKNN. The highest accuracy using resting state data was 67.24%, while it was 93.10% using memory encoding state data. This study involving participants with SCD, naMCI, aMCI, and AD focused on early Alzheimer's diagnosis. The research used EEG data during resting and memory encoding states to classify these groups, demonstrating the significance of cognitive process-related brain waves for diagnosis. The computer-based cognitive task introduced in the study offers a time-efficient alternative to traditional neuropsychological tests, showing a strong correlation with their results and serving as a valuable tool to assess cognitive impairment with reduced bias.

Dataset Information

Classification of Targets and Distractors in an Audiovisual Attention Task Based on Electroencephalography.

Publications

Classification of Targets and Distractors in an Audiovisual Attention Task Based on Electroencephalography.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets