Dataset Information

Combining magnetoencephalography with magnetic resonance imaging enhances learning of surrogate-biomarkers.

ABSTRACT: Electrophysiological methods, that is M/EEG, provide unique views into brain health. Yet, when building predictive models from brain data, it is often unclear how electrophysiology should be combined with other neuroimaging methods. Information can be redundant, useful common representations of multimodal data may not be obvious and multimodal data collection can be medically contraindicated, which reduces applicability. Here, we propose a multimodal model to robustly combine MEG, MRI and fMRI for prediction. We focus on age prediction as a surrogate biomarker in 674 subjects from the Cam-CAN dataset. Strikingly, MEG, fMRI and MRI showed additive effects supporting distinct brain-behavior associations. Moreover, the contribution of MEG was best explained by cortical power spectra between 8 and 30 Hz. Finally, we demonstrate that the model preserves benefits of stacking when some data is missing. The proposed framework, hence, enables multimodal learning for a wide range of biomarkers from diverse types of brain signals.

SUBMITTER: Engemann DA

PROVIDER: S-EPMC7308092 | biostudies-literature | 2020 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Combining magnetoencephalography with magnetic resonance imaging enhances learning of surrogate-biomarkers.

Engemann Denis A DA Kozynets Oleh O Sabbagh David D Lemaître Guillaume G Varoquaux Gael G Liem Franziskus F Gramfort Alexandre A

eLife 20200519

Electrophysiological methods, that is M/EEG, provide unique views into brain health. Yet, when building predictive models from brain data, it is often unclear how electrophysiology should be combined with other neuroimaging methods. Information can be redundant, useful common representations of multimodal data may not be obvious and multimodal data collection can be medically contraindicated, which reduces applicability. Here, we propose a multimodal model to robustly combine MEG, MRI and fMRI f ...[more]

PMID: 32423528

Similar Datasets

Project description:Surgical treatment of epilepsy is a challenge for patients with non-contributive brain magnetic resonance imaging. However, surgery is feasible if the seizure-onset zone is precisely delineated through intracranial electroencephalography recording. We recently described a method, volumetric imaging of epileptic spikes, to delineate the spiking volume of patients with focal epilepsy using magnetoencephalography. We postulated that the extent of the spiking volume delineated with volumetric imaging of epileptic spikes could predict the localizability of the seizure-onset zone by intracranial electroencephalography investigation and outcome of surgical treatment. Twenty-one patients with non-contributive magnetic resonance imaging findings were included. All patients underwent intracerebral electroencephalography investigation through stereotactically implanted depth electrodes (stereo-electroencephalography) and magnetoencephalography with delineation of the spiking volume using volumetric imaging of epileptic spikes. We evaluated the spatial congruence between the spiking volume determined by magnetoencephalography and the localization of the seizure-onset zone determined by stereo-electroencephalography. We also evaluated the outcome of stereo-electroencephalography and surgical treatment according to the extent of the spiking volume (focal, lateralized but non-focal or non-lateralized). For all patients, we found a spatial overlap between the seizure-onset zone and the spiking volume. For patients with a focal spiking volume, the seizure-onset zone defined by stereo-electroencephalography was clearly localized in all cases and most patients (6/7, 86%) had a good surgical outcome. Conversely, stereo-electroencephalography failed to delineate a seizure-onset zone in 57% of patients with a lateralized spiking volume, and in the two patients with bilateral spiking volume. Four of the 12 patients with non-focal spiking volumes were operated upon, none became seizure-free. As a whole, patients having focal magnetoencephalography results with volumetric imaging of epileptic spikes are good surgical candidates and the implantation strategy should incorporate volumetric imaging of epileptic spikes results. On the contrary, patients with non-focal magnetoencephalography results are less likely to have a localized seizure-onset zone and stereo electroencephalography is not advised unless clear localizing information is provided by other presurgical investigation methods.

Project description:Early detection is critical for effective management of Alzheimer's disease (AD) and screening for mild cognitive impairment (MCI) is common practice. Among several deep-learning techniques that have been applied to assessing structural brain changes on magnetic resonance imaging (MRI), convolutional neural network (CNN) has gained popularity due to its superb efficiency in automated feature learning with the use of a variety of multilayer perceptrons. Meanwhile, ensemble learning (EL) has shown to be beneficial in the robustness of learning-system performance via integrating multiple models. Here, we proposed a classifier ensemble developed by combining CNN and EL, i.e., the CNN-EL approach, to identify subjects with MCI or AD using MRI: i.e., classification between (1) AD and healthy cognition (HC), (2) MCIc (MCI patients who will convert to AD) and HC, and (3) MCIc and MCInc (MCI patients who will not convert to AD). For each binary classification task, a large number of CNN models were trained applying a set of sagittal, coronal, or transverse MRI slices; these CNN models were then integrated into a single ensemble. Performance of the ensemble was evaluated using stratified fivefold cross-validation method for 10 times. The number of the intersection points determined by the most discriminable slices separating two classes in a binary classification task among the sagittal, coronal, and transverse slice sets, transformed into the standard Montreal Neurological Institute (MNI) space, acted as an indicator to assess the ability of a brain region in which the points were located to classify AD. Thus, the brain regions with most intersection points were considered as those mostly contributing to the early diagnosis of AD. The result revealed an accuracy rate of 0.84 ± 0.05, 0.79 ± 0.04, and 0.62 ± 0.06, respectively, for classifying AD vs. HC, MCIc vs. HC, and MCIc vs. MCInc, comparable to previous reports and a 3D deep learning approach (3D-SENet) based on a more state-of-the-art and popular Squeeze-and-Excitation Networks model using channel attention mechanism. Notably, the intersection points accurately located the medial temporal lobe and several other structures of the limbic system, i.e., brain regions known to be struck early in AD. More interestingly, the classifiers disclosed multiple patterned MRI changes in the brain in AD and MCIc, involving these key regions. These results suggest that as a data-driven method, the combined CNN and EL approach can locate the most discriminable brain regions indicated by the trained ensemble model while the generalization ability of the ensemble model was maximized to successfully capture AD-related brain variations early in the disease process; it can also provide new insights into understanding the complex heterogeneity of whole-brain MRI changes in AD. Further research is needed to examine the clinical implication of the finding, capability of the advocated CNN-EL approach to help understand and evaluate an individual subject's disease status, symptom burden and progress, and the generalizability of the advocated CNN-EL approach to locate the most discriminable brain regions in the detection of other brain disorders such as schizophrenia, autism, and severe depression, in a data-driven way.

Dataset Information

Combining magnetoencephalography with magnetic resonance imaging enhances learning of surrogate-biomarkers.

Publications

Combining magnetoencephalography with magnetic resonance imaging enhances learning of surrogate-biomarkers.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets