A multimodal vision transformer for interpretable fusion of functional and structural neuroimaging data.

ABSTRACT: Multimodal neuroimaging is an emerging field that leverages multiple sources of information to diagnose specific brain disorders, especially when deep learning-based AI algorithms are applied. The successful combination of different brain imaging modalities using deep learning remains a challenging yet crucial research topic. The integration of structural and functional modalities is particularly important for the diagnosis of various brain disorders, where structural information plays a crucial role in diseases such as Alzheimer's, while functional imaging is more critical for disorders such as schizophrenia. However, the combination of functional and structural imaging modalities can provide a more comprehensive diagnosis. In this work, we present MultiViT, a novel diagnostic deep learni

SUBMITTER: Bi Y 

PROVIDER: S-EPMC11599617 | biostudies-literature | 2024 Dec

REPOSITORIES: biostudies-literature