Dataset Information

Performance evaluation of automated white matter hyperintensity segmentation algorithms in a multicenter cohort on cognitive impairment and dementia.

ABSTRACT:

Background

White matter hyperintensities (WMH), a biomarker of small vessel disease, are often found in Alzheimer's disease (AD) and their advanced detection and quantification can be beneficial for research and clinical applications. To investigate WMH in large-scale multicenter studies on cognitive impairment and AD, appropriate automated WMH segmentation algorithms are required. This study aimed to compare the performance of segmentation tools and provide information on their application in multicenter research.

Methods

We used a pseudo-randomly selected dataset (n = 50) from the DZNE-multicenter observational Longitudinal Cognitive Impairment and Dementia Study (DELCODE) that included 3D fluid-attenuated inversion recovery (FLAIR) images from participants across the cognitive continuum. Performances of top-rated algorithms for automated WMH segmentation [Brain Intensity Abnormality Classification Algorithm (BIANCA), lesion segmentation toolbox (LST), lesion growth algorithm (LGA), LST lesion prediction algorithm (LPA), pgs, and sysu_media] were compared to manual reference segmentation (RS).

Results

Across tools, segmentation performance was moderate for global WMH volume and number of detected lesions. After retraining on a DELCODE subset, the deep learning algorithm sysu_media showed the highest performances with an average Dice's coefficient of 0.702 (±0.109 SD) for volume and a mean F1-score of 0.642 (±0.109 SD) for the number of lesions. The intra-class correlation was excellent for all algorithms (>0.9) but BIANCA (0.835). Performance improved with high WMH burden and varied across brain regions.

Conclusion

To conclude, the deep learning algorithm, when retrained, performed well in the multicenter context. Nevertheless, the performance was close to traditional methods. We provide methodological recommendations for future studies using automated WMH segmentation to quantify and assess WMH along the continuum of cognitive impairment and AD dementia.

SUBMITTER: Gaubert M

PROVIDER: S-EPMC9877422 | biostudies-literature | 2022

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Performance evaluation of automated white matter hyperintensity segmentation algorithms in a multicenter cohort on cognitive impairment and dementia.

Gaubert Malo M Dell'Orco Andrea A Lange Catharina C Garnier-Crussard Antoine A Zimmermann Isabella I Dyrba Martin M Duering Marco M Ziegler Gabriel G Peters Oliver O Preis Lukas L Priller Josef J Spruth Eike Jakob EJ Schneider Anja A Fliessbach Klaus K Wiltfang Jens J Schott Björn H BH Maier Franziska F Glanz Wenzel W Buerger Katharina K Janowitz Daniel D Perneczky Robert R Rauchmann Boris-Stephan BS Teipel Stefan S Kilimann Ingo I Laske Christoph C Munk Matthias H MH Spottke Annika A Roy Nina N Dobisch Laura L Ewers Michael M Dechent Peter P Haynes John Dylan JD Scheffler Klaus K Düzel Emrah E Jessen Frank F Wirth Miranka M

Frontiers in psychiatry 20230112

<h4>Background</h4>White matter hyperintensities (WMH), a biomarker of small vessel disease, are often found in Alzheimer's disease (AD) and their advanced detection and quantification can be beneficial for research and clinical applications. To investigate WMH in large-scale multicenter studies on cognitive impairment and AD, appropriate automated WMH segmentation algorithms are required. This study aimed to compare the performance of segmentation tools and provide information on their applicat ...[more]

PMID: 36713907

Similar Datasets

Project description:BackgroundPost-stroke cognitive impairment (PSCI) occurs in up to 50% of stroke survivors. Presence of pre-existing vascular brain injury, in particular the extent of white matter hyperintensities (WMH), is associated with worse cognitive outcome after stroke, but the role of WMH location in this association is unclear.AimsWe determined if WMH in strategic white matter tracts explain cognitive performance after stroke.MethodsIndividual patient data from nine ischemic stroke cohorts with magnetic resonance imaging (MRI) were harmonized through the Meta VCI Map consortium. The association between WMH volumes in strategic tracts and domain-specific cognitive functioning (attention and executive functioning, information processing speed, language and verbal memory) was assessed using linear mixed models and lasso regression. We used a hypothesis-driven design, primarily addressing four white matter tracts known to be strategic in memory clinic patients: the left and right anterior thalamic radiation, forceps major, and left inferior fronto-occipital fasciculus.ResultsThe total study sample consisted of 1568 patients (39.9% female, mean age = 67.3 years). Total WMH volume was strongly related to cognitive performance on all four cognitive domains. WMH volume in the left anterior thalamic radiation was significantly associated with cognitive performance on attention and executive functioning and information processing speed and WMH volume in the forceps major with information processing speed. The multivariable lasso regression showed that these associations were independent of age, sex, education, and total infarct volume and had larger coefficients than total WMH volume.ConclusionThese results show tract-specific relations between WMH volume and cognitive performance after ischemic stroke, independent of total WMH volume. This implies that the concept of strategic lesions in PSCI extends beyond acute infarcts and also involves pre-existing WMH.Data access statementThe Meta VCI Map consortium is dedicated to data sharing, following our guidelines.

Project description:IntroductionWhite matter hyperintensities (WMHs) are frequently observed on magnetic resonance (MR) images in older adults, commonly appearing as areas of high signal intensity on fluid-attenuated inversion recovery (FLAIR) MR scans. Elevated WMH volumes are associated with a greater risk of dementia and stroke, even after accounting for vascular risk factors. Manual segmentation, while considered the ground truth, is both labor-intensive and time-consuming, limiting the generation of annotated WMH datasets. Un-annotated data are relatively available; however, the requirement of annotated data poses a challenge for developing supervised machine learning models.MethodsTo address this challenge, we implemented a multi-stage semi-supervised learning (M3SL) approach that first uses un-annotated data segmented by traditional processing methods ("bronze" and "silver" quality data) and then uses a smaller number of "gold"-standard annotations for model refinement. The M3SL approach enabled fine-tuning of the model weights with the gold-standard annotations. This approach was integrated into the training of a U-Net model for WMH segmentation. We used data from three scanner vendors (over more than five scanners) and from both cognitively normal (CN) adult and patients cohorts [with mild cognitive impairment and Alzheimer's disease (AD)].ResultsAn analysis of WMH segmentation performance across both scanner and clinical stage (CN, MCI, AD) factors was conducted. We compared our results to both conventional and transfer-learning deep learning methods and observed better generalization with M3SL across different datasets. We evaluated several metrics (F-measure, IoU, and Hausdorff distance) and found significant improvements with our method compared to conventional (p < 0.001) and transfer-learning (p < 0.001).DiscussionThese findings suggest that automated, non-machine learning, tools have a role in a multi-stage learning framework and can reduce the impact of limited annotated data and, thus, enhance model performance.

Dataset Information

Performance evaluation of automated white matter hyperintensity segmentation algorithms in a multicenter cohort on cognitive impairment and dementia.

Background

Methods

Results

Conclusion

Publications

Performance evaluation of automated white matter hyperintensity segmentation algorithms in a multicenter cohort on cognitive impairment and dementia.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets