Dataset Information

Accuracy of Machine Learning Using the Montreal Cognitive Assessment for the Diagnosis of Cognitive Impairment in Parkinson's Disease.

ABSTRACT:

Objective

The Montreal Cognitive Assessment (MoCA) is recommended for assessing general cognition in Parkinson's disease (PD). Several cutoffs of MoCA scores for diagnosing PD with cognitive impairment (PD-CI) have been proposed, with varying sensitivity and specificity. This study investigated the utility of machine learning algorithms using MoCA cognitive domain scores for improving diagnostic performance for PD-CI.

Methods

In total, 2,069 MoCA results were obtained from 397 patients with PD enrolled in the Parkinson's Progression Markers Initiative database with a diagnosis of cognitive status based on comprehensive neuropsychological assessments. Using the same number of MoCA results randomly sampled from patients with PD with normal cognition or PD-CI, discriminant validity was compared between machine learning (logistic regression, support vector machine, or random forest) with domain scores and a cutoff method.

Results

Based on cognitive status classification using a dataset that permitted sampling of MoCA results from the same individual (n = 221 per group), no difference was observed in accuracy between the cutoff value method (0.74 ± 0.03) and machine learning (0.78 ± 0.03). Using a more stringent dataset that excluded MoCA results (n = 101 per group) from the same patients, the accuracy of the cutoff method (0.66 ± 0.05), but not that of machine learning (0.74 ± 0.07), was significantly reduced. Inclusion of cognitive complaints as an additional variable improved the accuracy of classification using the machine learning method (0.87-0.89).

Conclusion

Machine learning analysis using MoCA domain scores is a valid method for screening cognitive impairment in PD.

SUBMITTER: Jeon J

PROVIDER: S-EPMC9171310 | biostudies-literature | 2022 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Accuracy of Machine Learning Using the Montreal Cognitive Assessment for the Diagnosis of Cognitive Impairment in Parkinson's Disease.

Jeon Junbeom J Kim Kiyong K Baek Kyeongmin K Chung Seok Jong SJ Yoon Jeehee J Kim Yun Joong YJ

Journal of movement disorders 20220526 2

<h4>Objective</h4>The Montreal Cognitive Assessment (MoCA) is recommended for assessing general cognition in Parkinson's disease (PD). Several cutoffs of MoCA scores for diagnosing PD with cognitive impairment (PD-CI) have been proposed, with varying sensitivity and specificity. This study investigated the utility of machine learning algorithms using MoCA cognitive domain scores for improving diagnostic performance for PD-CI.<h4>Methods</h4>In total, 2,069 MoCA results were obtained from 397 pat ...[more]

PMID: 35670022

Similar Datasets

Project description:Given advantages in reperfusion therapy leading to mild stroke, less apparent cognitive deficits can be overseen in a routine neurological examination. Despite the widespread use of the Montreal Cognitive Assessment (MoCA), age- and education-specific cutoffs for the detection of post-stroke cognitive impairment (PSCI) are not established, hampering its valid application in stroke. We aimed to establish age- and education-specific MoCA cutoffs to better discriminate patients with and without acute PSCI. Patients with acute ischemic stroke underwent the MoCA and a detailed neuropsychological assessment. PSCI was defined as a performance < - 1.5 SD in ≥ 2 cognitive domains. As secondary data analysis, the discriminant abilities of the MoCAraw-score (not adding + 1 as correction for ≤ 12 years of education, YoE) cutoffs were automatically derived based on Youden Index and evaluated by receiver operating characteristic analyses across age- (< 55, 55-70, > 70 years old) and education-specific (≤ 12 and > 12 YoE) groups. 351 stroke patients (67.4 ± 14.1 years old; 13.1 ± 2.8 YoE) underwent the neuropsychological assessment 2.7 ± 2.0 days post-stroke. The original MoCA cutoff < 26 falsely classified 26.2% of examined patients, with poor sensitivity in younger adults (34.8% in patients < 55 years > 12 YoE) and poor specificity in older adults (55.0%, in > 70 years ≤ 12 YoE). By maximizing both sensitivity and specificity, the optimal MoCAraw cutoffs were: (i) < 28 in patients aged < 55 with > 12 YoE (sensitivity = 69.6%, specificity = 77.8%); (ii) < 22 and < 25 in patients > 70 years with ≤ 12 and > 12 YoE (sensitivity = 61.6%, specificity = 90.0%; sensitivity = 63.3%, specificity = 84.0%, respectively). In other groups the optimal MoCAraw cutoff was < 26. Age and education level should be considered when interpreting MoCA-scores. Though new age- and education-specific cutoffs demonstrated higher discriminant ability for PSCI, their performance in young stroke and adults with higher education level was low due to ceiling effects and MoCA subtests structure, and cautious interpretation in these patients is warranted.Trial registration: ClinicalTrials.gov Identifier: NCT05653141.

Project description:BackgroundClinical markers of cognitive decline in Parkinson's disease (PD) encompass several mental non-motor symptoms such as hallucinations, apathy, anxiety, and depression. Furthermore, freezing of gait (FOG) and specific gait alterations have been associated with cognitive dysfunction in PD. Finally, although low cerebrospinal fluid levels of amyloid-β42 have been found to predict cognitive decline in PD, hitherto PET imaging of amyloid-β (Aβ) failed to consistently demonstrate the association between Aβ plaques deposition and mild cognitive impairment in PD (PD-MCI).AimFinding significant features associated with PD-MCI through a machine learning approach.Patients and methodsPatients were assessed with an extensive clinical and neuropsychological examination. Clinical evaluation included the assessment of mental non-motor symptoms and FOG using the specific items of the MDS-UPDRS I and II. Based on the neuropsychological examination, patients were classified as subjects without and with MCI (noPD-MCI, PD-MCI). All patients were evaluated using a motion analysis system. A subgroup of PD patients also underwent amyloid PET imaging. PD-MCI and noPD-MCI subjects were compared with a univariate statistical analysis on demographic data, clinical features, gait analysis variables, and amyloid PET data. Then, machine learning analysis was performed two times: Model 1 was implemented with age, clinical variables (hallucinations/psychosis, depression, anxiety, apathy, sleep problems, FOG), and gait features, while Model 2, including only the subgroup performing PET, was implemented with PET variables combined with the top five features of the former model.ResultsSeventy-five PD patients were enrolled (33 PD-MCI and 42 noPD-MCI). PD-MCI vs. noPD-MCI resulted in older and showed worse gait patterns, mainly characterized by increased dynamic instability and reduced step length; when comparing amyloid PET data, the two groups did not differ. Regarding the machine learning analyses, evaluation metrics were satisfactory for Model 1 overcoming 80% for accuracy and specificity, whereas they were disappointing for Model 2.ConclusionsThis study demonstrates that machine learning implemented with specific clinical features and gait variables exhibits high accuracy in predicting PD-MCI, whereas amyloid PET imaging is not able to increase prediction. Additionally, our results prompt that a data mining approach on certain gait parameters might represent a reliable surrogate biomarker of PD-MCI.

Dataset Information

Accuracy of Machine Learning Using the Montreal Cognitive Assessment for the Diagnosis of Cognitive Impairment in Parkinson's Disease.

Objective

Methods

Results

Conclusion

Publications

Accuracy of Machine Learning Using the Montreal Cognitive Assessment for the Diagnosis of Cognitive Impairment in Parkinson's Disease.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets