Dataset Information

A statistical quality assessment method for longitudinal observations in electronic health record data with an application to the VA million veteran program.

ABSTRACT:

Background

To describe an automated method for assessment of the plausibility of continuous variables collected in the electronic health record (EHR) data for real world evidence research use.

Methods

The most widely used approach in quality assessment (QA) for continuous variables is to detect the implausible numbers using prespecified thresholds. In augmentation to the thresholding method, we developed a score-based method that leverages the longitudinal characteristics of EHR data for detection of the observations inconsistent with the history of a patient. The method was applied to the height and weight data in the EHR from the Million Veteran Program Data from the Veteran's Healthcare Administration (VHA). A validation study was also conducted.

Results

The receiver operating characteristic (ROC) metrics of the developed method outperforms the widely used thresholding method. It is also demonstrated that different quality assessment methods have a non-ignorable impact on the body mass index (BMI) classification calculated from height and weight data in the VHA's database.

Conclusions

The score-based method enables automated and scaled detection of the problematic data points in health care big data while allowing the investigators to select the high-quality data based on their need. Leveraging the longitudinal characteristics in EHR will significantly improve the QA performance.

SUBMITTER: Wang H

PROVIDER: S-EPMC8529838 | biostudies-literature | 2021 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A statistical quality assessment method for longitudinal observations in electronic health record data with an application to the VA million veteran program.

Wang Hui H Belitskaya-Levy Ilana I Wu Fan F Lee Jennifer S JS Shih Mei-Chiung MC Tsao Philip S PS Lu Ying Y

BMC medical informatics and decision making 20211020 1

<h4>Background</h4>To describe an automated method for assessment of the plausibility of continuous variables collected in the electronic health record (EHR) data for real world evidence research use.<h4>Methods</h4>The most widely used approach in quality assessment (QA) for continuous variables is to detect the implausible numbers using prespecified thresholds. In augmentation to the thresholding method, we developed a score-based method that leverages the longitudinal characteristics of EHR d ...[more]

PMID: 34670548

Similar Datasets

Project description:Background and objectivesNearly all genetic analyses of Parkinson disease (PD) have been in populations of European ancestry. We sought to test the ability of a machine learning method to extract accurate PD diagnoses from an electronic medical record (EMR) system, to see whether genetic variants identified in European populations generalize to individuals of African and Hispanic ancestries, and to compare the rates of PD across ancestries.MethodsA machine learning method using natural language processing was applied to EMRs of US veterans participating in the VA Million Veteran Program (MVP) to identify individuals with PD. These putative cases were vetted via blind chart review by a movement disorder specialist. A polygenic risk score (PRS) of 90 established genetic variants whose genotypes were imputed from a customized Axiom Biobank Array was evaluated in different case groups.ResultsThe EMR prediction scores had a distinct trimodal distribution, with 97% of the high group and only 30% of the middle group having a credible diagnosis of PD. Using the 3,542 cases from the high group matched 4:1 to controls, the PRS was highly predictive in individuals of European ancestry (n = 3,137 cases; OR = 1.82; p = 8.01E-48), and nearly identical effect sizes were seen in individuals of African (n = 184; OR = 2.07; p = 3.4E-4) and Hispanic ancestries (n = 221; OR = 2.13; p = 3.9E-6). The PRS was much less predictive for the 2,757 European ancestry cases who had an ICD code for PD but for whom the machine learning method had a lower confidence in their diagnosis. No novel ancestry-specific genetic variants were identified. Individuals with African ancestry had one-quarter the rate of PD compared with European or Hispanic ancestries aged 60-70 years and one half the rate in the 70-80 years age range. African American cases had a higher proportion of their DNA originating in Europe compared with African American controls.DiscussionMachine learning can reliably classify PD using data from a large EMR. Larger studies of non-European populations are required to confirm the generalizability of PD risk variants identified in populations of European ancestry and the increased risk coming from a higher proportion of European DNA in African Americans.

Project description:BackgroundGenetic studies may help identify causal pathways; therefore, we sought to identify genetic determinants of ideal CVH and their association with CVD outcomes in the multi-population Veteran Administration Million Veteran Program.MethodsAn ideal health score (IHS) was calculated from 3 clinical factors (blood pressure, total cholesterol, and blood glucose levels) and 3 behavioral factors (smoking status, physical activity, and BMI), ascertained at baseline. Multi-population genome-wide association study (GWAS) was performed on IHS and binary ideal health using linear and logistic regression, respectively. Using the genome-wide significant SNPs from the IHS GWAS, we created a weighted IHS polygenic risk score (PRSIHS) which was used (i) to conduct a phenome-wide association study (PheWAS) of associations between PRSIHS and ICD-9 phenotypes and (ii) to further test for associations with mortality and selected CVD outcomes using logistic and Cox regression and, as an instrumental variable, in Mendelian Randomization.ResultsThe discovery and replication cohorts consisted of 142,404 (119,129 European American (EUR); 16,495 African American (AFR)), and 45,766 (37,646 EUR; 5,366 AFR) participants, respectively. The mean age was 65.8 years (SD = 11.2) and 92.7% were male. Overall, 4.2% exhibited ideal CVH based on the clinical and behavioral factors. In the multi-population meta-analysis, variants at 17 loci were associated with IHS and each had known GWAS associations with multiple components of the IHS. PheWAS analysis in 456,026 participants showed that increased PRSIHS was associated with a lower odds ratio for many CVD outcomes and risk factors. Both IHS and PRSIHS measures of ideal CVH were associated with significantly less CVD outcomes and CVD mortality.ConclusionA set of high interest genetic variants contribute to the presence of ideal CVH in a multi-ethnic cohort of US Veterans. Genetically influenced ideal CVH is associated with lower odds of CVD outcomes and mortality.

Dataset Information

A statistical quality assessment method for longitudinal observations in electronic health record data with an application to the VA million veteran program.

Background

Methods

Results

Conclusions

Publications

A statistical quality assessment method for longitudinal observations in electronic health record data with an application to the VA million veteran program.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets