Dataset Information

A New Strategy for Evaluating the Quality of Laboratory Results for Big Data Research: Using External Quality Assessment Survey Data (2010-2020).

ABSTRACT:

Background

To ensure valid results of big data research in the medical field, the input laboratory results need to be of high quality. We aimed to establish a strategy for evaluating the quality of laboratory results suitable for big data research.

Methods

We used Korean Association of External Quality Assessment Service (KEQAS) data to retrospectively review multicenter data. Seven measurands were analyzed using commutable materials: HbA1c, creatinine (Cr), total cholesterol (TC), triglyceride (TG), alpha-fetoprotein (AFP), prostate-specific antigen (PSA), and cardiac troponin I (cTnI). These were classified into three groups based on their standardization or harmonization status. HbA1c, Cr, TC, TG, and AFP were analyzed with respect to peer group values. PSA and cTnI were analyzed in separate peer groups according to the calibrator type and manufacturer, respectively. The acceptance rate and absolute percentage bias at the medical decision level were calculated based on biological variation criteria.

Results

The acceptance rate (22.5%-100%) varied greatly among the test items, and the mean percentage biases were 0.6%-5.6%, 1.0%-9.6%, and 1.6%-11.3% for all items that satisfied optimum, desirable, and minimum criteria, respectively.

Conclusions

The acceptance rate of participants and their external quality assessment (EQA) results exhibited statistically significant differences according to the quality grade for each criterion. Even when they passed the EQA standards, the test results did not guarantee the quality requirements for big data. We suggest that the KEQAS classification can serve as a guide for building big data.

SUBMITTER: Cho EJ

PROVIDER: S-EPMC10151270 | biostudies-literature | 2023 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A New Strategy for Evaluating the Quality of Laboratory Results for Big Data Research: Using External Quality Assessment Survey Data (2010-2020).

Cho Eun-Jung EJ Jeong Tae-Dong TD Kim Sollip S Park Hyung-Doo HD Yun Yeo-Min YM Chun Sail S Min Won-Ki WK

Annals of laboratory medicine 20230421 5

<h4>Background</h4>To ensure valid results of big data research in the medical field, the input laboratory results need to be of high quality. We aimed to establish a strategy for evaluating the quality of laboratory results suitable for big data research.<h4>Methods</h4>We used Korean Association of External Quality Assessment Service (KEQAS) data to retrospectively review multicenter data. Seven measurands were analyzed using commutable materials: HbA1c, creatinine (Cr), total cholesterol (TC) ...[more]

PMID: 37080743

Similar Datasets

Project description:BackgroundSouth Africa's National Health Laboratory Service (NHLS), the only clinical laboratory service in the country's public health sector, is an important resource for monitoring public health programmes.ObjectivesWe describe NHLS data quality, particularly patient demographics among infants, and the effect this has on linking multiple test results to a single patient.MethodsRetrospective descriptive analysis of NHLS data from 1st January 2017-1st September 2020 was performed. A validated probabilistic record-linking algorithm linked multiple results to individual patients in lieu of a unique patient identifier. Paediatric HIV PCR data was used to illustrate the effect on monitoring and evaluating a public health programme. Descriptive statistics including medians, proportions and inter quartile ranges are reported, with Chi-square univariate tests for independence used to determine association between variables.ResultsDuring the period analysed, 485 300 007 tests, 98 217 642 encounters and 35 771 846 patients met criteria for analysis. Overall, 15.80% (n = 15 515 380) of all encounters had a registered national identity (ID) number, 2.11% (n = 2 069 785) were registered without a given name, 63.15% (n = 62 020 107) were registered to women and 32.89% (n = 32 304 329) of all folder numbers were listed as either the patient's date of birth or unknown. For infants tested at < 7 days of age (n = 2 565 329), 0.099% (n = 2 534) had an associated ID number and 48.87% (n = 1 253 620) were registered without a given name. Encounters with a given name were linked to a subsequent encounter 40.78% (n = 14 180 409 of 34 775 617) of the time, significantly more often than the 21.85% (n = 217 660 of 996 229) of encounters registered with a baby-derivative name (p-value < 0.001).ConclusionUnavailability and poor capturing of patient demographics, especially among infants and children, affects the ability to accurately monitor routine health programmes. A unique national patient identifier, other than the national ID number, is urgently required and must be available at birth if South Africa is to accurately monitor programmes such as the Prevention of Mother-to-Child Transmission of HIV.

Project description:BackgroundThe re-emergence of yellow fever poses a serious public health risk to unimmunized communities in the tropical regions of Africa and South America and unvaccinated travelers visiting these regions. This risk is further accentuated by the likely spread of the virus to areas with potential for yellow fever transmission such as in Asia, Europe, and North America. To mitigate this risk, surveillance of yellow fever is pivotal. We performed an analysis of laboratory-based surveillance of yellow fever suspected cases in Cameroon during 2010-2020 to characterize the epidemiology of yellow fever cases and define health districts at high risk.MethodWe reviewed IgM capture ELISA and plaque reduction neutralization test (PRNT) test results of all suspected yellow fever patients analyzed at Centre Pasteur of Cameroon, the national yellow fever testing laboratory, during 2010-2020.ResultsOf the 20,261 yellow fever suspected patient's samples that were tested, yellow fever IgM antibodies were detected in 360 patients representing an annual average of 33 cases/year. A major increase in YF IgM positive cases was observed in 2015 and in 2016 followed by a decrease in cases to below pre-2015 levels. The majority of the 2015 cases occurred during the latter part of the year while those in 2016, occurred between February and May. This trend may be due to an increase in transmission that began in late 2015 and continued to early 2016 or due to two separate transmission events. In 2016, where the highest number of cases were detected, 60 health districts in the 10 regions of Cameroon were affected with the Littoral, Northwest and, Far North regions being the most affected. After 2016, the number of detected yellow fever IgM positive cases dropped.ConclusionOur study shows that yellow fever transmission continues to persist and seems to be occurring all over Cameroon with all 10 regions under surveillance reporting a case. Preventive measures such as mass vaccination campaigns and routine childhood immunizations are urgently needed to increase population immunity. The diagnostic limitations in our analysis highlight the need to strengthen laboratory capacity and improve case investigations.

Project description:BackgroundData standardization is essential in electronic health records (EHRs) for both clinical practice and retrospective research. However, it is still not easy to standardize EHR data because of nonidentical duplicates, typographical errors, or inconsistencies. To overcome this drawback, standardization efforts have been undertaken for collecting data in a standardized format as well as for curating the stored data in EHRs. To perform clinical big data research, the stored data in EHR should be standardized, starting from laboratory results, given their importance. However, most of the previous efforts have been based on labor-intensive manual methods.ObjectiveWe aimed to develop an automatic standardization method for eliminating the noises of categorical laboratory data, grouping, and mapping of cleaned data using standard terminology.MethodsWe developed a method called standardization algorithm for laboratory test-categorical result (SALT-C) that can process categorical laboratory data, such as pos +, 250 4+ (urinalysis results), and reddish (urinalysis color results). SALT-C consists of five steps. First, it applies data cleaning rules to categorical laboratory data. Second, it categorizes the cleaned data into 5 predefined groups (urine color, urine dipstick, blood type, presence-finding, and pathogenesis tests). Third, all data in each group are vectorized. Fourth, similarity is calculated between the vectors of data and those of each value in the predefined value sets. Finally, the value closest to the data is assigned.ResultsThe performance of SALT-C was validated using 59,213,696 data points (167,938 unique values) generated over 23 years from a tertiary hospital. Apart from the data whose original meaning could not be interpreted correctly (eg, ** and _^), SALT-C mapped unique raw data to the correct reference value for each group with accuracy of 97.6% (123/126; urine color tests), 97.5% (198/203; (urine dipstick tests), 95% (53/56; blood type tests), 99.68% (162,291/162,805; presence-finding tests), and 99.61% (4643/4661; pathogenesis tests).ConclusionsThe proposed SALT-C successfully standardized the categorical laboratory test results with high reliability. SALT-C can be beneficial for clinical big data research by reducing laborious manual standardization efforts.

Project description:BackgroundResearch is the basis of advancement in health and wellbeing in modern societies. Our study aims to examine the funding policy of the Israel National Institute for Health Policy Research (NIHP), a national foundation responsible for assessing the impact of the national Health Insurance Law on health services in Israel. The study aims to evaluate the studies funded from 2010 to 2020, considering their publication in scientific literature and other channels that may influence decision-makers. We compare findings to a previous internal examination of studies funded by the NIHP during 1996-2014. Our paper presents an approach for measuring the impact of health policy research.MethodsAll 378 studies funded by NIHP during the specified years were identified. Objective data were gathered by investigating scientific literature across three datasets: Web of Science (WOS), PubMed, and Google Scholar, including journal impact factor, quarterly index, and citation metrics. Concurrently, a questionnaire was developed to collect additional and subjective data from principal investigators of the funded research projects.ResultsIn the final sample of 364 studies funded by NIHP from 2010 to 2020, after 11 were cancelled, and 3 were duplicates. 436 publications were retrieved in peer-reviewed journals. The average time elapsed from funding to scientific publication was 4.65 years. Metric parameters for the top publications of 231 funded studies with at least one publication in peer-reviewed journals revealed an average journal impact factor of 5.97 points and an average of 7.82 citations according to WOS and 14 citations according to Google Scholar. A comparison to 459 funded studies from 1996 to 2014 found a twofold increase in the impact factor. Nearly half of the principal investigators reported some influence on policy processes in the questionnaires, and the majority of the studies were also reported in popular media outlets.ConclusionsThe study provides an overview of the quality and potential influence of studies funded by NIHP, dedicated to supporting research in the field of health policy in Israel. Some of the findings are supported by results from similar inquiries. Several recommendations are introduced to enhance the quality and impact of the funded studies.

Project description:BackgroundEarly life impairments leading to lower lung function by adulthood are considered as risk factors for chronic obstructive pulmonary disease (COPD). Recently, we compared the lung transcriptomic profile between two mouse strains with extreme total lung capacities to identify plausible pulmonary function determining genes using microarray analysis (GSE80078). Advancement of high-throughput techniques like deep sequencing (eg. RNA-seq) and microarray have resulted in an explosion of genomic data in the online public repositories which however remains under-exploited. Strategic curation of publicly available genomic data with a mouse-human translational approach can effectively implement "3R- Tenet" by reducing screening experiments with animals and performing mechanistic studies using physiologically relevant in vitro model systems. Therefore, we sought to analyze the association of functional variations within human orthologs of mouse lung function candidate genes in a publicly available COPD lung RNA-seq data-set.MethodsAssociation of missense single nucleotide polymorphisms, insertions, deletions, and splice junction variants were analyzed for susceptibility to COPD using RNA-seq data of a Korean population (GSE57148). Expression of the associated genes were studied using the Gene Paint (mouse embryo) and Human Protein Atlas (normal adult human lung) databases. The genes were also assessed for replication of the associations and expression in COPD-/mouse cigarette smoke exposed lung tissues using other datasets.ResultsSignificant association (p < 0.05) of variations in 20 genes to higher COPD susceptibility have been detected within the investigated cohort. Association of HJURP, MCRS1 and TLR8 are novel in relation to COPD. The associated ADAM19 and KIT loci have been reported earlier. The remaining 15 genes have also been previously associated to COPD. Differential transcript expression levels of the associated genes in COPD- and/ or mouse emphysematous lung tissues have been detected.ConclusionOur findings suggest strategic mouse-human datamining approaches can identify novel COPD candidate genes using existing datasets in the online repositories. The candidates can be further evaluated for mechanistic role through in vitro studies using appropriate primary cells/cell lines. Functional studies can be limited to transgenic animal models of only well supported candidate genes. This approach will lead to a significant reduction of animal experimentation in respiratory research.

Dataset Information

A New Strategy for Evaluating the Quality of Laboratory Results for Big Data Research: Using External Quality Assessment Survey Data (2010-2020).

Background

Methods

Results

Conclusions

Publications

A New Strategy for Evaluating the Quality of Laboratory Results for Big Data Research: Using External Quality Assessment Survey Data (2010-2020).

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets