Dataset Information

A Comprehensive Statistical Framework for Determination of Commutability, Accuracy, and Agreement in Clinical DNAemia Assays.

ABSTRACT: Despite advances in the standardization of quantitative DNAemia tests and efforts to better understand and characterize the performance of reference materials in different assays, it remains unclear how the commutability performance of reference materials is related to intra- and interassay agreement. Building upon previous work, we describe a comprehensive framework to determine the relationship of commutability with assay accuracy and agreement. The use of this framework is illustrated using previously generated data regarding the performance of four quantitative Epstein-Bar virus (EBV) PCR assays with the WHO and ABI standards as examples. The use of these statistical tools can link the performance characteristics of one or more assays with predetermined clinical decision limits and may help improve the development, validation, and clinical utility of such DNAemia tests.

SUBMITTER: Tang L

PROVIDER: S-EPMC6322474 | biostudies-literature | 2019 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A Comprehensive Statistical Framework for Determination of Commutability, Accuracy, and Agreement in Clinical DNAemia Assays.

Tang L L Su Y Y Gu Z Z Caliendo A M AM Pounds S S Hayden R T RT

Journal of clinical microbiology 20190102 1

Despite advances in the standardization of quantitative DNAemia tests and efforts to better understand and characterize the performance of reference materials in different assays, it remains unclear how the commutability performance of reference materials is related to intra- and interassay agreement. Building upon previous work, we describe a comprehensive framework to determine the relationship of commutability with assay accuracy and agreement. The use of this framework is illustrated using p ...[more]

PMID: 30381420

Similar Datasets

Project description:Quantitative testing of BK virus (BKPyV) nucleic acid has become the standard of care in transplant patients. While the relationship between interassay harmonization and commutability has been well characterized for other transplant-related viruses, it has been less well studied for BKPyV, particularly regarding differences in commutability between matrices. Here, interassay agreement was evaluated among six real-time nucleic acid amplification tests (NAATs) and one digital PCR (dPCR) BKPyV assay. Differences in the commutability of three quantitative standards was examined across all assays using a variety of statistical approaches. Panels, including 40 samples each of plasma and urine samples previously positive for BKPyV, together with one previously negative plasma sample and four previously negative urine samples, were tested using all assays, with each real-time NAAT utilizing its usual quantitative calibrators. Serial dilutions of WHO, National Institute for Standards and Technology (NIST), and commercially produced (Exact/Bio-Rad) reference materials were also run by each assay as unknowns. The agreement of the clinical sample values was assessed as a group and in a pairwise manner. The commutability was estimated using both relativistic and quantitative means. The quantitative agreement across assays in the urine samples was within a single log10 unit across all assays, while the results from the plasma samples varied by 2 to 3 log10 IU/mL. The commutability showed a similar disparity between the matrices. Recalibration using international standards diminished the resulting discrepancies in some but not all cases. Differences in the sample matrix can affect the commutability and interassay agreement of quantitative BKPyV assays. Differences in commutability between matrices may largely be due to factors other than those such as amplicon size, previously described as important in the case of cytomegalovirus. Continued efforts to standardize viral load measurements must address multiple sources of variability and account for differences in assay systems, quantitative standards, and sample matrices.

Project description:BackgroundHBV DNA is the most important molecular marker in hepatitis B, used to determine treatment indication and monitoring. Most patients require lifelong hepatitis B virus (HBV) management, thus viral load (VL) monitoring may be performed at different laboratories, with different HBV assays, which may result in different VL results. This multicenter study compares the commutability and concordance of results from four different HBV DNA assays: CAP/CTM HBVv2, HPS/CTM HBVv2 and the new cobas 6800/8800 HBV and cobas 4800 HBV assays.MethodsAcross all four assays, HBV limit of detection (LoD) and linearity at lower concentrations were assessed using panels traceable to the World Health Organization international standard, and concordance was investigated at the important medical decision cutoffs 2000 and 20,000 IU/ml, using specimens from HBV-positive patients.ResultsThe calculated LoD via a probit curve was 2.7 IU/ml for cobas 6800/8800 HBV, 2.8 IU/ml for cobas 4800 HBV, 9.6 IU/ml for CAP/CTM HBVv2, and 6.2 IU/ml for HPS/CTM HBVv2. The average accuracy was comparable between cobas 6800/8800 HBV, cobas 4800 HBV and CAP/CTM HBVv2 (0.04-0.05 log10 IU/ml), while a slightly lower accuracy was documented for HPS/CTM HBVv2 (-0.16 log10 IU/ml). A total of 211-245 clinical samples were used for a pairwise comparison. Mean paired log differences ranged from -0.17 log10 IU/ml to -0.01 log10 IU/ml. Coefficient of determination was over 98% for all pairs with high overall percent agreement at the 2000 and 20,000 IU/ml cutoffs (from 91.7% to 96.3%). In a subset of samples with VL±0.5 log10 to the 2000 and 20,000 IU/ml thresholds, concordance was still 72% and 82%, respectively.ConclusionsThe new cobas 6800/8800 HBV and 4800 HBV assays show high accuracy in samples with low-level viremia and a high concordance with the established HBV tests, CAP/CTM HBVv2 and HPS/CTM HBVv2, at 2000 and 20,000 IU/ml. Thus, all four HBV assays have high commutability and may be used interchangeably in routine clinical practice.

Dataset Information

A Comprehensive Statistical Framework for Determination of Commutability, Accuracy, and Agreement in Clinical DNAemia Assays.

Publications

A Comprehensive Statistical Framework for Determination of Commutability, Accuracy, and Agreement in Clinical DNAemia Assays.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets