Dataset Information

A reliability study of colour-Doppler sonography for the diagnosis of chronic cerebrospinal venous insufficiency shows low inter-rater agreement.

ABSTRACT:

Objective

Chronic cerebrospinal venous insufficiency (CCSVI) has been extremely variable, associated with multiple sclerosis in colour-Doppler sonographic studies. We aimed to evaluate inter-rater agreement in a colour-Doppler sonography venous examination.

Design

Inter-rater agreement study.

Setting

First-referral multiple sclerosis centre.

Participants

38 patients with multiple sclerosis and 55 age-matched (±5 years) controls.

Intervention

Sonography was carried out in accordance with Zamboni's five criteria by eight sonographers with different expertise, blinded to the status of cases and controls. Each participant was evaluated by two operators.

Primary and secondary outcome measures

Inter-rater agreement was measured through the κ statistics and the intraclass correlation coefficient.

Results

The agreement was no higher than chance for criterion 2-reflux in the deep cerebral veins (κ=-0.02) and criterion 4-flow not Doppler detectable in one or both the internal jugular veins (IJVs) or vertebral veins (VVs; -0.09). It was substantially low for criterion 1-reflux in the IJVs and/or VVs (0.29), criterion 3-IJV stenosis or malformations (0.23) and criterion 5-absence of IJV diameter increase when passing from the sitting to the supine position (0.22). The κ value for CCSVI as a whole was 0.20 (95% confidence limit -0.01 to 0.42). Intraclass correlation coefficients for the measure of cross-sectional area ranged from 0.05 to 0.25. Inter-rater agreement was low for CCSVI experts (κ=0.24; -0.11 to 0.59) and non-experts (0.20; -0.33 to 0.73); neurologists (0.21; -0.06 to 0.47) and non-neurologists (0.18; -0.20 to 0.56); cases (0.19; -0.14 to 0.52) and controls (0.21; -0.08 to 0.49). Zamboni-trained neurosonographers ascertained CCSVI more frequently than the non-trained neurosonographers.

Conclusions

Agreement was unsatisfactory for the diagnosis of CCSVI as a whole, for each of its five criteria and according to the different subgroups. Standardisation of the method is urgently needed prior to its further application in studies of patients with multiple sclerosis or other neurological diseases.

SUBMITTER: Leone MA

PROVIDER: S-EPMC3831103 | biostudies-literature | 2013 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A reliability study of colour-Doppler sonography for the diagnosis of chronic cerebrospinal venous insufficiency shows low inter-rater agreement.

Leone Maurizio A MA Raymkulova Olga O Lucenti Ausiliatrice A Stecco Alessandro A Bolamperti Laura L Coppo Lorenzo L Liboni William W Rivadossi Gianandrea G Zaccala Giuseppe G Maggio Maurizio M Melis Fabio F Giaccone Claudia C Carriero Alessandro A Lochner Piergiorgio P

BMJ open 20131115 11

<h4>Objective</h4>Chronic cerebrospinal venous insufficiency (CCSVI) has been extremely variable, associated with multiple sclerosis in colour-Doppler sonographic studies. We aimed to evaluate inter-rater agreement in a colour-Doppler sonography venous examination.<h4>Design</h4>Inter-rater agreement study.<h4>Setting</h4>First-referral multiple sclerosis centre.<h4>Participants</h4>38 patients with multiple sclerosis and 55 age-matched (±5 years) controls.<h4>Intervention</h4>Sonography was car ...[more]

PMID: 24240139

Similar Datasets

Project description:Background: Arterial Doppler Ultrasound waveform (DW) analysis allows the detection and evaluation of lower extremity peripheral artery disease. The high heterogeneity of the reported description of DW is reduced by the use of classification. However, the reliability of these classifications is either unknown or low to moderate and practices of vascular caregivers regarding the use of these classifications remain unknown. Aims: This study aims to assess the inter-observer reliability of the Saint-Bonnet classification, a 13-category DW classification. The secondary objective was to determine the utilization rate of the most common classifications and the ability of these classifications to describe DW. Methods: A national survey was conducted among all vascular physicians of French society of vascular medicine. They were invited by email to describe on a website 20 DW without and with the display of the Saint-Bonnet classification. The reliability of this classification was estimated by Fleiss' Kappa expressed with [95% confidence interval]. A semantic analysis allowed us to classify the physicians' responses according to the terms used. Finally we have evaluated for each classification the rate of misuse, i.e., the addition of a complementary term to the defined categories. Results: One hundred and ten physicians participated and only 5% of these were familiar with Saint-Bonnet classification. Fifty-four percent of vascular physicians used no classification at all. Vascular physicians used the Spronk (four-category), Descotes (five-category) and Saint-Bonnet (13-category) classifications for respectively, 31, 10, and 5%. Kappa coefficient of Fleiss (κ) was 0.546 [0.544-0.547] (p < 0.001). Reliability by category ranges from κ of 0.075 to 0.864. In multivariate analysis, the use of a classification was associated with fewer years of experience and was dependent on geographic location. Misuse rate by classification was 88, 82, and 5% using Spronk, Descotes and Saint-Bonnet classifications respectively. Conclusion: The reliability of Saint-Bonnet classification is weak to moderate by vascular physicians who are not familiar with its use. However, unlike the other classifications, it seems to be sufficiently precise so that the user does not need to complete its description. There is a significant heterogeneity in the use of arterial Doppler classifications in France.

Project description:PurposeHaemodialysis provides various options for vascular access, including native arteriovenous fistulas (AVFs), arteriovenous grafts (AVGs), and central intravenous catheters. However, the use of catheters should be avoided due to their association with greater risks when opposed to AVFs or AVGs. AVFs have garnered strong endorsement as the favoured vascular access choice for extended haemodialysis.Material and methodsA total of 200 patients initially diagnosed with AVF/AVG dysfunction were referred to the radiology department across 3 different institutions. The inclusion criteria involved patients who encountered repeated difficulties with access cannulation during dialysis. Conversely, the exclusion criteria comprised cases that had been solely assessed using colour Doppler ultrasound (CDUS), those exclusively evaluated with digital subtraction angiography (DSA), situations where DSA was not feasible, instances requiring immediate intervention due to acute access failure, and cases in which patients refused participation.ResultsInter-observer agreement regarding complications of AVF/AVG was very good for the identification of thrombus (κ = 1.0), seroma (κ = 0.953), aneurysm (κ = 0.851), and pseudoaneurysm (κ = 0.851). It was considered good for the detection of juxta-anastomosis stenosis (κ = 0.751) and feeding artery stenosis (κ = 0.638). However, he agreement was fair for identifying draining vein stenosis (κ = 0.380) and distal arterial steal syndrome (κ = 0.210). The overall diagnostic performance of CDUS exhibited 86% sensitivity in identifying stenosis, with a specificity of 99.1%, a positive predictive value (PPV) of 96.5%, a negative predictive value (NPV) of 97%, and an accuracy of 94.3%.ConclusionsCDUS is a noninvasive diagnostic approach for the prompt picking of AVF complications. It serves as a suitable first-line imaging modality for nonfunctional AVF due to its cost-effectiveness and accessibility. Additionally, we provide evidence of reproducibility, encouraging the diligent use of CDUS in AVF and AVG evaluation for early complication detection and management guidance.

Dataset Information

A reliability study of colour-Doppler sonography for the diagnosis of chronic cerebrospinal venous insufficiency shows low inter-rater agreement.

Objective

Design

Setting

Participants

Intervention

Primary and secondary outcome measures

Results

Conclusions

Publications

A reliability study of colour-Doppler sonography for the diagnosis of chronic cerebrospinal venous insufficiency shows low inter-rater agreement.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets