Dataset Information

Interobserver variability in the classification of appendicitis during laparoscopy.

ABSTRACT:

Background

The intraoperative classification of appendicitis dictates the patient's postoperative management. Prolonged antibiotic prophylaxis is recommended for complex appendicitis (gangrenous, perforated, abscess), whereas preoperative prophylaxis suffices for simple appendicitis. Distinguishing these two conditions can be challenging. The aim of this study was to assess interobserver variability in the classification of appendicitis during laparoscopy.

Methods

Short video recordings taken during laparoscopy for suspected appendicitis were shown to surgeons and surgical residents. They were asked to: classify the appendix as indicative of no, simple or complex appendicitis; categorize the appendix as normal, phlegmonous, gangrenous, perforated and/or abscess; and decide whether they would prescribe postoperative antibiotics. Inter-rater reliability was evaluated using Fleiss' κ score and the S* statistic.

Results

Some 80 assessors participated in the study. Video recordings of 20 patients were used. Interobserver agreement was minimal for both the classification of appendicitis (κ score 0·398, 95 per cent c.i. 0·385 to 0·410) and the decision to prescribe postoperative antibiotic treatment (κ score 0·378, 0·362 to 0·393). Agreement was slightly higher when published criteria were applied (κ score 0·552, 0·537 to 0·568).

Conclusion

There is considerable variability in the intraoperative classification of appendicitis and the decision to prescribe postoperative antibiotic treatment.

SUBMITTER: van den Boom AL

PROVIDER: S-EPMC6033013 | biostudies-literature | 2018 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Interobserver variability in the classification of appendicitis during laparoscopy.

van den Boom A L AL de Wijkerslooth E M L EML Mauff K A L KAL Dawson I I van Rossem C C CC Toorenvliet B R BR Wijnhoven B P L BPL

The British journal of surgery 20180416 8

<h4>Background</h4>The intraoperative classification of appendicitis dictates the patient's postoperative management. Prolonged antibiotic prophylaxis is recommended for complex appendicitis (gangrenous, perforated, abscess), whereas preoperative prophylaxis suffices for simple appendicitis. Distinguishing these two conditions can be challenging. The aim of this study was to assess interobserver variability in the classification of appendicitis during laparoscopy.<h4>Methods</h4>Short video reco ...[more]

PMID: 29663311

Similar Datasets

Project description:To evaluate the interobserver variability in descriptions of breast masses by dedicated breast imagers and radiology residents and determine how any differences in lesion description affect the performance of a computer-aided diagnosis (CAD) computer classification system.Institutional review board approval was obtained for this HIPAA-compliant study, and the requirement to obtain informed consent was waived. Images of 50 breast lesions were individually interpreted by seven dedicated breast imagers and 10 radiology residents, yielding 850 lesion interpretations. Lesions were described with use of 11 descriptors from the Breast Imaging Reporting and Data System, and interobserver variability was calculated with the Cohen κ statistic. Those 11 features were selected, along with patient age, and merged together by a linear discriminant analysis (LDA) classification model trained by using 1005 previously existing cases. Variability in the recommendations of the computer model for different observers was also calculated with the Cohen κ statistic.A significant difference was observed for six lesion features, and radiology residents had greater interobserver variability in their selection of five of the six features than did dedicated breast imagers. The LDA model accurately classified lesions for both sets of observers (area under the receiver operating characteristic curve = 0.94 for residents and 0.96 for dedicated imagers). Sensitivity was maintained at 100% for residents and improved from 98% to 100% for dedicated breast imagers. For residents, the computer model could potentially improve the specificity from 20% to 40% (P < .01) and the κ value from 0.09 to 0.53 (P < .001). For dedicated breast imagers, the computer model could increase the specificity from 34% to 43% (P = .16) and the κ value from 0.21 to 0.61 (P < .001).Among findings showing a significant difference, there was greater interobserver variability in lesion descriptions among residents; however, an LDA model using data from either dedicated breast imagers or residents yielded a consistently high performance in the differentiation of benign from malignant breast lesions, demonstrating potential for improving specificity and decreasing interobserver variability in biopsy recommendations.

Project description:Annually, a vast number of patients visits the emergency department for acute wounds. Many wound classification systems exist, but often these were not originally designed for acute wounds. This study aimed to assess the most frequently used classifications for acute wounds in the Netherlands and the interobserver variability of the Gustilo Anderson wound classification (GAWC) and Red Cross wound classification (RCWC) in acute wounds. This multicentre cross-sectional survey study employed an online oral questionnaire. We contacted emergency physicians from eleven hospitals in the south-eastern part of the Netherlands and identified the currently applied classifications. Participants classified ten fictitious wounds by applying the GAWC and RCWC. Afterwards, they rated the user-friendliness of these classifications. We examined the interobserver variability of both classifications using a Fleiss' kappa analysis, with a subdivision in RCWC grades and types representing wound severity and injured tissue structures. The study included twenty emergency physicians from eight hospitals. Fifty percent of the participants reported using a classification for acute wounds, mostly the GAWC. The interobserver variability of the GAWC (κ = 0.46; 95% CI 0.44-0.49) and RCWC grades (κ = 0.56; 95% CI 0.53-0.59) was moderate, and it was good for the RCWC types (κ = 0.69; 95% CI 0.66-0.73). Participants considered both classifications helpful for acute wound assessment when the emergency physician was less experienced, despite a moderate user-friendliness. The GAWC was only of additional value in wounds with fractures, whereas the RCWC's additional value in acute wound assessment was independent of the presence of a fracture. Emergency physicians are reserved to use a classification for acute wound assessment. The interobserver variability of the GAWC and RCWC in acute wounds is promising, and both classifications are easy to apply. However, their user-friendliness is moderate. It is recommended to apply the GAWC to acute wounds with underlying fractures and the RCWC to major traumatic injuries. Awareness should be raised of existing wound classifications, specifically among less experienced healthcare professionals.

Project description:BackgroundEducational video datasets can be an effective method for training in emergency department (ED) point-of-care ultrasound (PoCUS). A video dataset for normal appendix and appendicitis in children using ED PoCUS images was developed to assess interobserver agreement, as measured by Cohen's Kappa on key sonographic findings.MethodsThree sets of 25 ED PoCUS videos were selected and curated from pediatric patients with normal appendix and acute appendicitis. Four participant ED sonologist-physicians were trained on the first set of 25 videos showing normal appendix or normal bowel in patients without appendicitis to note if normal appendix was seen in any part or in it's entirety from tip-to-cecum. They were then tested on the second set of similar videos. A third set of 25 videos from patients who had appendicitis where participant sonologists were asked to note if appendicitis was present or absent, with and without appendicolith or perforation. Cohen's Kappa was calculated in aggregate and stratified by experience vs. novice against a senior sonologist-physician aware of all patient outcomes for visualization of: 1. any part of normal appendix, 2. normal appendix visualized from tip to cecum 3. any part of appendicitis, 4. appendicolith, 5. appendiceal perforation.ResultsCohen's Kappa for any part of normal appendix, 0.71, 95% CI (0.58-0.85); normal appendix tip-to-cecum, 0.43, 95% CI (0.19-0.67), appendicitis, 0.53, 95%CI (0.34-0.70), appendicolith, 0.63, 95%CI (0.43-0.84), perforated appendicitis, 0.46, 95%CI (0.22-0.70). Stratified by experienced vs. novice: any part of normal appendix, 0.75 vs. 0.68; normal appendix tip-to-cecum, 0.50 vs. 0.36; appendicitis, 0.78 vs. 0.31; appendicolith, 0.75 vs. 0.5; perforated appendicitis, 0.5 vs 0.42.ConclusionsThis educational video dataset may be used to train sonologist-physicians in ED PoCUS scanning for normal appendix and appendicitis in children. Sonologist experience affected interobserver agreement with respect to visualization of entire normal appendix and appendicitis.

Project description:The aim of this study was to evaluate the reproducibility of myocardial blood flow (MBF) and myocardial flow reserve (MFR) measurement in patients referred for dynamic SPECT. Methods: We retrospectively analyzed patients referred for myocardial perfusion imaging. SPECT data were acquired on a cadmium zinc telluride-based pinhole cardiac camera in list mode using a stress (251 ± 15 MBq)/rest (512 ± 26 MBq) 1-d 99mTc-tetrofosmin protocol. Kinetic analyses were done with software using a 1-tissue-compartment model and converted to MBF using a previously determined extraction fraction correction. MFR was analyzed and compared globally and regionally. Motion detection was applied, but not attenuation correction. Results: In total, 124 patients (64 male, 60 female) were included, and SPECT acquisitions were twice reconstructed by the same nuclear medicine board-certified physician for 50 patients and by 2 different physicians for 74. Both intra- and interobserver measurements of global MFR had no significant bias (-0.01 [P = 0.94] and 0.01 [P = 0.67], respectively). However, rest MBF and stress MBF were significantly different in global left ventricular evaluation (P = 0.001 and P = 0.002, respectively) and in the anterior territory (P < 0.0001) on interuser analysis. The average coefficient of variation was 15%-30% of the mean stress MBF if the analysis was performed by the same physician or 2 different physicians and was around 20% of the mean MFR independently of the processing physician. Using the MFR threshold of 2, we noticed good intrauser agreement, whereas it was moderate when the users were different (κ = 0.75 [95% CI, 0.56-0.94] vs. 0.56 [95% CI, 0.36-0.75], respectively). Conclusion: Repeated measurements of global MFR by the same physician or 2 different physicians were similar, with an average coefficient of variation of 20%. Better reproducibility was achieved for intrauser MBF evaluation. Automation of processing is needed to improve reproducibility.

Dataset Information

Interobserver variability in the classification of appendicitis during laparoscopy.

Background

Methods

Results

Conclusion

Publications

Interobserver variability in the classification of appendicitis during laparoscopy.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets