Unknown

Dataset Information

0

How to evaluate and improve the quality and credibility of an outcomes database: validation and feedback study on the UK Cardiac Surgery Experience.


ABSTRACT:

Objectives

To assess the quality and completeness of a database of clinical outcomes after cardiac surgery and to determine whether a process of validation, monitoring, and feedback could improve the quality of the database.

Design

Stratified sampling of retrospective data followed by prospective re-sampling of database after intervention of monitoring, validation, and feedback.

Setting

Ten tertiary care cardiac surgery centres in the United Kingdom.

Intervention

Validation of data derived from a stratified sample of case notes (recording of deaths cross checked with mortuary records), monitoring of completeness and accuracy of data entry, feedback to local data managers and lead surgeons.

Main outcome measures

Average percentage missing data, average kappa coefficient, and reliability score by centre for 17 variables required for assignment of risk scores. Actual minus risk adjusted mortality in each centre.

Results

The database was incomplete, with a mean (SE) of 24.96% (0.09%) of essential data elements missing, whereas only 1.18% (0.06%) were missing in the patient records (P<0.0001). Intervention was associated with (a) significantly less missing data (9.33% (0.08%) P<0.0001); (b) marginal improvement in reliability of data and mean (SE) overall centre reliability score (0.53 (0.15) v 0.44 (0.17)); and (c) improved accuracy of assigned Parsonnet risk scores (kappa 0.84 v 0.70). Mortality scores (actual minus risk adjusted mortality) for all participating centres fell within two standard deviations of the mean score.

Conclusion

A short period of independent validation, monitoring, and feedback improved the quality of an outcomes database and improved the process of risk adjustment, but with substantial room for further improvement. Wider application of this approach should increase the credibility of similar databases before their public release.

SUBMITTER: Fine LG 

PROVIDER: S-EPMC139501 | biostudies-literature | 2003 Jan

REPOSITORIES: biostudies-literature

altmetric image

Publications

How to evaluate and improve the quality and credibility of an outcomes database: validation and feedback study on the UK Cardiac Surgery Experience.

Fine Leon G LG   Keogh Bruce E BE   Cretin Shan S   Orlando Maria M   Gould Mairi M MM  

BMJ (Clinical research ed.) 20030101 7379


<h4>Objectives</h4>To assess the quality and completeness of a database of clinical outcomes after cardiac surgery and to determine whether a process of validation, monitoring, and feedback could improve the quality of the database.<h4>Design</h4>Stratified sampling of retrospective data followed by prospective re-sampling of database after intervention of monitoring, validation, and feedback.<h4>Setting</h4>Ten tertiary care cardiac surgery centres in the United Kingdom.<h4>Intervention</h4>Val  ...[more]

Similar Datasets

| S-EPMC9746893 | biostudies-literature
| S-EPMC1458546 | biostudies-literature
| S-EPMC10103723 | biostudies-literature
| S-EPMC8368112 | biostudies-literature
| S-EPMC8454590 | biostudies-literature
| S-EPMC6378396 | biostudies-literature
| S-EPMC10099756 | biostudies-literature
| S-EPMC7921022 | biostudies-literature
| S-EPMC6790311 | biostudies-literature
2007-12-08 | GSE9734 | GEO