The Diagnostic Performance Feedback "Calibration Gap": Why Clinical Experience Alone Is Not Enough to Prevent Serious Diagnostic Errors.
Ontology highlight
ABSTRACT:
SUBMITTER: Omron R
PROVIDER: S-EPMC6194049 | biostudies-literature | 2018 Oct
REPOSITORIES: biostudies-literature
Publications
The Diagnostic Performance Feedback "Calibration Gap": Why Clinical Experience Alone Is Not Enough to Prevent Serious Diagnostic Errors.
Omron Rodney R Kotwal Susrutha S Garibaldi Brian T BT Newman-Toker David E DE
AEM education and training 20180917 4
Similar Datasets
Project description:BackgroundAn experimenter controlled form of reflection has been shown to improve the detection and correction of diagnostic errors in some situations; however, the benefits of participant-controlled reflection have not been assessed.ObjectiveThe goal of the current study is to examine how experience and a self-directed decision to reflect affect the accuracy of revised diagnoses.DesignMedical residents diagnosed 16 medical cases (pass 1). Participants were then given the opportunity to reflect on each case and revise their diagnoses (pass 2).ParticipantsForty-seven medical Residents in post-graduate year (PGY) 1, 2 and 3 were recruited from Hamilton Health Care Centres.Main measuresDiagnoses were scored as 0 (incorrect), 1 (partially correct) and 2 (correct). Accuracies and response times in pass 1 were analyzed using an ANOVA with three factors-PGY, Decision to revise yes/no, and Case 1-16, averaged across residents. The extent to which additional reflection affected accuracy was examined by analyzing only those cases that were revised, using a repeated measures ANOVA, with pass 1 or 2 as a within subject factor, and PGY and Case or Resident as a between-subject factor.Key resultsThe mean score at pass 1 for each level was PGY1, 1.17 (SE 0.50); PGY2, 1.35 (SE 0.67) and PGY3, 1.27 (SE 0.94). While there was a trend for increased accuracy with level, this did not achieve significance. The number of residents at each level who revised at least one diagnosis was 12/19 PGY1 (63 %), 9/11 PGY2 (82 %) and 8/17 PGY3 (47 %). Only 8 % of diagnoses were revised resulting in a small but significant increase in scores from Pass 1 to 2, from 1.20/2 to 1.22 /2 (t = 2.15, p = 0.03).ConclusionsParticipants did engage in self-directed reflection for incorrect diagnoses; however, this strategy provided minimal benefits compared to knowing the correct answer. Education strategies should be directed at improving formal and experiential knowledge.
| S-EPMC4539330 | biostudies-literature
Project description:ImportanceDespite widespread recognition and known harms, serious surgical errors, known as surgical never events, endure. The California Department of Public Health (CDPH) has developed an oversight system to capture never events and a platform for process improvement that has not yet been critically appraised.ObjectivesTo examine surgical never events occurring in hospitals in California and summarize recommendations to prevent future events.Design, setting, and participantsThis cross-sectional study identified 386 CDPH hospital administrative penalty reports, of which 142 were ascribable to never events occurring during surgery. These never events were identified and summarized from January 1, 2007, to December 31, 2017. A directed qualitative approach was used to analyze CDPH-mandated corrective steps to reduce future errors in this multicenter study of all accredited hospitals in California. Inclusion of surgical never event records was based on definitions established by the US Department of Health and Human Services National Quality Forum. Data analysis was performed from January 1, 2019, to November 30, 2020.ExposuresNever events include death or disability of an American Society of Anesthesiologists class I patient, wrong site or wrong surgery, retained foreign objects, burns, equipment failure leading to intraoperative injury, nonapproved experimental procedures, insufficient surgeon presence or privileges, or fall from the operating room table.Main outcomes and measuresIncident rates, consequences, and improvement plans to prevent additional never events were outcomes of interest.ResultsA total of 142 never events were reported to the CDPH (1 per 200 000 operations). Annual surgical volume for hospitals with events was 9203 vs 3251 cases for hospitals without events (P < .001). A total of 94 of 142 events (66.2%) were retained foreign objects ranging from Kocher clamps to drain sponges. Wrong site or patient surgery accounted for 22 events (15.5%), surgical burns for 11 (7.7%), and other for 15 (10.6%). Other included insufficient surgeon presence, equipment failure, or falls in the operating room. Improvement plans included 18 unique categories of recommendations from regulators, many focusing on proper use of checklists. Regulators mandated a mean (SD) of 13 (7) corrective actions in the improvement plans. Policy adherence monitoring (119 [90.2%]), revision of existing policy (84 [63.6%]), and education regarding policy (83 [62.9%]) were common action items, whereas disciplinary action toward staff was rare (11 [8.3%]).Conclusions and relevanceSurgical never events are a rare issue in California. Numerous strategies have evolved to reduce errors, many involving the thorough and proper use of intraoperative checklists.
| S-EPMC8094010 | biostudies-literature
Project description:Serious games show a lot of potential for use in movement rehabilitation (eg, after a stroke, injury to the spinal cord, or limb loss). However, the nature of this research leads to diversity both in the background of the researchers and in the approaches of their investigation. Our close examination and categorization of virtual training software for upper limb prosthetic rehabilitation found that researchers typically followed one of two broad approaches: (1) focusing on the game design aspects to increase engagement and muscle training and (2) concentrating on an accurate representation of prosthetic training tasks, to induce task-specific skill transfer. Previous studies indicate muscle training alone does not lead to improved prosthetic control without a transfer-enabling task structure. However, the literature shows a recent surge in the number of game-based prosthetic training tools, which focus on engagement without heeding the importance of skill transfer. This influx appears to have been strongly influenced by the availability of both software and hardware, specifically the launch of a commercially available acquisition device and freely available high-profile game development engines. In this Viewpoint, we share our perspective on the current trends and progress of serious games for prosthetic training.
| S-EPMC8663510 | biostudies-literature
Project description:BackgroundsThe laboratory plays a critical role in tuberculosis (TB) control by providing testing for diagnosis, treatment monitoring, and surveillance at each level of the health care system. Weak accessibility to TB diagnosric services still represents a big concern in many limited resources' countries. Here we report the experience of Burkina Faso in implementing a comprehensive intervention packages to strengthen TB laboratory capacity and diagnostic accessibility.MethodsThe intervention lasted from October 2016 to December 2018 and focused on two main areas: i) development of strategic documents and policies; ii) implementation of TB diagnostic technology. National TB laboratory data were collected between 2016 and 2018 and evaluated according to five programmatic TB laboratory indicators: i) Percentage of notified new and relapse TB cases with bacteriological confirmation; ii) Percentage of notified new and relapse TB cases tested by Xpert MTB/RIF; iii) Percentage of notified, bacteriologically confirmed TB cases with a drug susceptibility testing (DST) result for rifampin; iv) Percentage of notified MDR-TB cases on the estimated number of MDR-TB cases; v) The ration between the number of smear microscopy and Xpert MTB/RIF tests. We compared these indicators between a 1 year (2016-2017) and 2 years (2016-2018) timeframe.ResultsFrom 2016 to 2018, the percentage of bacteriologically confirmed cases increased from 67 to 71%. The percentage of new and relapse TB cases notified tested by Xpert MTB/RIF increased from 18% in 2016 to 46% in 2018 and the percentage of bacteriologically confirmed cases with an available DST result for rifampicin increased from 27% in 2016 to 66% in 2018.. The percentage of notified MDR-TB cases on the estimated number of MDR-TB cases in 2018 increased from 43% in 2016 to 78% in 2018. In 2018, the ratio between the number of smear microscopy and Xpert MTB/RIF tests decreased from 53% in 2016 to 21% in 2018.ConclusionWe demonstrated that the implementation of a comprehensive package of laboratory strengthening interventions led to a significant improvement of all indicators. External technical assistance played a key role in speeding up the TB laboratory system improvement process.
| S-EPMC8042973 | biostudies-literature
Project description: Not available
| S-EPMC9562499 | biostudies-literature
Project description:PurposeIn this study, we retrospectively reviewed the use of flow cytometry (FCM) in the diagnosis of inborn errors of immunity (IEIs) at a single center in Algeria. Sharing insights into our practical experience, we present FCM based diagnostic approaches adapted to different clinical scenarios.MethodsBetween May 2017 and February 2024, pediatric and adult patients presenting with clinical features suggestive of immunodeficiency were subjected to FCM evaluation, including lymphocyte subset analysis, detection of specific surface or intracellular proteins, and functional analysis of immune cells.ResultsOver a nearly seven-year period, our laboratory diagnosed a total of 670 patients (372 (55.5%) males and 298 (44.5%) females), distributed into 70 different IEIs belonging to 9 different categories of the International Union of Immunological Societies classification. FCM was used to diagnose and categorize IEI in 514 patients (76.7%). It provided direct diagnostic insights for IEIs such as severe combined immunodeficiency, Omenn syndrome, MHC class II deficiency, familial hemophagocytic lymphohistiocytosis, and CD55 deficiency. For certain IEIs, including hyper-IgE syndrome, STAT1-gain of function, autoimmune lymphoproliferative syndrome, and activated PI3K delta syndrome, FCM offered suggestive evidence, necessitating subsequent genetic testing for confirmation. Protein expression and functional assays played a crucial role in establishing definitive diagnoses for various disorders. To setup such diagnostic assays at high and reproducible quality, high level of expertise is required; in house reference values need to be determined and the parallel testing of healthy controls is highly recommended.ConclusionFlow cytometry has emerged as a highly valuable and cost-effective tool for diagnosing and studying most IEIs, particularly in low-income countries where access to genetic testing can be limited. FCM analysis could provide direct diagnostic insights for most common IEIs, offer clues to the underlying genetic defects, and/or aid in narrowing the list of putative genes to be analyzed.
| S-EPMC11273131 | biostudies-literature
Project description:BackgroundHuman inborn errors of immunity (IEI) are a group of inherited genetic disorders of the immune system. IEI Patients suffer from severe repeated infections, autoimmunity, lymphadenopathy and/or increased susceptibility to malignancies. IEI are due to absence, disproportion, or loss of function of immune cells; mostly inherited in autosomal recessive manner, hence are more common in countries with high rate of consanguinity. Definite diagnosis of IEI is achieved by genetic analysis, however it is not always available.Aimto report on different IEI categories and impact of expanding the use of flow cytometry (FCM) in diagnosis, categorization and follow up of IEI patients in a highly consanguineous population.MethodsRetrospective chart review on different IEI categories diagnosed at the primary immunodeficiency center in Cairo University Specialized Pediatric hospital from 2011 to 2021 based on expanding the use of FCM.Results1510 IEI patients were diagnosed; 480 were diagnosed genetically with FMF, 11 with cystic fibrosis and 1019 patients were diagnosed with other IEI disorders. Phagocytic defects were the commonest (30%) followed by severe combined immunodeficiency (22%) and combined immunodeficiency (18.3%). FCM testing properly diagnosed and categorized 73% of the cases.ConclusionUsing multi-color FCM to evaluate immune cells populations, subpopulations, functions, and intracellular proteins expression is proved a useful cost-effective method for screening, categorization and follow up of IEI patients. FCM can improve the diagnosis of IEI significantly when tests are properly targeted and well designed. This study presents a 10-year experience in diagnosis of IEI using FCM at a tertiary referral center in a setting of limited resources and yet high prevalence of IEI.
| S-EPMC9164555 | biostudies-literature
Project description:BackgroundSerious games for medical education have seen a resurgence in recent years, partly due to the growth of the video game industry and the ability of such games to support learning achievements. However, there is little consensus on what the serious and game components in a serious game are composed of. As a result, electronic learning (e-learning) and medical simulation modules are sometimes mislabeled as serious games. We hypothesize that one of the main reasons is the difficulty for a medical educator to systematically and accurately evaluate key aspects of serious games.ObjectiveThis study aimed to identify markers that can evaluate serious games and distinguish between serious games, entertainment games, and e-learning.MethodsJabareen's eight-phase framework-building procedure was used to identify the core markers of a serious game. The procedure was modified slightly to elicit "diagnostic criteria" as opposed to its original purpose of a conceptual framework. Following the identification of purported markers, the newly developed markers were tested on a series of freely available health care serious games-Dr. Game Surgeon Trouble, Staying Alive, and Touch Surgery-and the results were compared to the published test validity for each game.ResultsDiagnostic criteria for serious games were created, comprising the clusters of User Experience (UX), Play, and Learning. Each cluster was formed from six base markers, a minimum of four of which were required for a cluster to be considered present. These criteria were tested on the three games, and Dr. Game Surgeon Trouble and Staying Alive fit the criteria to be considered a serious game. Touch Surgery did not meet the criteria, but fit the definition of an e-learning module.ConclusionsThe diagnostic criteria appear to accurately distinguish between serious games and mediums commonly misidentified as serious games, such as e-learning modules. However, the diagnostic criteria do not determine if a serious game will be efficacious; they only determine if it is a serious game. Future research should include a much larger sample of games designed specifically for health care purposes.
| S-EPMC6664662 | biostudies-literature
Project description:Measurement error arises through a variety of mechanisms. A rich literature exists on the bias introduced by covariate measurement error and on methods of analysis to address this bias. By comparison, less attention has been given to errors in outcome assessment and nonclassical covariate measurement error. We consider an extension of the regression calibration method to settings with errors in a continuous outcome, where the errors may be correlated with prognostic covariates or with covariate measurement error. This method adjusts for the measurement error in the data and can be applied with either a validation subset, on which the true data are also observed (eg, a study audit), or a reliability subset, where a second observation of error prone measurements are available. For each case, we provide conditions under which the proposed method is identifiable and leads to consistent estimates of the regression parameter. When the second measurement on the reliability subset has no error or classical unbiased measurement error, the proposed method is consistent even when the primary outcome and exposures of interest are subject to both systematic and random error. We examine the performance of the method with simulations for a variety of measurement error scenarios and sizes of the reliability subset. We illustrate the method's application using data from the Women's Health Initiative Dietary Modification Trial.
| S-EPMC8670514 | biostudies-literature
Project description:Background Cell therapy based on macrophages is promising in solid tumors, but effective acquisition of macrophages is a challenge. Induced pluripotent stem cell (iPSC)-induced macrophages are a good source but are time-consuming and costly. Macrophages derived from somatic cells by reprogramming technologies have the potential to enable the development of cell-based therapies for numerous malignant diseases. Methods The composition of CD45+ myeloid-like cell complex (MCC) was analyzed by flow cytometry and single-cell sequencing. The engraftment capacity of CD45+ MCC was evaluated by two transplantation assays. Regulation of c-myc on MafB was evaluated by ChIP-qPCR and promoter reporter and dual luciferase assays. The phenotype and phagocytosis of induced macrophages were explored by flow cytometry and immunofluorescence. Leukemia, breast cancer, and patient-derived tumor xenograft models were used to explore the anti-tumor function of induced macrophages. Results Here we report on the establishment of a novel methodology allowing for reprogramming fibroblasts into functional macrophages with phagocytic activity by c-Myc overexpression. Fibroblasts with ectopic expression of c-Myc in iPSC medium rapidly generated CD45+ MCC intermediates with engraftment capacity as well as the repopulation of distinct hematopoietic compartments. MCC intermediates were stably maintained in suspension culture and continuously generated functional and highly pure-induced macrophage (iMac) just by M-CSF cytokine stimulation. Single-cell transcriptomic analysis of MCC intermediates revealed that c-Myc up-regulates the expression of MafB, a major regulator of macrophage differentiation, to promote macrophage differentiation. Characterization of the iMac activity showed NF-κB signaling activation and a pro-inflammatory phenotype. iMac cells display significantly increased in vivo persistence and inhibition of tumor progression in leukemia, breast cancer, and patient-derived tumor xenograft models. Conclusions Our findings demonstrate that c-Myc alone is enough to reprogram fibroblasts into functional macrophages, supporting that c-Myc reprogramming strategy of fibroblasts could help circumvent long-standing obstacles to gaining “off-the-shelf” macrophages for anti-cancer immunotherapy. Keywords c-Myc, fibroblast, macrophage, immunotherapy, reprogramming
2024-09-18 | GSE275457 | GEO