Dataset Information

Development of and Preliminary Validity Evidence for the EFeCT Feedback Scoring Tool.

ABSTRACT:

Background

Narrative feedback, like verbal feedback, is essential to learning. Regardless of form, all feedback should be of high quality. This is becoming even more important as programs incorporate narrative feedback into the constellation of evidence used for summative decision-making. Continuously improving the quality of narrative feedback requires tools for evaluating it, and time to score. A tool is needed that does not require clinical educator expertise so scoring can be delegated to others.

Objective

To develop an evidence-based tool to evaluate the quality of documented feedback that could be reliably used by clinical educators and non-experts.

Methods

Following a literature review to identify elements of high-quality feedback, an expert consensus panel developed the scoring tool. Messick's unified concept of construct validity guided the collection of validity evidence throughout development and piloting (2013-2020).

Results

The Evaluation of Feedback Captured Tool (EFeCT) contains 5 categories considered to be essential elements of high-quality feedback. Preliminary validity evidence supports content, substantive, and consequential validity facets. Generalizability evidence supports that EFeCT scores assigned to feedback samples show consistent interrater reliability scores between raters across 5 sessions, regardless of level of medical education or clinical expertise (Session 1: n=3, ICC=0.94; Session 2: n=6, ICC=0.90; Session 3: n=5, ICC=0.91; Session 4: n=6, ICC=0.89; Session 5: n=6, ICC=0.92).

Conclusions

There is preliminary validity evidence for the EFeCT as a useful tool for scoring the quality of documented feedback captured on assessment forms. Generalizability evidence indicated comparable EFeCT scores by raters regardless of level of expertise.

SUBMITTER: Ross S

PROVIDER: S-EPMC8848874 | biostudies-literature | 2022 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development of and Preliminary Validity Evidence for the EFeCT Feedback Scoring Tool.

Ross Shelley S Hamza Deena D Zulla Rosslynn R Stasiuk Samantha S Nichols Darren D

Journal of graduate medical education 20220201 1

<h4>Background</h4>Narrative feedback, like verbal feedback, is essential to learning. Regardless of form, all feedback should be of high quality. This is becoming even more important as programs incorporate narrative feedback into the constellation of evidence used for summative decision-making. Continuously improving the quality of narrative feedback requires tools for evaluating it, and time to score. A tool is needed that does not require clinical educator expertise so scoring can be delegat ...[more]

PMID: 35222824

Similar Datasets

Project description:Standard bioassays allow hazard assessment at the population level, but much remains to be learned about the molecular level response of organisms to stressors. The main aim of this study was the development of a DNA microarray for Enchytraeus albidus, a common soil worm species. Further, this microarray was tested using worms exposed to Cu, phenmedipham, and different soil types. Hybridization onto the developed microarray revealed several genes with homology to known sequences. Genes of interest were confirmed through real-time polymerase chain reaction. It was possible to discriminate between natural and chemical stressors and chemical concentrations. Gene responses were detected under conditions known to have effects in the reproduction of individuals. It was confirmed that the integration of different endpoints improves the assessment process and enhances the understanding of the modes of action of stressors. The chemical stressM-bM-^@M-^Sinduced genes were related to factors such as immune response, stress response, metabolic processes, and/or signal transduction. The present study represents the first step of a gene-level study in the ecologically relevant and standard test species E. albidus. It demonstrates the usefulness of cDNA normalization in the production of cDNA libraries of ecotoxicological standard organisms that are not genome models like E. albidus. Fluorescently labelled cDNA, from enchytraeids exposed during 2 days to control LUFA 2.2 (Cy3) soil and to the different exposure conditions (Cy5), was synthesized for microarray analysis and hybridizations were performed. After scanning, spots were identified and ratios quantified using the Genepix software 5.0 (Axon Instruments). Statistical analysis of the microarrays was performed using limmaGUI package (1.18.0) (Smyth, 2005) in the R (2.8.0) software environment (http://www.R-project.org/). After being submitted to local background subtraction, microarrays were normalized using global loess method. To statistically evaluate the differential gene expression between the different conditions, a gene-per-gene linear model (limma M-bM-^@M-^S linear model for microarray analysis) and empirical Bayes methods were applied. The results were then corrected for multiple testing using the Benjamini-HochbergM-bM-^@M-^Ys method (adjusted p<0.05 was considered significant) (Benjamini and Hochberg, 1995).

Dataset Information

Development of and Preliminary Validity Evidence for the EFeCT Feedback Scoring Tool.

Background

Objective

Methods

Results

Conclusions

Publications

Development of and Preliminary Validity Evidence for the EFeCT Feedback Scoring Tool.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets