Dataset Information

Low-Stakes, Growth-Oriented Testing in Large-Enrollment General Chemistry 1: Formulation, Implementation, and Statistical Analysis.

ABSTRACT: We formulate an alternative to high-stakes examinations that is designed to help students grow, and we describe its implementation in a large-enrollment General Chemistry 1 class. In our alternative grading approach, students complete weekly assessments. Each assessment has four items that are aligned to explicit learning objectives and a level in Marzano's taxonomy, retrieval, comprehension, analysis, and knowledge utilization, which can be used by students and instructors to gauge the progression of student learning. Proficiency-based grading and multiple attempts reduce the stakes of the assessments. Unique assessments are generated through a computational infrastructure that draws question stems from an item bank and further randomizes quantities, elements, compounds, reactions, spectra, Lewis structures, orbitals, etc. in the questions. Nearly all assessment items require student-generated responses and cover a complete General Chemistry 1 curriculum. We interpret Marzano's taxonomy in the General Chemistry context and outline the structure of the learning objectives, cognitive levels, assessment schedule, and grading scheme. Item response theory (Rasch analysis) validates the theoretical framework and indicates that assessment items are high quality. Students demonstrate improvement through assessment retakes, and they report that the system motivates them to study and learn.

SUBMITTER: Shepherd TD

PROVIDER: S-EPMC11328131 | biostudies-literature | 2024 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Low-Stakes, Growth-Oriented Testing in Large-Enrollment General Chemistry 1: Formulation, Implementation, and Statistical Analysis.

Shepherd Tricia D TD Garrett-Roe Sean S

Journal of chemical education 20240725 8

We formulate an alternative to high-stakes examinations that is designed to help students grow, and we describe its implementation in a large-enrollment General Chemistry 1 class. In our alternative grading approach, students complete weekly assessments. Each assessment has four items that are aligned to explicit learning objectives and a level in Marzano's taxonomy, retrieval, comprehension, analysis, and knowledge utilization, which can be used by students and instr ...[more]

PMID: 39157432

Similar Datasets

Project description:Mental health services in multicultural societies require culturally sensitive approaches to reduce health disparities. The Cultural Formulation Interview (CFI) is thought to enhance shared decision making and to facilitate culturally and contextually informed treatment. There is, however, little known regarding its implementability in large-scale psychiatric services. The current paper reports on (a) efforts to implement the CFI in a large organization for mental health services in the Netherlands, and (b) two studies that evaluated this implementation process and identified barriers to CFI adoption in clinical practice. Implementation of the CFI was facilitated by developing an online course, an advanced training of "team coaches", (digital) resources, and integrating the CFI questions into the intake format. A preliminary evaluation revealed that the CFI was administered in only 13.2% of all intakes across the entire organization, with minimal utilization of training resources. Study 1 aimed to investigate how the CFI was perceived by clinicians and stakeholders. A survey of 150 clinicians found a great lack of familiarity with the CFI and its purpose. While 67% reported partial CFI use, 50% saw no added value, and 61% deemed it relevant only for ethnic minorities. Study 2 examined which patient and clinician variables were associated with adequate CFI use (i.e., correct documentation of the CFI information in initial intake reports). The sample consisted of 112 intakes of patients conducted by ten clinicians. Regression analysis showed a significant association between clinicians' cultural competences and adequate CFI use, meaning that more culturally competent clinicians tended to generate better cultural assessments using the CFI. In addition, the CFI information was documented more adequately among patients who were unemployed at the time of assessment. In conclusion, implementation of the CFI requires a fundamental rethinking of the entire intake assessment, shifting it from a symptom-oriented approach towards a context- and person-centered one. Future trainings may benefit from embedding the CFI within a broader cultural competency training, rather than solely focusing on the CFI, which is currently the common practice.

Project description:BackgroundIncorporating emerging knowledge into Emergency Medical Service (EMS) competency assessments is critical to reflect current evidence-based out-of-hospital care. However, a standardized approach is needed to incorporate new evidence into EMS competency assessments because of the rapid pace of knowledge generation.ObjectiveThe objective was to develop a framework to evaluate and integrate new source material into EMS competency assessments.MethodsThe National Registry of Emergency Medical Technicians (National Registry) and the Prehospital Guidelines Consortium (PGC) convened a panel of experts. A Delphi method, consisting of virtual meetings and electronic surveys, was used to develop a Table of Evidence matrix that defines sources of EMS evidence. In Round One, participants listed all potential sources of evidence available to inform EMS education. In Round Two, participants categorized these sources into: (a) levels of evidence quality; and (b) type of source material. In Round Three, the panel revised a proposed Table of Evidence. Finally, in Round Four, participants provided recommendations on how each source should be incorporated into competency assessments depending on type and quality. Descriptive statistics were calculated with qualitative analyses conducted by two independent reviewers and a third arbitrator.ResultsIn Round One, 24 sources of evidence were identified. In Round Two, these were classified into high- (n = 4), medium- (n = 15), and low-quality (n = 5) of evidence, followed by categorization by purpose into providing recommendations (n = 10), primary research (n = 7), and educational content (n = 7). In Round Three, the Table of Evidence was revised based on participant feedback. In Round Four, the panel developed a tiered system of evidence integration from immediate incorporation of high-quality sources to more stringent requirements for lower-quality sources.ConclusionThe Table of Evidence provides a framework for the rapid and standardized incorporation of new source material into EMS competency assessments. Future goals are to evaluate the application of the Table of Evidence framework in initial and continued competency assessments.

Project description:Protein identification was carried out by searching against a joint Human + Yeast Swissprot database (Uniprot release 57.3 May 2009, 26885 entries), in order to increase statistical power of peptide identification, which was supplemented with porcine trypsin, and using SEQUEST algorithm (Bioworks 3.2 package, Thermo Finnigan). For SILAC, we used variable (methionine oxidation, lysine and arginine modification of +6 Da) and fixed modifications (cysteine carboxamidomethylation). Precursor mass tolerance was set to 2Da, fragment mass tolerance to 1.2Da and up to two missed cleavage sites for trypsin were allowed. The same collections of MS/MS spectra were also searched against inverted databases constructed from the same target databases. SEQUEST results were analyzed using the probability ratio method 22b, taking into account isoelectric points of peptides to improve peptide identification 9b. False discovery rates (FDR) of peptide identifications were calculated from the search results against the inverted databases using the refined method 9b. The combination of stable isotope labeling (SIL) with mass spectrometry (MS) allows comparison of the abundance of thousands of proteins in complex mixtures. However, interpretation of the large datasets generated by these techniques remains a challenge since appropriate statistical standards are lacking. Here we present the first generally applicable model that accurately explains the behavior of data obtained using current SIL approaches, including 18O, iTRAQ and SILAC labeling, and different MS instruments. The model decomposes the total technical variance into the spectral, peptide and protein variance components, and its general validity was demonstrated by confronting 48 experimental distributions against 18 different null hypotheses. In addition to its general applicability, the performance of the algorithm was similar or better than that of other existing methods. The model also provides a general framework to integrate quantitative information, allowing a comparative analysis of the results obtained from different SIL experiments. The model was applied to the global analysis of protein alterations induced by low H2O2 concentrations in yeast, demonstrating the increased statistical power that may be achieved by rigorous data integration. Our results highlight the importance of establishing an adequate and validated statistical framework for the analysis of high-throughput data. Except for TOF/TOF MS/MS files, protein identification was carried out by searching against a joint Human+YeastSwissprot database (Uniprot release 57.3 May 2009, 26885 entries), in order to increase statistical power of peptide identification, which was supplemented with porcine trypsin, and using SEQUEST algorithm (Bioworks 3.2 package, Thermo Finnigan). For 18O-labeled samples variable (methionine oxidation, lysine and arginine modification of +4 Da) and fixed modifications (cysteine carboxamidomethylation) were used. For iTRAQ, we allowed variable (methionine oxidation) and fixed modifications (cysteine carboxamidomethylation, lysine and N- terminal modification of +144.1020 Da). For SILAC, we used variable (methionine oxidation, lysine and arginine modification of +6 Da) and fixed modifications (cysteine carboxamidomethylation). Precursor mass tolerance was set to 2Da, fragment mass tolerance to 1.2Da and up to two missed cleavage sites for trypsin were allowed. The same collections of MS/MS spectra were also searched against inverted databases constructed from the same target databases. SEQUEST results were analyzed using the probability ratio method 22b, taking into account isoelectric points of peptides to improve peptide identification 9b. False discovery rates (FDR) of peptide identifications were calculated from the search results against the inverted databases using the refined method 9b. TOF/TOF MS/MS spectra were converted to MGF files by using the 4000 Series Explorer V.3.5.1 internal processor and the following parameters: mass range from precursor -20 Da to 60 Da, peak density of 50 peaks per 200 Da with S/N >1 and minimum area >1 with a maximum number of 100 peaks per precursor. These files were analyzed with the Mascot V2.2.06 search engine using the database and search conditions indicated above.

Dataset Information

Low-Stakes, Growth-Oriented Testing in Large-Enrollment General Chemistry 1: Formulation, Implementation, and Statistical Analysis.

Publications

Low-Stakes, Growth-Oriented Testing in Large-Enrollment General Chemistry 1: Formulation, Implementation, and Statistical Analysis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets