Dataset Information

Development and validation of the student ratings in clinical teaching scale in Australia: a methodological study

ABSTRACT:

Purpose

This study aimed to devise a valid measurement for assessing clinical students' perceptions of teaching practices.

Methods

A new tool was developed based on a meta-analysis encompassing effective clinical teaching-learning factors. Seventy-nine items were generated using a frequency (never to always) scale. The tool was applied to the University of New South Wales year 2, 3, and 6 medical students. Exploratory and confirmatory factor analysis (exploratory factor analysis [EFA] and confirmatory factor analysis [CFA], respectively) were conducted to establish the tool’s construct validity and goodness of fit, and Cronbach’s α was used for reliability.

Results

In total, 352 students (44.2%) completed the questionnaire. The EFA identified student-centered learning, problem-solving learning, self-directed learning, and visual technology (reliability, 0.77 to 0.89). CFA showed acceptable goodness of fit (chi-square P<0.01, comparative fit index=0.930 and Tucker-Lewis index=0.917, root mean square error of approximation=0.069, standardized root mean square residual=0.06).

Conclusion

The established tool—Student Ratings in Clinical Teaching (STRICT)—is a valid and reliable tool that demonstrates how students perceive clinical teaching efficacy. STRICT measures the frequency of teaching practices to mitigate the biases of acquiescence and social desirability. Clinical teachers may use the tool to adapt their teaching practices with more active learning activities and to utilize visual technology to facilitate clinical learning efficacy. Clinical educators may apply STRICT to assess how these teaching practices are implemented in current clinical settings.

SUBMITTER: Huang PH

PROVIDER: S-EPMC10562831 | biostudies-literature | 2023

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development and validation of the student ratings in clinical teaching scale in Australia: a methodological study

Huang Pin-Hsiang PH O'Sullivan Anthony John AJ Shulruf Boaz B

Journal of educational evaluation for health professions 20230905

<h4>Purpose</h4>This study aimed to devise a valid measurement for assessing clinical students' perceptions of teaching practices.<h4>Methods</h4>A new tool was developed based on a meta-analysis encompassing effective clinical teaching-learning factors. Seventy-nine items were generated using a frequency (never to always) scale. The tool was applied to the University of New South Wales year 2, 3, and 6 medical students. Exploratory and confirmatory factor analysis (exploratory factor analysis [ ...[more]

PMID: 37667437

Similar Datasets

Project description:Programs encouraging medical student research such as Scholarly Concentrations (SC) are increasing nationally. However, there are few validated measures of mentoring quality tailored to medical students. We sought to modify and validate a mentoring scale for use in medical student research experiences.SC faculty created a scale evaluating how medical students assess mentors in the research setting. A validated graduate student scale of mentorship, the Ideal Mentor Scale, was modified by selecting 10 of the 34 original items most relevant for medical students and adding an item on project ownership. We administered this 11-item assessment to second year medical students in the Johns Hopkins University SC Program from 2011 to 2016, and performed exploratory factor analysis with oblique rotation to determine included items and subscales. We correlate overall mentoring quality scale and subscales with four student outcomes: 'very satisfied' with mentor, 'more likely' to do future research, project accepted at a national meeting, and highest SC faculty rating of student project.Five hundred ninety-eight students responded (87% response rate). After factor analysis, we eliminated three items producing a final scale of overall mentoring quality (8 items, Cronbach's alpha = 0.92) with three subscales: advocacy, responsiveness, and assistance. The overall mentoring quality scale was significantly associated with all four student outcomes, including mentor satisfaction: OR [(95% CI), p-value] 1.66 [(1.53-1.79), p < 0.001]; likelihood of future research: OR 1.06 [(1.03-1.09), p < 0.001]; abstract submission to national meetings: OR 1.05 [(1.02-1.08), p = 0.002]; and SC faculty rating of student projects: OR 1.08 [(1.03-1.14), p = 0.004]. Each subscale also correlated with overall mentor satisfaction, and the strongest relationship of each subscale was seen with 'mentor advocacy.'Mentor quality can be reliably measured and associates with important medical student scholarly outcomes. Given the lack of tools, this scale can be used by other SC Programs to advance medical students' scholarship.

Project description:The purpose of this study was to explore the ways in which a student centered video assignment enhanced student learning about developing and teaching a health education plan designed to address a complex public health problem. The objectives of the assignment included (1) to explore a complex public health problem, (2) practice developing a corresponding health education plan, and (3) develop and fully execute a multimedia video to deliver high impact health education and or promotion to a diverse audience. The assignment referred to as the student centered video assignment was developed and piloted at Grand Valley State University and included students participating in a 200 level undergraduate introductory public health course. Students working in groups of 3, worked through the project in multiple phases with corresponding elements: problem identification, problem solving, plan development and the creation of the video, which included four primary elements: Dig Deeper, Think, Discuss, and Watch. Upon completion of the video, students were asked to voluntarily complete a 10-question survey about the benefits of learning through a video creation assignment. A total of 15 students completed the survey with the majority either strongly agreeing or agreeing that the video assignment enhanced learning. Survey results suggest that the assignment is beneficial and favored over other assignment types. Additionally, students reported that the project was beneficial in learning the concepts and competencies associated with public health education. Finally, students indicated that the creation of videos as a means to explore and apply course concepts was favored as an assignment format in future coursework. Instructor assessment of learning outcomes occurred through ongoing grading of and feedback on the project elements. The findings reveal that students enjoyed the opportunity to engage in real world problem solving, gained insight, perspective and scope through group discussion and collaboration, and felt that they learned new skills in created the video.

Project description:AimsThis study was designed to develop a biosafety incident response competence scale and evaluate its validity and reliability among clinical nurses.DesignThis study employed a sequential approach, comprising four phases: (1) the establishment of a multidimensional conceptual model, (2) the preliminary selection of the items, (3) further exploration and psychometric testing of the items, (4) the application of the scale among clinical nurses.MethodsThe biosafety incident response competence conceptual model was developed through literature review and the Delphi method. A total of 1,712 clinical nurses participated in the preliminary items selection, while 1,027 clinical nurses were involved in the further psychometric testing from July 2023 to August 2023. The item analysis, exploratory factor analysis and confirmatory factor analysis were conducted to evaluate the construct validity. Reliability was measured using Cronbach's alpha, split-half reliability, and test-retest reliability, while validity analysis included content validity, structural validity, convergent validity, and discriminant validity. From September to November 2023, we conducted a survey using the established scale with a total of 4338 valid questionnaires collected. T-test and variance analysis was employed to determine potential variations in biosafety incident response competence based on participants characteristics.ResultsThe final scale is composed of 4 factors and 29 items, including monitoring and warning abilities, nursing disposal abilities, biosafety knowledge preparedness, and infection protection abilities. The explanatory variance of the 4 factors was 75.100%. The Cronbach's alpha, split-half reliability and test-retest reliability were 0.974, 0.945 and 0.840 respectively. The Scale-level content validity index was 0.866. The Average Variance Extracted of the 4 factors was larger than 0.5, the Construct Reliability was larger than 0.7, and the Heterotrait-Monotrait ratio were less than 0.9. There were significant differences in the scores of response competence among nurses of different ages, working years, titles, positions, departments, marital status and participation in biosafety training (all P < 0.05).ConclusionsThe biosafety incident response competence scale for nurses exhibits satisfactory reliability and validity, making it a valuable tool for assessing clinical nurses' abilities in responding to biosafety incidents.

Project description:BACKGROUND:In a whole-of-system approach to evaluation of teaching across any degree, multiple sources of information can help develop an educators' understanding of their teaching quality. In the health professions, student evaluations of clinical teaching are commonplace. However, self-evaluation of teaching is less common, and exploration of clinical educators' self-efficacy even less so. The aim of the study was to evaluate how a clinical educator's self-evaluation of teaching intersects with their self-efficacy, to ascertain if that matches student evaluation of their teaching. This information may assist in facilitating targeted professional development to improve teaching quality. METHODS:Clinical educators in the osteopathy program at Victoria University (VU) were invited to complete: a) self-evaluation version of the Osteopathy Clinical Teaching Questionnaire (OCTQ); and b) the Self-Efficacy in Clinical Teaching (SECT) questionnaire. Students in the VU program completed the OCTQ for each of the clinical educators they worked with during semester 2, 2017. RESULTS:Completed OCTQ and SECT were received from 37 clinical educators. These were matched with 308 student evaluations (mean of 6 student ratings per educator). Three possible educator cohorts were identified: a) high clinical eductor self-OCTQ with low student evaluation; b) low clinical educator self-evaluation and high student evaluations; and, c) no difference between self- and student evaulations. Clinical educators in the first cohort demonstrated significantly higher SECT subscale scores (effect size >?0.42) than their colleagues. Age, gender, teaching qualification, and years practicing or years as a clinical educator were not associated with clinical educator OCTQ scores or the SECT subscales. CONCLUSIONS:Targeted professional development directed towards fostering self-efficacy may provide an avenue for engaging those clinical educators whose self-efficacy is low and/or those who did not receive high student evaluations. Given there is no gold standard measure of clinical teaching quality, educators should engage with multiple sources of feedback to benchmark their current performance level, and identify opportunities to improve. Student and self-evaluations using the OCTQ and evaluation of self-efficacy using the SECT, are useful tools for inclusion in a whole-of-system approach to evaluation of the clinical learning environment.

Dataset Information

Development and validation of the student ratings in clinical teaching scale in Australia: a methodological study

Purpose

Methods

Results

Conclusion

Publications

Development and validation of the student ratings in clinical teaching scale in Australia: a methodological study

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets