Dataset Information

Development and Integration of DOPS as Formative Tests in Head and Neck Ultrasound Education: Proof of Concept Study for Exploration of Perceptions.

ABSTRACT: In Germany, progress assessments in head and neck ultrasonography training have been carried out mainly theoretically and lack standardisation. Thus, quality assurance and comparisons between certified courses from various course providers are difficult. This study aimed to develop and integrate a direct observation of procedural skills (DOPS) in head and neck ultrasound education and explore the perceptions of both participants and examiners. Five DOPS tests oriented towards assessing basic skills were developed for certified head and neck ultrasound courses on national standards. DOPS tests were completed by 76 participants from basic and advanced ultrasound courses (n = 168 documented DOPS tests) and evaluated using a 7-point Likert scale. Ten examiners performed and evaluated the DOPS after detailed training. The variables of "general aspects" (6.0 Scale Points (SP) vs. 5.9 SP; p = 0.71), "test atmosphere" (6.3 SP vs. 6.4 SP; p = 0.92), and "test task setting" (6.2 SP vs. 5.9 SP; p = 0.12) were positively evaluated by all participants and examiners. There were no significant differences between a basic and advanced course in relation to the overall results of DOPS tests (p = 0.81). Regardless of the courses, there were significant differences in the total number of points achieved between individual DOPS tests. DOPS tests are accepted by participants and examiners as an assessment tool in head and neck ultrasound education. In view of the trend toward "competence-based" teaching, this type of test format should be applied and validated in the future.

SUBMITTER: Weimer JM

PROVIDER: S-EPMC9954978 | biostudies-literature | 2023 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development and Integration of DOPS as Formative Tests in Head and Neck Ultrasound Education: Proof of Concept Study for Exploration of Perceptions.

Weimer Johannes Matthias JM Rink Maximilian M Müller Lukas L Dirks Klaus K Ille Carlotta C Bozzato Alessandro A Sproll Christoph C Weimer Andreas Michael AM Neubert Christian C Buggenhagen Holger H Ernst Benjamin Philipp BP Symeou Luisa L Lorenz Liv Annebritt LA Hollinderbäumer Anke A Künzel Julian J

Diagnostics (Basel, Switzerland) 20230210 4

In Germany, progress assessments in head and neck ultrasonography training have been carried out mainly theoretically and lack standardisation. Thus, quality assurance and comparisons between certified courses from various course providers are difficult. This study aimed to develop and integrate a direct observation of procedural skills (DOPS) in head and neck ultrasound education and explore the perceptions of both participants and examiners. Five DOPS tests oriented towards assessing basic ski ...[more]

PMID: 36832149

Similar Datasets

Project description:BackgroundIn competency-based medical education (CBME), "Assessment for learning" or "Formative Assessment" (FA) plays a key role in augmenting student learning. FAs help students to measure their progress over time, enabling them to proactively improve their performance in summative assessments. FAs also encourage students to learn in a way where they address their knowledge gaps and gaps in their conceptualization of the subject matter. The effectiveness of an FA, as a learning and development instrument, relies on the degree of student involvement in the corresponding educational intervention's design and implementation. The extent of students' engagement in FA can be evaluated by appraising their perception regarding the educational intervention itself.ObjectiveThis proof-of-concept study aims to develop a systemic understanding of a Formative Assessment as an Instructional Tool (FAIS) implemented in a biochemistry course in the Basic Medical Sciences component of an undergraduate entry, CBME.MethodsThe educational intervention in question is an FAIS, which is implemented in a biochemistry course in the first semester of a 6-year bachelor of medicine, bachelor of surgery program. When developing the FAIS, each area of knowledge, skills, and attitudes were considered. Assessment formats are developed per Miller's learning pyramid. This multiphase study is meant to rely on a convergent mixed methods design, where qualitative and quantitative data are independently collected and analyzed. Thereafter, the outputs of analyses are systematically merged using joint display analysis process. Qualitative data are collected through a focus group session that captures the students' perception toward the FAIS. Data collection, integral to this focus group session, is exploratory. The inductive qualitative data analysis follows Braun and Clarke's 6-step framework. The quantitative component of this study revolves around investigating the effect of the FAIS on the course's summative assessment. The summative assessment performance of the 71 students, enrolled in the FAIS cohort, will be compared to that of the students in the non-FAIS cohort. The total duration of the proposed multiphase research study is 6 months.ResultsThis proposed multiphase study is expected to showcase, from a systemic perspective, the effectiveness of the respective educational intervention. It will shed light on the participating students' attitudes in relation to the usefulness of FA in achieving competency goals and in fostering self-directed learning. The proposed study could also uncover the hypothesized association between the FA intervention and enhanced performance in summative assessments.ConclusionsOur findings will generate evidence regarding the application of FAs, which can be leveraged by other medical educators in contexts similar to those under investigation.International registered report identifier (irrid)DERR1-10.2196/41626.

Project description:IntroductionRecent international consensus statements advocate for the integration of Point-of-Care Ultrasound (PoCUS) into the global undergraduate medical curriculum. Some medical schools outside Saudi Arabia have already incorporated PoCUS into their undergraduate curricula to enhance anatomy, physiology and pathology instruction. However, there are no data on the potential role of PoCUS in the preclinical training of medical students in Saudi Arabia. Given constraints on resources for medical education, a formal needs assessment was conducted to evaluate the potential utility of PoCUS within the basic science curriculum at our institution.MethodsAll final year medical students at our institution were invited to complete a validated online survey. The questionnaire utilized a 5-point Likert scale to assess student perceptions of the potential for PoCUS to improve their understanding of basic sciences and their desire for its incorporation into the preclinical curriculum.ResultsA total of 229 students participated (response rate 76%; male 134/200; female 95/100). Our survey demonstrated good internal consistency (Cronbach's alpha: learning basic sciences 0.81, need for curriculum integration 0.83). The vast agreed that learning PoCUS would enhance their understanding of anatomy (95%) and pathology (75%). While only 52% agreed that learning PoCUS would improve their understanding of physiology, a substantial majority (80%) agreed that all medical schools should incorporate PoCUS into their undergraduate curricula. Furthermore, 62% agreed that offering PoCUS training would make the medical school more attractive to prospective applicants. No significant differences were observed between the responses of male and female students. The results of a confirmatory factor analysis provide strong support for the hypothesized three-factor model. All factor loadings are significant (P < 0.001), CONCLUSIONS: Medical students in Saudi Arabia perceive that PoCUS would be a valuable tool to learn anatomy and pathology, aligning with the recommendations of the consensus conference on PoCUS integration in undergraduate medical education organized by the World Interactive Network Focused on Critical Ultrasound (WINFOCUS) and the Society of Ultrasound in Medical Education (SUSME). Introducing PoCUS training into preclinical medical curricula may also enhance the attractiveness of medical schools to potential applicants.

Dataset Information

Development and Integration of DOPS as Formative Tests in Head and Neck Ultrasound Education: Proof of Concept Study for Exploration of Perceptions.

Publications

Development and Integration of DOPS as Formative Tests in Head and Neck Ultrasound Education: Proof of Concept Study for Exploration of Perceptions.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets