Dataset Information

Improving surgical skills with feedback: directly-observed versus video-recorded practice.

ABSTRACT:

Objective

This study aimed to compare two methods of feedback: verbal face-to-face feedback after direct observation (F2F-feedback) versus electronic-written feedback after observation of recorded-VDO of student's performance (VDO-feedback), in terms of effectiveness in improving skill, effects on motivation and satisfaction.

Background

Medical schools are responsible for teaching and ensuring proficiency of basic surgical skills. Feedback is effective in developing psychomotor skills; by providing information of learner's current performance, how to improve, and enhancing motivation.

Materials and method

Fifty-eight medical students (3^rd- 4^th year) were trained to perform vertical mattress suture in small groups. Then, during 6-week period of self-directed practice, students were randomized into group1 VDO-feedback (male:female = 21:8) and group 2 F2F-feedback (male:female = 20:9). Feedbacks were provided once every 2 weeks (Week2, Week4). End-of-rotation OSCE was at Week6, and retention tested was at Week8. Performance checklist (Cronbach's Alpha 0.72) was used to assess skill at 4 timepoints; pre- and post- small group learning, OSCE, and retention phase. Questionnaire was used to assess motivation, learning strategies and satisfaction (Cronbach's Alpha 0.83).

Result

After in-class learning, further significant improvement of skills could be gained by both F2F- and VDO- feedbacks (p < 0.0001). Both could similarly retain skill for at least 4 weeks later without additional practice. Self-efficacy, test anxiety, and cognitive strategies scores were significantly increased in both groups (p < 0.05). Extrinsic motivation was increased in VDO-feedback group. No difference in satisfaction between groups was observed.

Discussion and conclusion

VDO-feedback could be alternative to F2F-feedbacks for basic surgical skill training when limitation for simultaneous meeting of teacher and students occurs.

Trial registration

This study has been registered to Thai Clinical Trial Registry (WHO International Clinical Trial Registry Platform) on 11/07/2023 (TCTR20230711005).

SUBMITTER: Tantiphlachiva K

PROVIDER: S-EPMC10496316 | biostudies-literature | 2023 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Improving surgical skills with feedback: directly-observed versus video-recorded practice.

Tantiphlachiva Kasaya K Iramaneerat Cherdsak C Lertbunnaphong Tripop T

BMC medical education 20230911 1

<h4>Objective</h4>This study aimed to compare two methods of feedback: verbal face-to-face feedback after direct observation (F2F-feedback) versus electronic-written feedback after observation of recorded-VDO of student's performance (VDO-feedback), in terms of effectiveness in improving skill, effects on motivation and satisfaction.<h4>Background</h4>Medical schools are responsible for teaching and ensuring proficiency of basic surgical skills. Feedback is effective in developing psychomotor sk ...[more]

PMID: 37697379

Similar Datasets

Project description:BackgroundDirectly observed treatment (DOT) has been the standard of care for tuberculosis since the early 1990s, but it is inconvenient for patients and service providers. Video-observed therapy (VOT) has been conditionally recommended by WHO as an alternative to DOT. We tested whether levels of treatment observation were improved with VOT.MethodsWe did a multicentre, analyst-blinded, randomised controlled superiority trial in 22 clinics in England (UK). Eligible participants were patients aged at least 16 years with active pulmonary or non-pulmonary tuberculosis who were eligible for DOT according to local guidance. Exclusion criteria included patients who did not have access to charging a smartphone. We randomly assigned participants to either VOT (daily remote observation using a smartphone app) or DOT (observations done three to five times per week in the home, community, or clinic settings). Randomisation was done by the SealedEnvelope service using minimisation. DOT involved treatment observation by a health-care or lay worker, with any remaining daily doses self-administered. VOT was provided by a centralised service in London. Patients were trained to record and send videos of every dose ingested 7 days per week using a smartphone app. Trained treatment observers viewed these videos through a password-protected website. Patients were also encouraged to report adverse drug events on the videos. Smartphones and data plans were provided free of charge by study investigators. DOT or VOT observation records were completed by observers until treatment or study end. The primary outcome was completion of 80% or more scheduled treatment observations over the first 2 months following enrolment. Intention-to-treat (ITT) and restricted (including only patients completing at least 1 week of observation on allocated arm) analyses were done. Superiority was determined by a 15% difference in the proportion of patients with the primary outcome (60% vs 75%). This trial is registered with the International Standard Randomised Controlled Trials Number registry, number ISRCTN26184967.FindingsBetween Sept 1, 2014, and Oct 1, 2016, we randomly assigned 226 patients; 112 to VOT and 114 to DOT. Overall, 131 (58%) patients had a history of homelessness, imprisonment, drug use, alcohol problems or mental health problems. In the ITT analysis, 78 (70%) of 112 patients on VOT achieved ≥80% scheduled observations successfully completed during the first 2 months compared with 35 (31%) of 114 on DOT (adjusted odds ratio [OR] 5·48, 95% CI 3·10-9·68; p<0·0001). In the restricted analysis, 78 (77%) of 101 patients on VOT achieved the primary outcome compared with 35 (63%) of 56 on DOT (adjusted OR 2·52; 95% CI 1·17-5·54; p=0·017). Stomach pain, nausea, and vomiting were the most common adverse events reported (in 16 [14%] of 112 on VOT and nine [8%] of 114 on DOT).InterpretationVOT was a more effective approach to observation of tuberculosis treatment than DOT. VOT is likely to be preferable to DOT for many patients across a broad range of settings, providing a more acceptable, effective, and cheaper option for supervision of daily and multiple daily doses than DOT.FundingNational Institute for Health Research.

Project description:BackgroundThe health care system in Thailand has struggled to cope with the COVID-19 pandemic, resulting in decreased administration of community-based directly observed therapy (DOT) for tuberculosis (TB). As an alternative to failed DOT, video-observed therapy (VOT) or the Thai asynchronous VOT system, "TH VOT," was devised. We developed a protocol for a study to test the superiority of VOT over DOT in ensuring treatment compliance.ObjectiveWe aim to compare the mean cumulative compliance days of TB patients and their observers under the VOT program with that of individuals under the DOT program during the intensive phase of TB treatment.MethodsA cluster randomized controlled trial of pulmonary TB patients and their observers will be conducted over a 2-month period. This study will be conducted in the Hat Yai and Meuang Songkhla districts of Songkhla Province, Southern Thailand. A total of 38 observers working at 38 primary care units (PCUs) will be randomized equally into VOT and DOT groups. The TH VOT system will be implemented in 19 PCUs in the VOT group while the other 19 PCUs will continue with the traditional DOT program. Approximately 1-5 TB patients will be under observation, depending on the PCU jurisdiction in which the patients reside. The inclusion criteria for TB patients will be as follows: patients diagnosed with newly active pulmonary TB with a positive acid-fast bacilli sputum smear, aged >18 years, own a smartphone, and are able to use the LINE (Line Corporation) app. The exclusion criteria will be patients with a condition that requires the intervention of a specialist, rifampicin resistance according to a cartridge-based nucleic acid amplification test (GeneXpert MTB/RIF), unable to continue the treatment, and/or alcohol dependence. After the 2-month observation period, all sessions and follow-up clinical outcomes recorded will be retrieved. An intention-to-treat analysis will be performed to assess the compliance of both patients undergoing drug administration and their observers.ResultsThe Human Research Ethics Committee, Faculty of Medicine, Prince of Songkla University approved the trial on February 19, 2021 (approval number 64-03618-9). The trial was funded in May 2021. The recruitment period will be from January 2022 to July 2022. The observation is scheduled to end by September 2022.ConclusionsIf the VOT shows superiority in observational compliance among patients and observers, the existing DOT policy will be replaced with VOT.Trial registrationThai Clinical Trials Registry TCTR20210624002; https://www.thaiclinicaltrials.org/show/TCTR20210624002.International registered report identifier (irrid)DERR1-10.2196/38796.

Project description:Assessing nontechnical skills in operating rooms (ORs) is crucial for enhancing surgical performance and patient safety. However, automated and real-time evaluation of these skills remains challenging. To explore the feasibility of using motion features extracted from surgical video recordings to automatically assess nontechnical skills during cardiac surgical procedures. This cross-sectional study used video recordings of cardiac surgical procedures at a tertiary academic US hospital collected from January 2021 through May 2022. The OpenPose library was used to analyze videos to extract body pose estimations of team members and compute various team motion features. The Non-Technical Skills for Surgeons (NOTSS) assessment tool was employed for rating the OR team's nontechnical skills by 3 expert raters. NOTSS overall score, with motion features extracted from surgical videos as measures. A total of 30 complete cardiac surgery procedures were included: 26 (86.6%) were on-pump coronary artery bypass graft procedures and 4 (13.4%) were aortic valve replacement or repair procedures. All patients were male, and the mean (SD) age was 72 (6.3) years. All surgical teams were composed of 4 key roles (attending surgeon, attending anesthesiologist, primary perfusionist, and scrub nurse) with additional supporting roles. NOTSS scores correlated significantly with trajectory (r = 0.51, P = .005), acceleration (r = 0.48, P = .008), and entropy (r = -0.52, P = .004) of team displacement. Multiple linear regression, adjusted for patient factors, showed average team trajectory (adjusted R2 = 0.335; coefficient, 10.51 [95% CI, 8.81-12.21]; P = .004) and team displacement entropy (adjusted R2 = 0.304; coefficient, -12.64 [95% CI, -20.54 to -4.74]; P = .003) were associated with NOTSS scores. This study suggests a significant link between OR team movements and nontechnical skills ratings by NOTSS during cardiac surgical procedures, suggesting automated surgical video analysis could enhance nontechnical skills assessment. Further investigation across different hospitals and specialties is necessary to validate these findings.

Project description:BACKGROUND:Pre-recorded videotapes have become the standard approach when teaching clinical communication skills (CCS). Furthermore, video-based feedback (VF) has proven to be beneficial in formative assessments. However, VF in CCS with the use of pre-recorded videos from real-life settings is less commonly studied than the use of simulated patients. To explore: 1) perceptions about the potential benefits and challenges in this kind of VF; 2) differences in the CCC scores in first-year medical residents in primary care, before and after a communication program using VF in a curricular formative assessment. METHOD:We conducted a pre/post study with a control group. The intervention consisted of VF sessions regarding CCS, performed in a small group with peers and a facilitator. They reviewed clinical consultations pre-recorded in a primary care setting with real patients. Before and after the intervention, 54 medical residents performed two clinical examinations with simulated patients (SP), answered quantitative scales (Perception of Patient-Centeredness and Jefferson Empathy Scale), and semi-structured qualitative questionnaires. The performances were scored by SP (Perception of Patient-Centeredness and CARE scale) and by two blind raters (SPIKES protocol-based and CCOG-based scale). The quantitative data analysis employed repeated-measures ANOVA. The qualitative analysis used the Braun and Clarke framework for thematic analysis. RESULTS:The quantitative analyses did not reveal any significant differences in the sum scores of the questionnaires, except for the Jefferson Empathy Scale. In the qualitative questionnaires, the main potential benefits that emerged from the thematic analysis of the VF method were self-perception, peer-feedback, patient-centered approach, and incorporation of reflective practices. A challenging aspect that emerged from facilitators was the struggle to relate the VF with theoretical references and the resident's initial stress to record and watch oneself on video. CONCLUSION:VF taken from real-life settings seems to be associated with a significant increase in self-perceived empathy. The study of other quantitative outcomes related to this VF intervention needs larger sample sizes. VF with clinical patients from real healthcare settings appears to be an opportunity for a deeper level of self-assessment, peer-feedback, and reflective practices.

Dataset Information

Improving surgical skills with feedback: directly-observed versus video-recorded practice.

Objective

Background

Materials and method

Result

Discussion and conclusion

Trial registration

Publications

Improving surgical skills with feedback: directly-observed versus video-recorded practice.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets