Dataset Information

Feasibility and Perceived Usefulness of Using Head-Mounted Cameras for Resident Video Portfolios.

ABSTRACT:

Background

There is limited guidance on how to longitudinally administer simulation materials or to incorporate video recordings into assessment portfolios of simulated surgical skills.

Materials and methods

We launched a longitudinal weekly simulation curriculum for PGY1-PGY3 surgical residents based on the ACS/APDS Curriculum. Residents underwent monthly objective structured assessment of technical skills (OSATS) while wearing head-mounted cameras. Videos of OSATS performance accrued into individual online video portfolios. Residents were surveyed about their attitudes toward video recording.

Results

Twenty-seven general surgical residents participated, completing 161 OSATS encompassing 11 distinct skills and generating 258 videos of simulated skills performance. The overall survey response rate was 88%. Residents viewed the curriculum favorably overall, and 36.4% of residents accessed their videos. Of those who did not watch their videos, 78.6% cited not having enough time, whereas 28.6% did not think the videos would be useful. Over 95% of surveyed residents expressed interest in having a video library of attending-performed procedures, 59.1% were interested in having their own operations recorded, and 45.5% were interested in video-based coaching.

Conclusions

Residents viewed longitudinal administration of the ACS/APDS Curriculum positively. Although video recording in simulation is feasible, resident interest may be higher for intraoperative recordings than for simulated skills.

SUBMITTER: McKinley SK

PROVIDER: S-EPMC7232965 | biostudies-literature | 2019 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Feasibility and Perceived Usefulness of Using Head-Mounted Cameras for Resident Video Portfolios.

McKinley Sophia K SK Hashimoto Daniel A DA Mansur Arian A Cassidy Douglas D Petrusa Emil E Mullen John T JT Phitayakorn Roy R Gee Denise W DW

The Journal of surgical research 20190308

<h4>Background</h4>There is limited guidance on how to longitudinally administer simulation materials or to incorporate video recordings into assessment portfolios of simulated surgical skills.<h4>Materials and methods</h4>We launched a longitudinal weekly simulation curriculum for PGY1-PGY3 surgical residents based on the ACS/APDS Curriculum. Residents underwent monthly objective structured assessment of technical skills (OSATS) while wearing head-mounted cameras. Videos of OSATS performance ac ...[more]

PMID: 30856516

Similar Datasets

Project description:BackgroundUnobtrusive observation is a promising method for assessing physical activity and other well-being behaviors (eg, social interactions) in urban environments, without participant burden and biases associated with self-report. However, current methods require multiple in-person observers. Using video cameras instead could allow for more accurate observations at lower cost and with greater flexibility in scheduling.ObjectiveThis research aimed to test the feasibility of using stationary wireless video cameras to observe physical activity and other well-being behaviors, and to assess its reliability and potential participant reactivity.MethodsAcross 3 cross-sectional studies, 148 hours of video recordings were collected from 6 outdoor public spaces in Manchester, United Kingdom. The videos were coded by 3 researchers using MOHAWk (Method for Observing Physical Activity and Wellbeing)-a validated in-person observation tool for assessing physical activity, social interactions, and people taking notice of the environment. Inter- and intrarater reliabilities were assessed using intraclass correlation coefficients (ICCs). Intercept surveys were conducted to assess public awareness of the cameras and whether they altered their behavior due to the presence of cameras.ResultsThe 148 hours of video recordings were coded in 85 hours. Interrater reliability between independent coders was mostly "excellent" (ICCs>0.90; n=36), with a small number of "good" (ICCs>0.75; n=2), "moderate" (ICCs=0.5-0.75; n=3), or "poor" (ICCs<0.5; n=1) ICC values. Reliability decreased at night, particularly for coding ethnic group and social interactions, but remained mostly "excellent" or "good." Intrarater reliability within a single coder after a 2-week interval was "excellent" for all but 1 code, with 1 "good" ICC value for assessing vigorous physical activity, indicating that the coder could reproduce similar results over time. Intrarater reliability was generally similar during the day and night, apart from ICC values for coding ethnic group, which reduced from "excellent" to "good" at night. Intercept surveys with 86 public space users found that only 5 (5.8%) participants noticed the cameras used for this study. Importantly, all 5 said that they did not alter their behavior as a result of noticing these cameras, therefore, indicating no evidence of reactivity.ConclusionsCamera-based observation methods are more reliable than in-person observations and do not produce participant reactivity often associated with self-report methods. This method requires less time for data collection and coding, while allowing for safe nighttime observation without the risk to research staff. This research is a significant first step in demonstrating the potential for camera-based methods to improve natural experimental studies of real-world environmental interventions. It also provides a rigorous foundation for developing more scalable automated computer vision algorithms for assessing human behaviors.

Project description:SignificanceA recent trend in low vision rehabilitation has been the use of portable head-mounted displays to enhance residual vision. Our study confirms the feasibility of telerehabilitation and informs the development of evidence-based recommendations to improve telerehabilitation interventions to reduce device abandonment.PurposeTo develop evidence-based recommendations for telerehabilitation, we conducted a feasibility study in preparation for a future randomized trial on the use of head-mounted displays.MethodsWe recruited novice eSight Eyewear users, randomized 1:1: the experimental group received telerehabilitation by a low vision therapist using video conferencing; the control group completed at home self-training provided by the device manufacturer. The primary feasibility outcomes were whether the recruitment goal of 60 participants (30/group) was attainable within 1 year and how participants judged the accessibility and acceptability of the telerehabilitation. An exploratory outcome was the impact of telerehabilitation on eSight Eyewear use behavior.ResultsAmong 333 eSight users, 57 participants were enrolled, of which 35% withdrew from the study, whereas the remainder completed the 6-month follow-up. The withdrawal rate was higher in the control group but did not differ significantly from the experimental group. High accessibility (93% of participants accessed the platform) and global acceptability (100% overall satisfaction) were reported among those who completed the telerehabilitation protocol. The therapist had no difficulty judging the participants' reading performances qualitatively while participants used their device to read their eSkills and VisExc guides. Most participants improved their daily activities, based on qualitative reports of the attained goals. Seventy-nine percent of individuals declined to participate, whereas 16% of participants decided not to use eSight Eyewear anymore.ConclusionsThe data demonstrated the feasibility of a randomized controlled telerehabilitation study for people with low vision using a head-mounted display. Positive feedback from the participants and the therapist suggests the potential value of this modality for low vision services.

Project description:BackgroundAlthough nearly one-third of the world's disease burden requires surgical care, only a small proportion of digital health applications are directly used in the surgical field. In the coming decades, the application of augmented reality (AR) with a new generation of optical-see-through head-mounted displays (OST-HMDs) like the HoloLens (Microsoft Corp) has the potential to bring digital health into the surgical field. However, for the application to be performed on a living person, proof of performance must first be provided due to regulatory requirements. In this regard, cadaver studies could provide initial evidence.ObjectiveThe goal of the research was to develop an open-source system for AR-based surgery on human cadavers using freely available technologies.MethodsWe tested our system using an easy-to-understand scenario in which fractured zygomatic arches of the face had to be repositioned with visual and auditory feedback to the investigators using a HoloLens. Results were verified with postoperative imaging and assessed in a blinded fashion by 2 investigators. The developed system and scenario were qualitatively evaluated by consensus interview and individual questionnaires.ResultsThe development and implementation of our system was feasible and could be realized in the course of a cadaver study. The AR system was found helpful by the investigators for spatial perception in addition to the combination of visual as well as auditory feedback. The surgical end point could be determined metrically as well as by assessment.ConclusionsThe development and application of an AR-based surgical system using freely available technologies to perform OST-HMD-guided surgical procedures in cadavers is feasible. Cadaver studies are suitable for OST-HMD-guided interventions to measure a surgical end point and provide an initial data foundation for future clinical trials. The availability of free systems for researchers could be helpful for a possible translation process from digital health to AR-based surgery using OST-HMDs in the operating theater via cadaver studies.

Project description:BackgroundTo promote and ensure coaches' fidelity in delivering an online health coaching program to parents of children with suspected developmental delay, we developed and implemented a novel coaching fidelity rating tool, CO-FIDEL (COaches Fidelity in Intervention DELivery). We aimed to (1) Demonstrate CO-FIDEL's feasibility in evaluating coaches' fidelity and its change over time; and (2) Explore coaches' satisfaction with and usefulness of the tool.MethodsIn an observational study design, coaches (n = 4) were assessed using the CO-FIDEL following each coaching session (n = 13-14 sessions/parent-participant) during the pilot phase of a large randomized clinical trial involving eleven (n = 11) parent-participants. Outcome measures included subsections' fidelity measures, overall coaching fidelity, and coaching fidelity changes over time analyzed using descriptive and non-parametric statistics. In addition, using a four-point Likert Scale and open-ended questions, coaches were surveyed on their satisfaction and preference levels, as well as facilitators, barriers, and impacts related to the use of CO-FIDEL. These were analyzed using descriptive statistics and content analysis.ResultsOne hundred and thirty-nine (n = 139) coaching sessions were evaluated with the CO-FIDEL. On average, overall fidelity was high (88.0 ± 6.3 to 99.5 ± 0.8%). Four coaching sessions were needed to achieve and maintain a ≥ 85.0% fidelity in all four sections of the tool. Two coaches showed significant improvements in their coaching skills over time in some of the CO-FIDEL sections (Coach B/Section 1/between parent-participant B1 and B3: 89.9 ± 4.6 vs. 98.5 ± 2.6, Z = -2.74, p = 0.00596; Coach C/Section 4/between parent-participant C1 and C2: 82.4 ± 7.5 vs. 89.1 ± 4.1, Z = -2.66; p = 0.00758), and in overall fidelity (Coach C, between parent-participant C1 and C2: 88.67 ± 6.32 vs. 94.53 ± 1.23, Z = -2.66; p = 0. 00758). Coaches mainly reported moderate-high satisfaction with and usefulness of the tool, and pointed out areas of improvement (e.g., ceiling effect, missing elements).ConclusionsA new tool ascertaining coaches' fidelity was developed, applied, and shown to be feasible. Future research should address the identified challenges and examine the psychometric properties of the CO-FIDEL.

Dataset Information

Feasibility and Perceived Usefulness of Using Head-Mounted Cameras for Resident Video Portfolios.

Background

Materials and methods

Results

Conclusions

Publications

Feasibility and Perceived Usefulness of Using Head-Mounted Cameras for Resident Video Portfolios.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets