Working volume: validity evidence for a motion-based metric of surgical efficiency.
Ontology highlight
ABSTRACT: Background
The aim of this study was to evaluate working volume as a potential assessment metric for open surgical tasks.Methods
Surgical attendings (n = 6), residents (n = 4), and medical students (n = 5) performed a suturing task on simulated connective tissue (foam), artery (rubber balloon), and friable tissue (tissue paper). Using a motion tracking system, effective working volume was calculated for each hand. Repeated measures analysis of variance assessed differences in working volume by experience level, dominant and/or nondominant hand, and tissue type.Results
Analysis revealed a linear relationship between experience and working volume. Attendings had the smallest working volume, and students had the largest (P = .01). The 3-way interaction of experience level, hand, and material type showed attendings and residents maintained a similar working volume for dominant and nondominant hands for all tasks. In contrast, medical students' nondominant hand covered larger working volumes for the balloon and tissue paper materials (P < .05).Conclusions
This study provides validity evidence for the use of working volume as a metric for open surgical skills. Working volume may provide a means for assessing surgical efficiency and the operative learning curve.
SUBMITTER: D'Angelo AL
PROVIDER: S-EPMC4724457 | biostudies-literature | 2016 Feb
REPOSITORIES: biostudies-literature
Publications
Working volume: validity evidence for a motion-based metric of surgical efficiency.
D'Angelo Anne-Lise D AL Rutherford Drew N DN Ray Rebecca D RD Laufer Shlomi S Mason Andrea A Pugh Carla M CM
American journal of surgery 20151111 2
<h4>Background</h4>The aim of this study was to evaluate working volume as a potential assessment metric for open surgical tasks.<h4>Methods</h4>Surgical attendings (n = 6), residents (n = 4), and medical students (n = 5) performed a suturing task on simulated connective tissue (foam), artery (rubber balloon), and friable tissue (tissue paper). Using a motion tracking system, effective working volume was calculated for each hand. Repeated measures analysis of variance assessed differences in wor ...[more]
Similar Datasets
Project description:PurposeFor stereotactic radiosurgery (SRS), accurate evaluation of dose-volume metrics for small structures is necessary. The purpose of this study was to compare the DVH metric capabilities of five commercially available SRS DVH analysis tools (Eclipse, Elements, Raystation, MIM, and Velocity).MethodsDICOM RTdose and RTstructure set files created using MATLAB were imported and evaluated in each of the tools. Each structure set consisted of 50 randomly placed spherical targets. The dose distributions were created on a 1-mm grid using an analytic model such that the dose-volume metrics of the spheres were known. Structure sets were created for 3, 5, 7, 10, 15, and 20 mm diameter spheres. The reported structure volume, V100% [cc], and V50% [cc], and the RTOG conformity index and Paddick Gradient Index, were compared with the analytical values.ResultsThe average difference and range across all evaluated target sizes for the reported structure volume was - 4.73%[-33.2,0.2], 0.11%[-10.9, 9.5], -0.39%[-12.1, 7.0], -2.24%[-21.0, 1.3], and 1.15%[-15.1,0.8], for TPS-A through TPS-E, respectively. The average difference and range for the V100%[cc] (V20Gy[cc]) was - 0.4[-24.5,9.8], -2.73[-23.6, 1.1], -3.01[-23.6, 0.6], -3.79[-27.3, 1.3], and 0.26[-6.1,2.6] for TPS-A through TPS-E, respectively. For V50%[cc](V10Gy[cc]) in TPS-A through TPS-E the average and ranger were - 0.05[-0.8,0.4], -0.18[-1.2, 0.5], -0.44[-1.4, 0.3], -0.26[-1.8, 2.6], and 0.09[-1.4,2.7].ConclusionThis study expanded on the previously published literature to quantitatively compare the DVH analysis capabilities of software commonly used for SRS plan evaluation and provides freely available and downloadable analytically derived set of ground truth DICOM dose and structure files for the use of radiotherapy clinics. The differences between systems highlight the need for standardization and/or transparency between systems, especially when evaluating plan quality for multi-institutional clinical trials.
| S-EPMC8248418 | biostudies-literature
Project description:Working memory (WM) is a system for maintenance of and access to a limited number of goal-relevant representations in the service of higher cognition. Because of its limited capacity, WM requires interference-control processes, allowing us to avoid being distracted by irrelevant information. Recent research has proposed two interference-control processes, which are conceptually similar: (1) an active, item-wise removal process assumed to remove no-longer relevant information from WM, and (2) an inhibitory process assumed to suppress the activation of distractors against competing, goal-relevant representations. The purpose of this study was to determine the extent to which the tasks used to assess removal and inhibition measure the same interference-control construct. Results showed acceptable to good reliabilities for nearly all measures. Similar to previous studies, a structural equation modeling approach identified a reliable latent variable of removal. However, also similar to some previous studies, no latent variable of inhibition could be established. This was the case even when the correlation matrix used to compute the latent variable of inhibition was disattenuated for imperfect reliability. Critically, the individual measures of inhibition were unrelated to the latent variable of removal. These results provide tentative support for the notion that removal is not related to the interference-control processes assessed in inhibition tasks. This suggests that the removal process should be conceptualized as a process independent of the concept of inhibition, as proposed in computational WM models that implement removal as the "unbinding" of a WM item from the context in which it occurred.
| S-EPMC7710115 | biostudies-literature
Project description:ImportanceUS hospitals report data on many health care quality metrics to government and independent health care rating organizations, but the annual cost to acute care hospitals of measuring and reporting quality metric data, independent of resources spent on quality interventions, is not well known.ObjectiveTo evaluate externally reported inpatient quality metrics for adult patients and estimate the cost of data collection and reporting, independent of quality-improvement efforts.Design, setting, and participantsRetrospective time-driven activity-based costing study at the Johns Hopkins Hospital (Baltimore, Maryland) with hospital personnel involved in quality metric reporting processes interviewed between January 1, 2019, and June 30, 2019, about quality reporting activities in the 2018 calendar year.Main outcomes and measuresOutcomes included the number of metrics, annual person-hours per metric type, and annual personnel cost per metric type.ResultsA total of 162 unique metrics were identified, of which 96 (59.3%) were claims-based, 107 (66.0%) were outcome metrics, and 101 (62.3%) were related to patient safety. Preparing and reporting data for these metrics required an estimated 108 478 person-hours, with an estimated personnel cost of $5 038 218.28 (2022 USD) plus an additional $602 730.66 in vendor fees. Claims-based (96 metrics; $37 553.58 per metric per year) and chart-abstracted (26 metrics; $33 871.30 per metric per year) metrics used the most resources per metric, while electronic metrics consumed far less (4 metrics; $1901.58 per metric per year).Conclusions and relevanceSignificant resources are expended exclusively for quality reporting, and some methods of quality assessment are far more expensive than others. Claims-based metrics were unexpectedly found to be the most resource intensive of all metric types. Policy makers should consider reducing the number of metrics and shifting to electronic metrics, when possible, to optimize resources spent in the overall pursuit of higher quality.
| S-EPMC10245189 | biostudies-literature
Project description:Occupational well-being is inherent to physicians' professional performance and is indispensable for a cost-effective, robust healthcare system and excellent patient outcomes. Increasing numbers of physicians with symptoms of burnout, depression, and other health issues are demonstrating the need to foster and maintain physicians' well-being. Assessing physicians' well-being, occupational demands, and resources can help create more supportive and health-promoting working environments. The WellNext Scan (WNS) is a 46-item questionnaire developed to assess (i) physicians' well-being and (ii) relevant factors related to physicians' clinical working environment. We collected data to investigate the validity and reliability of the WNS using a non-randomized, multicenter, cross-sectional survey of 467 physicians (staff, residents, doctors not in training, and fellows) from 17 departments in academic and non-academic teaching medical centers in the Netherlands. Exploratory factor analysis detected three composite scales of well-being (energy and work enjoyment, meaning, and patient-related disengagement) and five explanatory factors (supportive team culture, efficiency of practice, job control and team-based well-being practices, resilience, and self-kindness). Pearson's correlations, item-total and inter-scale correlations, and Cronbach's alphas demonstrated good construct validity and internal consistency reliability of the scales (α: 0.67-0.90; item-total correlations: 0.33-0.84; inter-scale correlations: 0.19-0.62). Overall, the WNS appears to yield reliable and valid data and is now available as a supportive tool for meaningful team-based conversations aimed at improving physician well-being.
| S-EPMC11864550 | biostudies-literature
Project description:The purpose of this study was to characterize the motion features of surgical devices associated with laparoscopic surgical competency and build an automatic skill-credential system in porcine cadaver organ simulation training. Participants performed tissue dissection around the aorta, dividing vascular pedicles after applying Hem-o-lok (tissue dissection task) and parenchymal closure of the kidney (suturing task). Movements of surgical devices were tracked by a motion capture (Mocap) system, and Mocap-metrics were compared according to the level of surgical experience (experts: ≥50 laparoscopic surgeries, intermediates: 10-49, novices: 0-9), using the Kruskal-Wallis test and principal component analysis (PCA). Three machine-learning algorithms: support vector machine (SVM), PCA-SVM, and gradient boosting decision tree (GBDT), were utilized for discrimination of the surgical experience level. The accuracy of each model was evaluated by nested and repeated k-fold cross-validation. A total of 32 experts, 18 intermediates, and 20 novices participated in the present study. PCA revealed that efficiency-related metrics (e.g., path length) significantly contributed to PC 1 in both tasks. Regarding PC 2, speed-related metrics (e.g., velocity, acceleration, jerk) of right-hand devices largely contributed to the tissue dissection task, while those of left-hand devices did in the suturing task. Regarding the three-group discrimination, in the tissue dissection task, the GBDT method was superior to the other methods (median accuracy: 68.6%). In the suturing task, SVM and PCA-SVM methods were superior to the GBDT method (57.4 and 58.4%, respectively). Regarding the two-group discrimination (experts vs. intermediates/novices), the GBDT method resulted in a median accuracy of 72.9% in the tissue dissection task, and, in the suturing task, the PCA-SVM method resulted in a median accuracy of 69.2%. Overall, the mocap-based credential system using machine-learning classifiers provides a correct judgment rate of around 70% (two-group discrimination). Together with motion analysis and wet-lab training, simulation training could be a practical method for objectively assessing the surgical competence of trainees.
| S-EPMC9629630 | biostudies-literature
Project description:BackgroundAtrial fibrillation is the most common cardiac arrythmia and causes many complications. Sinus rhythm restoration could reduce late mortality of atrial fibrillation patients. The Maze procedure is the gold standard for surgical ablation of atrial fibrillation. Higher surgical volume has been documented with favorable outcomes of various cardiac procedures such as mitral valve surgery and aortic valve replacement. We aimed to determine the volume-outcome relationship (i.e., association between surgical volume and outcomes) for the concomitant Maze procedure during major cardiac surgeries.MethodsThis nationwide population-based cohort study retrieved data from the Taiwan National Health Insurance Research Database. Adult patients undergoing concomitant Maze procedures during 2010-2017 were identified; consequently, 2666 patients were classified into four subgroups based on hospital cumulative surgery volumes. In-hospital outcomes and late outcomes during follow-up were analyzed. Logistic regression and Cox proportional hazards model were used to analyze the volume-outcome relationship.ResultsPatients undergoing Maze procedures at lower-volume hospitals tended to be frailer and had higher comorbidity scores. Patients in the highest-volume hospitals had a lower risk of in-hospital mortality than those in the lowest-volume hospitals [adjusted odds ratio, 0.30; 95% confidence interval (CI), 0.15-0.61; P < 0.001]. Patients in the highest-volume hospitals had lower rates of late mortality than those in the lowest-volume hospitals, including all-cause mortality [adjusted hazard ratio (aHR) 0.53; 95% CI 0.40-0.68; P < 0.001] and all-cause mortality after discharge (aHR 0.60; 95% CI 0.44-0.80; P < 0.001).ConclusionsA positive hospital volume-outcome relationship for concomitant Maze procedures was demonstrated for in-hospital and late follow-up mortality. The consequence may be attributed to physician skill/experience, experienced multidisciplinary teams, and comprehensive care processes. We suggest referring patients with frailty or those requiring complicated cardiac surgeries to high-volume hospitals to improve clinical outcomes.Trial registrationthe institutional review board of Chang Gung Memorial Hospital approved all data usage and the study protocol (registration number: 202100151B0C502).
| S-EPMC9922454 | biostudies-literature
Project description:Low-cost, portable RGB-D cameras with integrated motion tracking functionality enable easy-to-use 3D motion analysis without requiring expensive facilities and specialized personnel. However, the accuracy of existing systems is insufficient for most clinical applications, particularly when applied to children. In previous work, we developed an RGB-D camera-based motion tracking method and showed that it accurately captures body joint positions of children and young adults in 3D. In this study, the validity and accuracy of clinically relevant motion parameters that were computed from kinematics of our motion tracking method are evaluated in children and young adults. Twenty-three typically developing children and healthy young adults (5-29 years, 110-189 cm) performed five movement tasks while being recorded simultaneously with a marker-based Vicon system and an Azure Kinect RGB-D camera. Motion parameters were computed from the extracted kinematics of both methods: time series measurements, i.e., measurements over time, peak measurements, i.e., measurements at a single time instant, and movement smoothness. The agreement of these parameter values was evaluated using Pearson's correlation coefficients r for time series data, and mean absolute error (MAE) and Bland-Altman plots with limits of agreement for peak measurements and smoothness. Time series measurements showed strong to excellent correlations (r-values between 0.8 and 1.0), MAE for angles ranged from 1.5 to 5 degrees and for smoothness parameters (SPARC) from 0.02-0.09, while MAE for distance-related parameters ranged from 9 to 15 mm. Extracted motion parameters are valid and accurate for various movement tasks in children and young adults, demonstrating the suitability of our tracking method for clinical motion analysis. The low-cost portable hardware in combination with our tracking method enables motion analysis outside of specialized facilities while providing measurements that are close to those of the clinical gold-standard.
| S-EPMC11329219 | biostudies-literature
Project description:BackgroundThe aim of the study were as below. (1) To investigate the feasibility of intravoxel incoherent motion (IVIM)-based virtual magnetic resonance elastography (vMRE) to provide quantitative estimates of tissue stiffness in pulmonary neoplasms. (2) To verify the diagnostic performance of shifted apparent diffusion coefficient (sADC) and reconstructed virtual stiffness values in distinguishing neoplasm nature.MethodsThis study enrolled 59 patients (37 males, 22 females) with one pulmonary neoplasm who underwent computed tomography-guided percutaneous transthoracic needle biopsy (PTNB) with pathological diagnosis (26 adenocarcinoma, 10 squamous cell carcinoma, 3 small cell carcinoma, 4 tuberculosis and 16 non-specific benign; mean age, 60.81 ± 9.80 years). IVIM was performed on a 3 T magnetic resonance imaging scanner before biopsy. sADC and virtual shear stiffness maps reflecting lesion stiffness were reconstructed. sADC and virtual stiffness values of neoplasm were extracted, and the diagnostic performance of vMRE in distinguishing benign and malignant and detailed pathological type were explored.ResultsCompared to benign neoplasms, malignant ones had a significantly lower sADC and a higher virtual stiffness value (P < 0.001). Subsequent subtype analyses showed that the sADC values of adenocarcinoma and squamous cell carcinoma groups were significantly lower than non-specific benign group (P = 0.013 and 0.001, respectively). Additionally, virtual stiffness values of the adenocarcinoma and squamous cell carcinoma subtypes were significantly higher than non-specific benign group (P = 0.008 and 0.001, respectively). However, no significant correlation was found among other subtype groups.ConclusionsNon-invasive vMRE demonstrated diagnostic efficiency in differentiating the nature of pulmonary neoplasm. vMRE is promising as a new method for clinical diagnosis.
| S-EPMC11227719 | biostudies-literature
Project description:PurposeQuantitative measurement of hand motion is essential in evaluating hand function. This study aimed to investigate the validity and reliability of a novel depth camera-based contactless automatic measurement system to assess hand range of motion and its potential benefits in clinical applications.MethodsFive hand gestures were designed to evaluate the hand range of motion using a depth camera-based measurement system. Seventy-one volunteers were enrolled in performing the designed hand gestures. Then, the hand range of motion was measured with the depth camera and manual procedures. System validity was evaluated based on 3 dimensions: repeatability, within-laboratory precision, and reproducibility. For system reliability, linear evaluation, the intraclass correlation coefficient, paired t -test and bias were employed to test the consistency and difference between the depth camera and manual procedures.ResultsWhen measuring phalangeal length, repeatability, within-laboratory precision, and reproducibility were 2.63%, 12.87%, and 27.15%, respectively. When measuring angles of hand motion, the mean repeatability and within-laboratory precision were 1.2° and 3.3° for extension of 5 digits, 2.7° and 10.2° for flexion of 4 fingers, and 3.1° and 5.3° for abduction of 4 metacarpophalangeal joints, respectively. For system reliability, the results showed excellent consistency (intraclass correlation coefficient = 0.823; P < .05) and good linearity with the manual procedures (r = 0.909-0.982, approximately; P < .001). Besides, 78.3% of the measurements were clinically acceptable.ConclusionsOur depth camera-based evaluation system provides acceptable validity and reliability in measuring hand range of motion and offers potential benefits for clinical care and research in hand surgery. However, further studies are required before clinical application.Clinical relevanceThis study suggests a depth camera-based contactless automatic measurement system holds promise for assessing hand range of motion in hand function evaluation, diagnosis, and rehabilitation for medical staff. However, it is currently not adequate for all clinical applications.
| S-EPMC9870814 | biostudies-literature
Project description:The current study aimed to assess the repeatability and validity of cervical range of motion (CROM) measurements using an optical motion capture system (OMCS), compared with a CROM device. A total of 20 healthy volunteers were selected and enrolled in the current study after informed consent was received. The motion of the cervical spine in all directions was measured using the OMCS and CROM devices. Reproducibility of data was assessed using the intra-group correlation coefficient (ICC), standard error of measurement (SEM) and minimum detectable change (MDC). Validity was assessed using the coefficient of determination (R2) in combination with Pearson's correlation coefficient. Bland-Altman plot were presented for the two measurement methods. The range of motion (ROM) was measured by using the OMCS and the CROM device during the same session. Both procedures evidenced high ICCs [OMCS: ICC (1,2) =0.802-0.981; CROM device: ICC (1,2) =0.768-0.948], low SEM values (OMCS: 0.98°-1.38°; CROM device: 1.04°-2.45°) and low MDC values (OMCS: 2.72°-3.81°; CROM device: 2.89°-6.78°). A high R2 (0.568-0.882) and Pearson's correlation coefficient (0.753-0.939) were determined. The Bland-Altman plots demonstrated that most of the data were within the 95% consistency limit. In summary, the OMCS has good repeatability and validity when measuring CROM and is an effective way to evaluate cervical vertebral range of motion.
| S-EPMC6862302 | biostudies-literature