Context and Complexity in Telemedicine Evaluation: Work Domain Analysis in a Surgical Setting.
Ontology highlight
ABSTRACT:
SUBMITTER: Aminoff H
PROVIDER: S-EPMC8485199 | biostudies-literature | 2021 Sep
REPOSITORIES: biostudies-literature
Publications
Context and Complexity in Telemedicine Evaluation: Work Domain Analysis in a Surgical Setting.
Aminoff Hedvig H Meijer Sebastiaan S
JMIR perioperative medicine 20210916 2
Many promising telemedicine innovations fail to be accepted and used over time, and there are longstanding questions about how to best evaluate telemedicine services and other health information technologies. In response to these challenges, there is a growing interest in how to take the sociotechnical complexity of health care into account during design, implementation, and evaluation. This paper discusses the methodological implications of this complexity and how the sociotechnical context hol ...[more]
Similar Datasets
Project description:BackgroundA telemedicine service enabling remote surgical consultation had shown promising results. When the service was to be scaled up, it was unclear how contextual variations among different clinical sites could affect the clinical outcomes and implementation of the service. It is generally recognized that contextual factors and work system complexities affect the implementation and outcomes of telemedicine. However, it is methodologically challenging to account for context in complex health care settings. We conducted a work domain analysis (WDA), an engineering method for modeling and analyzing complex work environments, to investigate and represent contextual influences when a telemedicine service was to be scaled up to multiple hospitals.ObjectiveWe wanted to systematically characterize the implementation contexts at the clinics participating in the scale-up process. Conducting a WDA would allow us to identify, in a systematic manner, the functional constraints that shape clinical work at the implementation sites and set the sites apart. The findings could then be valuable for informed implementation and assessment of the telemedicine service.MethodsWe conducted observations and semistructured interviews with a variety of stakeholders. Thematic analysis was guided by concepts derived from the WDA framework. We identified objects, functions, priorities, and values that shape clinical procedures. An iterative "discovery and modeling" approach allowed us to first focus on one clinic and then readjust the scope as our understanding of the work systems deepened.ResultsWe characterized three sets of constraints (ie, facets) in the domain: the treatment facet, administrative facet (providing resources for procedures), and development facet (training, quality improvement, and research). The constraints included medical equipment affecting treatment options; administrative processes affecting access to staff and facilities; values and priorities affecting assessments during endoscopic retrograde cholangiopancreatography; and resources for conducting the procedure.ConclusionsThe surgical work system is embedded in multiple sets of constraints that can be modeled as facets of the system. We found variations between the implementation sites that might interact negatively with the telemedicine service. However, there may be enough motivation and resources to overcome these initial disruptions given that values and priorities are shared across the sites. Contrasting the development facets at different sites highlighted the differences in resources for training and research. In some cases, this could indicate a risk that organizational demands for efficiency and effectiveness might be prioritized over the long-term outcomes provided by the telemedicine service, or a reduced willingness or ability to accept a service that is not yet fully developed or adapted. WDA proved effective in representing and analyzing these complex clinical contexts in the face of technological change. The models serve as examples of how to analyze and represent a complex sociotechnical context during telemedicine design, implementation, and assessment.
| S-EPMC8277332 | biostudies-literature
Project description:BackgroundAlthough radical gastrectomy with lymph node dissection is the standard treatment for gastric cancer, the complication rate remains high. Thus, estimation of surgical complexity is required for safety. We aim to investigate the association between the surgical process and complexity, such as a risk of complications in robotic distal gastrectomy (RDG), to establish an artificial intelligence (AI)-based automated surgical phase recognition by analyzing robotic surgical videos, and to investigate the predictability of surgical complexity by AI.MethodThis study assessed clinical data and robotic surgical videos for 56 patients who underwent RDG for gastric cancer. We investigated (1) the relationship between surgical complexity and perioperative factors (patient characteristics, surgical process); (2) AI training for automated phase recognition and model performance was assessed by comparing predictions to the surgeon-annotated reference; (3) AI model predictability for surgical complexity was calculated by the area under the curve.ResultSurgical complexity score comprised extended total surgical duration, bleeding, and complications and was strongly associated with the intraoperative surgical process, especially in the beginning phases (area under the curve 0.913). We established an AI model that can recognize surgical phases from video with 87% accuracy; AI can determine intraoperative surgical complexity by calculating the duration of beginning phases from phases 1-3 (area under the curve 0.859).ConclusionSurgical complexity, as a surrogate of short-term outcomes, can be predicted by the surgical process, especially in the extended duration of beginning phases. Surgical complexity can also be evaluated with automation using our artificial intelligence-based model.
| S-EPMC9949687 | biostudies-literature
Project description:Background: Children with medical complexity (CMC) are high utilizers of health care services. Telehealth encounters may provide a means to improve care outcomes for this population. Objective: To evaluate the feasibility, usability, and impact of an in-home telehealth device in the care of CMC. Methods: This single-center feasibility study employed a nonblinded randomized clinical trial design. English-speaking caregivers of children within a pediatric complex care program with home Wi-Fi were eligible for participation. Participants were randomized 1.5:1 with stratification based on tracheostomy status to a control group that received usual care or an intervention group that received a telehealth device for in-home use. Patients were followed up for 4 months. The primary outcome was successful device connectivity and data transmission. Data included clinician encounter device usability; caregiver satisfaction; and encounter type, purpose, and cost. Descriptive statistics, negative binomial regression, and Kaplan-Meier plot were used for analysis. Results: Twenty-four patients were enrolled (9 controls, 15 in the intervention group) in September 2016. The telehealth device was attempted in 73 encounters. Device connectivity was successful 96% of the time. Image and sound quality were acceptable in 98% of visits. Caregivers expressed their overall satisfaction with the device. The hospitalization rate was lower in the intervention group (0.77 vs. 1.14 intensive care unit days/patient-months), resulting in $9,425/USD per patient savings compared with the control group. Conclusion: Despite small sample size and short observation period, this study demonstrated that use of an in-home telehealth device is feasible, well received by caregivers, and can result in decreased hospitalizations when compared with usual care.
| S-EPMC6842894 | biostudies-literature
Project description:ObjectiveTo develop and evaluate a guideline for a paediatric telemedicine and medication delivery service (TMDS).MethodsA clinical guideline for paediatric telemedicine was derived from the World Health (WHO) Organization Integrated Management of Childhood Illness (IMCI) Handbook. The guideline was deployed at a TMDS in Haiti and evaluated through a prospective cohort study; children ≤10 years were enrolled. For non-severe cases, paired virtual and in-person examinations were conducted at the call centre and household; severe cases were referred to the hospital. The performance of virtual examination components were evaluated by comparison with the paired in-person examination findings (reference).ResultsA total of 391 cases were enrolled. Among the 320 cases with paired examinations, no general WHO danger signs were identified during in-person examinations; 5 cases (2%) required hospital referral due to problem-specific danger signs or other reasons for escalation. Cohen's kappa for the virtual designation of mild cases was 0.78 (95% CI: 0.69 to 0.87). The sensitivity and specificity of a virtually reported fever were 91% (95% CI: 87% to 96%) and 69% (95% CI: 62% to 76%), respectively; the sensitivity and specificity of virtually reported 'fast breathing' were 47% (95% CI: 21% to 72%) and 89% (95% CI: 85% to 94%), respectively. Kappa for 'no' and 'some' dehydration indicated moderate congruence between virtual and in-person examinations (0.69; 95% CI: 0.41 to 0.98). At 10 days, 273 (95%) of the 287 cases reached by phone were better/recovered.ConclusionCritical components of the virtual examination (triage, danger signs and dehydration assessment) performed well despite varied performance among the problem-specific components. The study and associated resources represents formative steps towards an evidence-based paediatric telemedicine guideline built on WHO clinical principles. In-person examinations for select cases were important to address limitations with virtual examinations and identify cases for escalation.Trial registration numberNCT03943654.
| S-EPMC10806461 | biostudies-literature
Project description:Community empowerment interventions, which aim to build greater individual and community control over health, are shaped by the community systems in which they are implemented. Drawing on complex systems thinking in public health research, this paper discusses the evaluation approach used for a UK community empowerment programme focused on disadvantaged neighbourhoods. It explores design choices and the tension between the overall enquiry questions, which were based on a programme theory of change, and the varied dynamic socio-cultural contexts in intervention communities. The paper concludes that the complexity of community systems needs to be accounted for through in-depth case studies that incorporate community perspectives.
| S-EPMC6981559 | biostudies-literature
Project description:PurposeTo evaluate the performance of a telemedicine platform integrated with optical coherence tomography (OCT) and artificial intelligence (AI) techniques for retinal disease screening and referral.MethodsWe constructed an OCT-AI-based telemedicine platform and deployed it at four primary care stations located in Jing'an district, Shanghai, to detect retinal disease cases among aged groups and refer them to Shanghai Tenth People's Hospital (TENTH Hospital). Two ophthalmologists jointly graded the data set collected from this pilot application, and then the performance of this platform was analyzed from multiple aspects.ResultsThis study included 1257 participants between July 2020 and September 2020, of whom 394 had retinal pathologies and 146 were even considered urgent cases by the ophthalmologists. The OCT-AI models achieved a sensitivity of 96.6% (95% confidence interval [CI], 91.8%-98.7%) and specificity of 98.8% (95% CI, 98.0%-99.3%) for detecting urgent cases and a sensitivity of 98.5% (95% CI, 96.5%-99.4%) and specificity of 96.2% (95% CI, 94.6%-97.3%) for detecting both urgent and routine cases. Coupled with AI, our platform reduced the workload of human consultation by 96.2% for massive normal cases. The detected disease cases received online medical suggestions at an average time of 21.4 hours via this platform.ConclusionsThis platform can automatically identify patients with retinal disease with high sensitivity and specificity, support timely human consultation, and bring necessary referrals.Translational relevanceThe OCT-AI-based telemedicine platform shows great practical value for retinal disease screening and referral in a real-world primary care setting.
| S-EPMC8914565 | biostudies-literature
Project description:The COVID-19 pandemic has boosted digital health utilization, raising concerns about increased physicians' after-hours clinical work ("work-outside-work"). The surge in patients' digital messages and additional time spent on work-outside-work by telemedicine providers underscores the need to evaluate the connection between digital health utilization and physicians' after-hours commitments. We examined the impact on physicians' workload from two types of digital demands - patients' messages requesting medical advice (PMARs) sent to physicians' inbox (inbasket), and telemedicine. Our study included 1716 ambulatory-care physicians in New York City regularly practicing between November 2022 and March 2023. Regression analyses assessed primary and interaction effects of (PMARs) and telemedicine on work-outside-work. The study revealed a significant effect of PMARs on physicians' work-outside-work and that this relationship is moderated by physicians' specialties. Non-primary care physicians or specialists experienced a more pronounced effect than their primary care peers. Analysis of their telemedicine load revealed that primary care physicians received fewer PMARs and spent less time in work-outside-work with more telemedicine. Specialists faced increased PMARs and did more work-outside-work as telemedicine visits increased which could be due to the difference in patient panels. Reducing PMAR volumes and efficient inbasket management strategies needed to reduce physicians' work-outside-work. Policymakers need to be cognizant of potential disruptions in physicians carefully balanced workload caused by the digital health services.
| S-EPMC10867011 | biostudies-literature
Project description:BackgroundTwo characteristics of commonly used outcomes in medical research are zero inflation and non-negative integers; examples include the number of hospital admissions or emergency department visits, where the majority of patients will have zero counts. Zero-inflated regression models were devised to analyze this type of data. However, the performance of zero-inflated regression models or the properties of data best suited for these analyses have not been thoroughly investigated.MethodsWe conducted a simulation study to evaluate the performance of two generalized linear models, negative binomial and zero-inflated negative binomial, for analyzing zero-inflated count data. Simulation scenarios assumed a randomized controlled trial design and varied the true underlying distribution, sample size, and rate of zero inflation. We compared the models in terms of bias, mean squared error, and coverage. Additionally, we used logistic regression to determine which data properties are most important for predicting the best-fitting model.ResultsWe first found that, regardless of the rate of zero inflation, there was little difference between the conventional negative binomial and its zero-inflated counterpart in terms of bias of the marginal treatment group coefficient. Second, even when the outcome was simulated from a zero-inflated distribution, a negative binomial model was favored above its ZI counterpart in terms of the Akaike Information Criterion. Third, the mean and skewness of the non-zero part of the data were stronger predictors of model preference than the percentage of zero counts. These results were not affected by the sample size, which ranged from 60 to 800.ConclusionsWe recommend that the rate of zero inflation and overdispersion in the outcome should not be the sole and main justification for choosing zero-inflated regression models. Investigators should also consider other data characteristics when choosing a model for count data. In addition, if the performance of the NB and ZINB regression models is reasonably comparable even with ZI outcomes, we advocate the use of the NB regression model due to its clear and straightforward interpretation of the results.
| S-EPMC10523642 | biostudies-literature
Project description:MotivationThe modeling of conservation patterns in genomic DNA has become increasingly popular for a number of bioinformatic applications. While several systems developed to date incorporate context-dependence in their substitution models, the impact on computational complexity and generalization ability of the resulting higher order models invites the question of whether simpler approaches to context modeling might permit appreciable reductions in model complexity and computational cost, without sacrificing prediction accuracy.ResultsWe formulate several alternative methods for context modeling based on windowed Bayesian networks, and compare their effects on both accuracy and computational complexity for the task of discriminating functionally distinct segments in vertebrate DNA. Our results show that substantial reductions in the complexity of both the model and the associated inference algorithm can be achieved without reducing predictive accuracy.
| S-EPMC2732293 | biostudies-literature
Project description:The Sars-CoV-2 pandemic catalysed integration of telemedicine worldwide. This systematic review assesses it's accuracy for diagnosis of Surgical Site Infection (SSI). Databases were searched for telemedicine and wound infection studies. All types of studies were included, only paired designs were taken to meta-analysis. QUADAS-2 assessed methodological quality. 1400 titles and abstracts were screened, 61 full text reports were assessed for eligibility and 17 studies were included in meta-analysis, mean age was 47.1 ± 13.3 years. Summary sensitivity and specificity was 87.8% (95% CI, 68.4-96.1) and 96.8% (95% CI 93.5-98.4) respectively. The overall SSI rate was 5.6%. Photograph methods had lower sensitivity and specificity at 63.9% (95% CI 30.4-87.8) and 92.6% (95% CI, 89.9-94.5). Telemedicine is highly specific for SSI diagnosis is highly specific, giving rise to great potential for utilisation excluding SSI. Further work is needed to investigate feasibility telemedicine in the elderly population group.
| S-EPMC9349203 | biostudies-literature