Developing a novel tool to assess the ability to self-administer medication - A systematic evaluation of patients' video recordings in the ABLYMED study.
Ontology highlight
ABSTRACT:
SUBMITTER: Luegering A
PROVIDER: S-EPMC9978218 | biostudies-literature | 2023
REPOSITORIES: biostudies-literature
Publications
Developing a novel tool to assess the ability to self-administer medication - A systematic evaluation of patients' video recordings in the ABLYMED study.
Luegering Anneke A Langner Robert R Wilm Stefan S Doeppner Thorsten R TR Hermann Dirk M DM Frohnhofen Helmut H Gronewold Janine J
Frontiers in medicine 20230216
Similar Datasets
Project description:Assessing nontechnical skills in operating rooms (ORs) is crucial for enhancing surgical performance and patient safety. However, automated and real-time evaluation of these skills remains challenging. To explore the feasibility of using motion features extracted from surgical video recordings to automatically assess nontechnical skills during cardiac surgical procedures. This cross-sectional study used video recordings of cardiac surgical procedures at a tertiary academic US hospital collected from January 2021 through May 2022. The OpenPose library was used to analyze videos to extract body pose estimations of team members and compute various team motion features. The Non-Technical Skills for Surgeons (NOTSS) assessment tool was employed for rating the OR team's nontechnical skills by 3 expert raters. NOTSS overall score, with motion features extracted from surgical videos as measures. A total of 30 complete cardiac surgery procedures were included: 26 (86.6%) were on-pump coronary artery bypass graft procedures and 4 (13.4%) were aortic valve replacement or repair procedures. All patients were male, and the mean (SD) age was 72 (6.3) years. All surgical teams were composed of 4 key roles (attending surgeon, attending anesthesiologist, primary perfusionist, and scrub nurse) with additional supporting roles. NOTSS scores correlated significantly with trajectory (r = 0.51, P = .005), acceleration (r = 0.48, P = .008), and entropy (r = -0.52, P = .004) of team displacement. Multiple linear regression, adjusted for patient factors, showed average team trajectory (adjusted R2 = 0.335; coefficient, 10.51 [95% CI, 8.81-12.21]; P = .004) and team displacement entropy (adjusted R2 = 0.304; coefficient, -12.64 [95% CI, -20.54 to -4.74]; P = .003) were associated with NOTSS scores. This study suggests a significant link between OR team movements and nontechnical skills ratings by NOTSS during cardiac surgical procedures, suggesting automated surgical video analysis could enhance nontechnical skills assessment. Further investigation across different hospitals and specialties is necessary to validate these findings.
| S-EPMC11292454 | biostudies-literature
Project description:Many patients with schizophrenia have negative symptoms, but their evaluation is a challenge. Thus, standardized assessments are needed to facilitate identification of these symptoms. Many tools have been developed, but most are based on observer ratings. Self-evaluation can provide an additional outcome measure and allow patients to be more engaged in their treatment. The aim of this study was to present a novel tool, Self-evaluation of Negative Symptoms (SNS), and demonstrate its validity. Forty-nine patients with schizophrenia and schizoaffective disorders according to DSM-5 were evaluated. Cronbach's coefficient (α = 0.867) showed good internal consistency. Factor analysis extracted 2 factors (apathy and emotional) that accounted for 75.2% of the variance. The SNS significantly correlated with the Scale of Assessment of Negative Symptoms (r= 0.628) and the Clinician Global Impression on the severity of negative symptoms (r= 0.599), supporting good convergent validity. SNS scores did not correlate with level of insight (r= 0.008), Parkinsonism (r= 0.175) or Brief Psychiatric Rating Scale positive subscores (r= 0.253), which indicates good discriminant validity. The intrasubject reliability of the SNS revealed excellent intraclass correlation coefficients (ICC = 0.942). Taken together, the results show that the SNS has good psychometric properties and satisfactory acceptance by patients. The study also demonstrates the ability of patients with schizophrenia to accurately report their own experiences. Self-assessments of negative symptoms should be more widely employed in clinical practice because they may allow patients with schizophrenia to develop appropriate coping strategies.
| S-EPMC4838089 | biostudies-literature
Project description:BackgroundOlder adults often face challenges in medication management due to multimorbidity and complex medication regimens, which frequently go unreported. Unrecognized problems, however, may lead to a loss of drug efficacy and harmful side effects. This study aimed to quantify the prevalence of such problems by applying a novel video-based assessment procedure in a sample of elderly patients.MethodsIn this study, 67 elderly in-patients (≥70 years old and regularly taking ≥5 different drugs autonomously) from the ABLYMED study participated in a placebo-based assessment of medication management with five different dosage forms in an instructed manner while being filmed. Patient performance was quantified by the median value of two raters who evaluated each step of medication administration, which were summed to sum scores for each dosage form and an overall impression for each dosage form with a standardized and previously validated rating scheme.ResultsThe median (Q1;Q3) sum score for tablets was 7.0 (5.0;8.0) with a theoretical range between 4.0 and 17.0, for eye-drops 2.0 (1.0;2.0) with a theoretical range between 1.0 and 5.0, for oral drops 4.0 (3.0;6.0) with a theoretical range between 3.0 and 12.0, for pens 7.0 (5.0;9.0) with a theoretical range between 4.0 and 17.0 and for patches 5.0 (4.0;7.0) with a theoretical range between 3.0 and 15.0. The most difficult step of medication administration was peeling off the protective liner of a patch: 30% had severe difficulties or it was not possible, 21% had moderate difficulties and 49% had mild or no difficulties.DiscussionIn a sample of patients with autonomous medication management, our novel assessment procedure identified a substantial fraction of patients with handling problems for each dosage form. This suggests that patients´ medication management problems should be assessed regularly in clinical routine and tackled by patient-individual training or modification of the prescribed drug regimens to achieve effective drug therapy in the elderly.
| S-EPMC11613422 | biostudies-literature
Project description:IntroductionDue to the COVID-19 pandemic, the recruitment cycle for the 2021 Match was performed virtually. This Association for Surgical Education (ASE)-sponsored survey set out to study applicants' ability to assess the factors contributing to fit through video interviews.MethodsAn IRB-approved, online, anonymous survey was distributed to surgical applicants at a single academic institution and through the ASE clerkship director distribution list between the rank order list certification deadline and Match Day. Applicants used 5-point Likert-type scales to rate factors for importance to fit and their ease of assessment through video interviewing. A variety of recruitment activities were also rated by applicants for their perceived helpfulness in assessment of fit.ResultsOne hundred and eighty-three applicants responded to the survey. The three most important factors for applicant fit were how much the program cared, how satisfied residents seem with their program, and how well residents get along. Resident rapport, diversity of the patient population, and quality of the facilities were hardest to assess through video interviews. In general, diversity-related factors were more important to female and non-White applicants, but not more difficult to assess. Interview day and resident-only virtual panels were the most helpful recruitment activities, while virtual campus tours, faculty-only panels, and a program's social media were the least helpful.ConclusionsThis study provides valuable insight into the limitations of virtual recruitment for surgical applicants' perception of fit. These findings and the recommendations herein should be taken into consideration by residency program leadership to ensure successful recruitment of diverse residency classes.
| S-EPMC10019094 | biostudies-literature
Project description:Background: Patients' non-adherence to medication affects both patients themselves and healthcare systems. Consequences include higher mortality, worsening of disease, patient injuries, and increased healthcare costs. Many existing survey tools for assessing adherence are linked to specific diseases and assessing medication-taking behavior or identifying barriers or beliefs. This study aimed to develop and validate a new non-disease-specific survey tool to assess self-reported medication-taking behavior, barriers, and beliefs in order to quantify the causes of non-adherence and measure adherence. Methods: The survey tool was developed after literature searches and pilot testing. Validation was conducted by assessing the psychometric properties of content, construct, reliability, and feasibility. Content validity was assessed by subject matter experts and construct validity by performing exploratory factor analysis. Reliability assessment was performed by calculating internal consistency, Cronbach's alpha and test/retest reliability, intraclass correlation coefficient (ICC), and standard error of measurement (SEm). A receiver operating characteristic (ROC) curve and the Lui method were used to calculate the statistical cut-off score for good versus poor adherence. Survey responses from Norwegian medication users over 18 years recruited via social media were used for the factor analysis and Cronbach's alpha. Results: The final survey tool contains 37 causes of non-adherence connected to medication-taking behavior and barriers to adherence and beliefs associated with adherence. The overall result for all 37 items demonstrated reliable internal consistency, Cronbach's alpha = 0.91. The factor analysis identified ten latent variables for 29 items, explaining 61.7% of the variance. Seven of the latent variables showed reliable internal consistency: medication fear and lack of effect, conditional practical issues, pregnancy/breastfeeding, information issues, needlessness, lifestyle, and avoiding stigmatization (Cronbach's alpha = 0.72-0.86). Shortage showed low internal consistency (Cronbach's alpha = 0.59). Impact issues and personal practical issues showed poor internal consistency (Cronbach's alpha = 0.51 and 0.48, respectively). The test/retest reliability ICC = 0.89 and SEm = 1.11, indicating good reliability. The statistical cut-off score for good versus poor adherence was 10, but the clinical cut-off score was found to be 2. Conclusion: This survey tool, OMAS-37 (OsloMet Adherence to medication Survey tool, 37 items), demonstrated to be a valid and reliable instrument for assessing adherence. Further studies will examine the ability of the tool for measuring adherence enhancing effect following interventions.
| S-EPMC9768604 | biostudies-literature
Project description:IntroductionConsultation audio recordings improve patient decision-making but are underutilized. Patient-administered recording apps on mobile devices may increase access, but implementation has not been evaluated.MethodsWe conducted a single-arm study delivering education, coaching, and reminders for patients to record their appointment using a mobile recording app. Patients had progressive, advanced prostate cancer and an upcoming appointment where the option of docetaxel would be discussed. We used the RE-AIM framework for evaluation. Reach was the proportion of patients who participated. Effectiveness was change in informed decision-making pre- vs. post-appointment. We used a questionnaire evaluating patient knowledge about docetaxel (0%-100% correct) and the decisional conflict scale-informed subscale (0 = feels extremely uninformed to 100 = extremely informed) to compare means using the paired t-test. Adoption was the proportion of providers agreeing to be recorded. Implementation was coordinator adherence to intervention delivery. We conducted semistructured interviews with patients, caregivers, and providers to assess barriers, facilitators, and suggestions for recording implementation.ResultsOf 102 patients approached, 50 (49%) patients participated. Mean age was 75 years, 38 (76%) were Non-Hispanic White, and 43 (86%) had telehealth appointments. Knowledge increased from 44.7% to 49.5% (p = 0.019), particularly about palliative care (42% answering correctly to 60%, p = 0.035). Decisional conflict-informed subscale increased from 48.9 to 70.9 (p < 0.001). Forty-three patients (85%) made a recording, of whom 33 (77%) reported the recording helped treatment decision-making. All 17 providers agreed to be recorded. Coordinator adherence was high. Multi-level barriers, suggestions, and facilitators mostly related to intervention complexity and stakeholder compatibility.ConclusionPatient-administered audio recordings had a positive effect on decision-making, particularly for palliative care awareness. For broader implementation, efforts should focus on revising institutional policies; teaching patients or caregivers to use existing recording functions on their devices; leveraging artificial intelligence for transcription and summarization; and integrating recording into telehealth technology and electronic patient portals.Trial registrationhttps://clinicaltrials.gov/study/NCT05127850.
| S-EPMC11579662 | biostudies-literature
Project description:ObjectiveThe aim of this study was to develop a reliable and valid self-evaluation tool for use by child protection team (CPT) members.MethodsAn online survey was administered to members of 10 CPTs. The survey included the following 3 sections: 1) initial conditions (eg, team composition, resources), 2) enabling conditions (eg, team effort, strategy), and 3) team effectiveness (eg, team cohesion, meeting performance standards). Each section contained multiple subscales. Internal consistency was calculated using Cronbach α. To evaluate construct validity, the subscale scores of the most advanced teams who qualified as centers of excellence (n = 3) were compared with the subscale scores of the other teams (n = 7) to determine whether the tool could distinguish between the two.ResultsOf 116 team members, 83 (72%) completed the survey. The subscales exhibited good internal consistency (α = .71-.97). The 3 centers of excellence had significantly higher mean scores than the other 7 CPTs on the following subscales: incentives (in the initial conditions section, 61.46 vs 38.89; P = .003), effort (in the enabling conditions section, 79.31 vs 67.70; P = .003), and professional growth (in the team effectiveness section, 83.89 vs 80.40; P = .004).ConclusionsThis novel survey demonstrates satisfactory test characteristics and can be used to assess CPT performance and identify areas for improvement.
| S-EPMC3215912 | biostudies-literature
Project description:BackgroundPediatric critical care medicine requires the acquisition of procedural skills, but to date no criteria exist for assessing trainee competence in central venous catheter (CVC) insertion.ObjectiveThe goal of this study was to create and demonstrate validity evidence for a direct observation tool for assessing CVC insertion.MethodsTen experts used the modified Delphi technique to create a 15-item direct observation tool to assess 5 scripted and filmed simulated scenarios of CVC placement. The scenarios were hosted on a dedicated website from March to May 2013, and respondents recruited by e-mail completed the observation tool in real time while watching the scenarios. The goal was to obtain 50 respondents and a total of 250 scenario ratings.ResultsA total of 49 pediatrics intensive care faculty physicians (6.3% of 780 potential subjects) responded and generated 188 scenario observations. Of these, 150 (79.8%) were recorded from participants who scored 4 or more on the 5 scenarios. The tool correctly identified the expected reference standard in 96.8% of assessments with an interrater agreement kappa (standard error) = 0.94 (0.07) and receiver operating characteristic = 0.97 (95% CI 0.94-0.99).ConclusionsThis direct observation assessment tool for central venous catheterization demonstrates excellent performance in identifying the reference standard with a high degree of interrater reliability. These assessments support a validity construct for a pediatric critical care medicine faculty member to assess a provider placing a CVC in a pediatrics patient.
| S-EPMC4936851 | biostudies-literature
Project description:BackgroundHealth technology assessment (HTA) brings together evidence from various disciplines while using explicit methods to assess the value of health technologies. In resource-constrained settings, there is a growing demand to measure and develop specialist skills, including those for HTA, to aid the implementation of Universal Healthcare Coverage. The purpose of this study was twofold: a) to find validated tools for the assessment of the technical capacity to conduct a HTA, and if none were found, to develop a tool, and b) to describe experiences of its pilot.MethodsFirst, a mapping review identified tools to assess the skills to conduct a HTA. A medical librarian conducted a comprehensive search in four databases (MEDLINE, Embase, Web of Science, ERIC). Then, incorporating results from the mapping and following an iterative process involving stakeholders and experts, we developed a HTA skills assessment tool. Finally, using an online platform to gather and analyse responses, in collaboration with our institutional partner, we piloted the tool in Ghana, and sought feedback on their experiences.ResultsThe database search yielded 3871 records; fifteen those were selected based on a priori criteria. These records were published between 2003 and 2018, but none covered all technical skills to conduct a HTA. In the absence of an instrument meeting our needs, we developed a HTA skill assessment tool containing four sections (general information, core and soft skills, and future needs). The tool was designed to be administered to a broad range of individuals who would potentially contribute to the planning, delivery and evaluation of HTA. The tool was piloted with twenty-three individuals who completed the skills assessment and shared their initial impressions of the tool.ConclusionsTo our knowledge, this is the first comprehensive tool enabling the assessment of technical skills to conduct a HTA. This tool allows teams to understand where their individual strengths and weakness lie. The tool is in the early validation phases and further testing is needed.Trial registrationNot applicable.
| S-EPMC8939100 | biostudies-literature
Project description:BACKGROUND:Diagnostic radiology residency programs pursuits as main objectives of the development of diagnostic capabilities and written communication skills to answer clinicians' questions of referring clinicians. There has been also an increasing focus on competencies, rather than just education inputs. Then, to show ongoing professional development is necessary for a system to assess and document resident's competence in these areas. Therefore, we propose the implementation of an informatics tool to objectively assess resident's progress in developing diagnostics and reporting skills. We expect to found decreased preliminary report-final report variability within the course of each year of the residency program. RESULTS:We analyzed 12,162 evaluations from 32 residents (8 residents per year in a 4-year residency program) in a 7-month period. 73.96% of these evaluations belong to 2nd-year residents. We chose two indicators to study the evolution of evaluations: the total of discrepancies over the total of preliminary reports (excluding score 0) and the total of likely to be clinically significant discrepancies (scores 2b, 3b, and 4b) over the total of preliminary reports (excluding score 0). With the analysis of these two indicators over the evaluations of 2nd-year residents, we found a slight decrease in the value of the first indicator and relative stable behavior of the second one. CONCLUSIONS:This tool is useful for objective assessment of reporting skill of radiology residents. It can provide an opportunity for continuing medical education with case-based learning from those cases with clinically significant discrepancies between the preliminary and the final report.
| S-EPMC6757078 | biostudies-literature