Identifying factors that promote and limit the effective use of real-time patient experience feedback: a mixed-methods study in secondary care.
Ontology highlight
ABSTRACT: Objectives
The Friends and Family Test (FFT) is commissioned by the National Health Service (NHS) in England to capture patient experience as a real-time feedback initiative for patient-centred quality improvement (QI). The aim of this study was to create a process map in order to identify the factors that promote and limit the effective use of FFT as a real-time feedback initiative for patient-centred QI.Setting
This study was conducted at a large London NHS Trust. Services include accident and emergency, inpatient, outpatient and maternity, which routinely collect FFT patient experience data.Participants
Healthcare staff and key stakeholders involved in FFT.Interventions
Semi-structured interviews were conducted on 15 participants from a broad range of professional groups to evaluate their engagement with the FFT. Interview data were recorded, transcribed and analysed for using deductive thematic analysis.Results
Concerns related to inefficiency in the flow of FFT data, lack of time to analyse FFT reports (with emphasis on high level reporting rather than QI), insufficient access to FFT reports and limited training provided to understand FFT reports for frontline staff. The sheer volume of data received was not amenable to manual thematic analysis resulting in inability to acquire insight from the free text. This resulted in staff ambivalence towards FFT as a near real-time feedback initiative.Conclusions
The results state that there is too much FFT free text for meaningful analysis, and the output is limited to the provision of sufficient capacity and resource to analyse the data, without consideration of other options, such as text analytics and amending the data collection tool.
SUBMITTER: Khanbhai M
PROVIDER: S-EPMC8655585 | biostudies-literature | 2021 Dec
REPOSITORIES: biostudies-literature
Publications
Identifying factors that promote and limit the effective use of real-time patient experience feedback: a mixed-methods study in secondary care.
Khanbhai Mustafa M Flott Kelsey K Manton Dave D Harrison-White Stephanie S Klaber Robert R Darzi Ara A Mayer Erik E
BMJ open 20211208 12
<h4>Objectives</h4>The Friends and Family Test (FFT) is commissioned by the National Health Service (NHS) in England to capture patient experience as a real-time feedback initiative for patient-centred quality improvement (QI). The aim of this study was to create a process map in order to identify the factors that promote and limit the effective use of FFT as a real-time feedback initiative for patient-centred QI.<h4>Setting</h4>This study was conducted at a large London NHS Trust. Services incl ...[more]
Similar Datasets
Project description:BackgroundPatients in health systems across the world can now choose between different health care providers. Patients are increasingly using websites and apps to compare the quality of health care services available in order to make a choice of provider. In keeping with many patient-facing platforms, most services currently providing comparative information on different providers do not take account of end-user requirements or the available evidence base.ObjectiveTo investigate what factors were considered most important when choosing nonemergency secondary health care providers in the United Kingdom with the purpose of translating these insights into a ratings platform delivered through a consumer mHealth app.MethodsA mixed methods approach was used to identify key indicators incorporating a literature review to identify and categorize existing quality indicators, a questionnaire survey to formulate a ranked list of performance indicators, and focus groups to explore rationales behind the rankings. Findings from qualitative and quantitative methodologies were mapped onto each other under the four categories identified by the literature review.ResultsQuality indicators were divided into four categories. Hospital access was the least important category. The mean differences between the other three categories hospital statistics, hospital staff, and hospital facilities, were not statistically significant. Staff competence was the most important indicator in the hospital staff category; cleanliness and up-to-date facilities were equally important in hospital facilities; ease of travel to the hospital was found to be most important in hospital access. All quality indicators within the hospital statistics category were equally important. Focus groups elaborated that users find it difficult to judge staff competence despite its importance.ConclusionsA mixed methods approach is presented, which supported a patient-centered development and evaluation of a hospital ratings mobile app. Where possible, mHealth developers should use systematic research methods in order to more closely meet the needs of the end user and add credibility to their platform.
| S-EPMC4526909 | biostudies-literature
Project description:BackgroundIncreasing physical activity (PA) behavior remains a public health priority, and wearable technology is increasingly being used to support behavior change efforts. Using wearables to capture and provide comprehensive, visually persuasive, multidimensional feedback with real-time support may be a promising way of increasing PA in inactive individuals.ObjectiveThis study aims to explore whether a 6-week self-monitoring intervention using composite web-based multidimensional PA feedback with real-time daily feedback supports increased PA in adults.MethodsA 6-week, mixed methods, 2-armed exploratory randomized controlled trial with 6-week follow-up was used, whereby low to moderately active (PA level [PAL] <2.0) adults (mean age 51.3 years, SD 8.4 years; women 28/51, 55%) were randomly assigned to receive the self-monitoring intervention (36/51, 71%) or waiting list control (15/51, 29%). Assessment of PA across multiple health-harnessing PA dimensions (eg, PAL, weekly moderate to vigorous intensity PA, sedentary time, and steps), psychosocial cognitions (eg, behavioral regulation, barrier self-efficacy, and habit strength), and health were made at the prerandomization baseline at 6 and 12 weeks. An exploratory analysis of the mean difference and CIs was conducted using the analysis of covariance model. After the 12-week assessment, intervention participants were interviewed to explore their views on the program.ResultsThere were no notable differences in any PA outcome immediately after the intervention; however, at 12 weeks, moderate-to-large effects were observed with a mean difference in PAL of 0.09 (95% CI 0.02-0.15; effect size [Hedges g] 0.8), daily moderate-intensity PA of 24 (95% CI 0-45; Hedges g=0.6) minutes, weekly moderate-to-vigorous intensity PA of 195 (95% CI 58-331; Hedges g=0.8) minutes, and steps of 1545 (95% CI 581-2553; Hedges g=0.7). Descriptive analyses suggested that the differences in PA at 12 weeks were more pronounced in women and participants with lower baseline PA levels. Immediately after the intervention, there were favorable differences in autonomous motivation, controlled motivation, perceived competence for PA, and barrier self-efficacy, with the latter sustained at follow-up. Qualitative data implied that the intervention was highly informative for participants and that the real-time feedback element was particularly useful in providing tangible, day-to-day behavioral support.ConclusionsUsing wearable trackers to capture and present sophisticated multidimensional PA feedback combined with discrete real-time support may be a useful way of facilitating changes in behavior. Further investigation into the ways of optimizing the use of wearables in inactive participants and testing the efficacy of this approach via a robust study design is warranted.Trial registrationClinicalTrials.gov NCT02432924; https://clinicaltrials.gov/ct2/show/NCT02432924.
| S-EPMC8928046 | biostudies-literature
Project description:BackgroundUpper-limb prostheses are regularly abandoned, in part due to the mismatch between user needs and prostheses performance. Sensory feedback is among several technological advances that have been proposed to reduce device abandonment rates. While it has already been introduced in some high-end commercial prostheses, limited data is available about user expectations in relation to sensory feedback. The aim of this study is thus to use a mixed methods approach to provide a detailed insight of users' perceptions and expectations of sensory feedback technology, to ensure the addition of sensory feedback is as acceptable, engaging and ultimately as useful as possible for users and, in turn, reduce the reliance on compensatory movements that lead to overuse syndrome.MethodsThe study involved an online survey (N = 37) and video call interviews (N = 15) where adults with upper-limb differences were asked about their experience with limb difference and prosthesis use (if applicable) and their expectations about sensory feedback to prostheses. The survey data were analysed quantitatively and descriptively to establish the range of sensory feedback needs and their variations across the different demographics. Reflexive thematic analysis was performed on the interview data, and data triangulation was used to understand key behavioural issues to generate actionable guiding principles for the development of sensory feedback systems.ResultsThe survey provided a list of practical examples and suggestions that did not vary with the different causes of limb difference or prosthesis use. The interviews showed that although sensory feedback is a desired feature, it must prove to have more benefits than drawbacks. The key benefit mentioned by participants was increasing trust, which requires a highly reliable system that provides input from several areas of the hand rather than just the fingertips. The feedback system should also complement existing implicit feedback sources without causing confusion or discomfort. Further, the effect sensory feedback has on the users' psychological wellbeing was highlighted as an important consideration that varies between individuals and should therefore be discussed. The results obtained were used to develop guiding principles for the design and implementation of sensory feedback systems.ConclusionsThis study provides a mixed-methods research on the sensory feedback needs of adults with upper-limb differences, enabling a deeper understanding of their expectations and worries. Guiding principles were developed based on the results of a survey and interviews to inform the development and assessment of sensory feedback for upper-limb prostheses.
| S-EPMC9308922 | biostudies-literature
Project description:BackgroundIn South Korea, most graduated medical students undertake a 1-year internship before beginning residency and specialization. Interns usually work in a tertiary hospital and rotate between different, randomly assigned departments to be exposed to different medical specialties. Their jobs are mostly simple and repetitive but are still essential for the patient care process. However, owing to the lack of experience and overwhelming workload, interns at tertiary hospitals in South Korea are usually inefficient, often delaying the entire clinical process. Health care providers have widely adopted mobile electronic medical records (mEMRs) as they have been shown to improve workflow efficiency.ObjectiveThis study investigates the association between the frequency of mEMR usage and the clinical task completion interval time among interns in a tertiary hospital.MethodsThis mixed methods study was conducted at the Samsung Medical Center, Seoul, South Korea. Interns who worked at the Samsung Medical Center from March 2018 to February 2019 were included. The hospital electronic medical record (EMR) system known as DARWIN (Data Analysis and Research Window for Integrated kNowledge) was launched with PC and mobile. Both versions are actively used in hospitals by personnel in various positions. We collected the log data from the mEMR server and the intern clinical task time-series data from the EMR server. Interns can manage the process of identifying patients, assigning the clinical task, finishing the requested clinical intern tasks, etc, through the use of the mEMR system. We compared the clinical task completion interval among 4 groups of interns divided by the mEMR frequency quantile. Then, System Usability Score (SUS) questionnaires and semistructured interviews were conducted.ResultsThe regular mEMR users were defined as those who logged in more than once a day on average and used the mEMR until the level after login. Among a total of 87 interns, 84 used the mEMR to verify the requested clinical tasks. The most frequently used item was "Intern task list." Analysis of the 4 intern groups revealed an inverse relationship between the median time of the task completion interval and the frequency of mEMR use. Correlation analysis showed that the intern task completion time interval had a significant inverse relationship with the individual frequency of mEMR usage (coefficient=-0.27; 95% CI -0.46 to -0.04; P=.02). In the additional survey, the mean SUS value was 81.67, which supported the results of the data analysis.ConclusionsOur findings suggest that frequent mEMR use is associated with improved work efficiency in hospital interns with good usability of the mEMR. Such finding supports the idea that the use of mEMR improves the effectiveness and workflow efficiency of interns working in hospitals and, more generally, in the context of health care.
| S-EPMC7772071 | biostudies-literature
Project description:BackgroundThe use of patient feedback is essential for identifying areas for improvement and tailoring care to the needs of patients, particularly in the context of eHealth, which has increased in adoption due to the pandemic. However, challenges persist in collecting feedback from vulnerable groups, those with severe conditions, or language barriers. Furthermore, concerns exist about the credibility and validity of the feedback received. This study aims to explore various possible forms that general practitioners (GPs) could use to collect patient feedback on eHealth applications in their daily practice.MethodsA Participatory Research (PR) was conducted involving an advisory group, patients, GPs and medical receptionists. The advisory group consisting of GPs, a board member, patient representatives and digital care manager affiliated with the primary care organisation 'Regionale Organisatie Huisartsen Amsterdam' (ROHA). The group provided input throughout the research process from the setup, data collection and interpretation to the finalization phase. Semi-structured interviews were conducted with 13 patients, 8 GPs and 2 medical receptionists. Participants were recruited through purposive sampling. Interviews were coded using Thematic Analysis.ResultsFour themes were considered important. First, timing of feedback. Gathering instant feedback immediately after digital interactions was considered important. Secondly, the feedback procedure, whereby feedback should be given through the same communication channel as was used for the doctor-patient contact was valued. Also, participants preferred short and specific surveys, in which they can remain anonymous. Thirdly, for the feedback content some key feedback topics included general experiences, quality of care and technical aspects. The last theme was advertisement. Overall, patients do not want to burden their GP and thus tend to only give feedback if initiated by their GP. GPs themselves pointed out to have limited time for collecting feedback from patients due to their workload.ConclusionGPs can optimize the feedback collection process by selecting targeted questions and integrating them into existing eHealth applications, thereby investing minimal time from GPs and patients. It is recommended to include automatic selected questions at the end of e-consultations. This integrated approach allows efficient feedback collection without burdening GPs.
| S-EPMC11823149 | biostudies-literature
Project description:BackgroundFor effective self-directed life-long learning physicians need to engage in feedback-seeking, which means fostering such behavior during training. Self-determination theory (SDT) posits that intrinsic motivation is fostered when the environment optimizes the individual's experience of autonomy, relatedness, and competence. Educational settings meeting these psychological needs may foster intrinsic motivation in trainees, enhance their desire for feedback, and promote feedback-seeking. We sought to examine residents' feedback-seeking behaviors through the lens of SDT and explore the association with intrinsic motivation and career choice.MethodsWe used a mixed-methods approach with an explanatory sequential design. Residents participated in simulation training, completed an inventory of intrinsic motivation (IMI) and responded to sequential opportunities for performance feedback requiring different levels of effort. We compared IMI scores and career choice between groups with different effort. We interviewed high-effort feedback-seekers and conducted thematic analysis of interview data.ResultsThirty-four of 35 residents completed the survey (97%). Of those completing the study, 12 engaged in low-effort feedback-seeking only, 10 indicated intent for high-effort feedback-seeking and 10 actually engaged in higher effort to get feedback. Groups did not differ in mean IMI scores. Among high-effort feedback-seekers more residents were interested in critical care-related fields compared to the other groups. We identified 5 themes around autonomy, relatedness, and competence clarifying residents' reasons for feedback-seeking.ConclusionsOur findings suggest that among residents, the relationship between motivation and feedback-seeking is complex and cannot be predicted by IMI score. Career plans and relationships with feedback providers impact feedback-seeking, which can inform educational interventions.
| S-EPMC6007008 | biostudies-literature
Project description:Introduction and objectivesDue to the lack of structured and systematic information available, the aim of this study was to describe the epidemiology, diagnosis, healthcare processes, and treatment patterns of hereditary angioedema (HAE) in Mexico. To achieve this, different data sources were consulted regarding medical literature, structured health system databases, and angioedema-specialized physicians (AEP) opinion regarding HAE.Material and methodsA mixed methods approach was conducted in 4 phases: I) systematic literature review (SLR) and meta-analysis according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines; II) review of national health system (NHS) databases and systematic reports; III) physician survey; and IV) an epidemiologic model. ICD 10 D84.1 encoded records from the NHS were used to estimate the number of patients with HAE attended and treated during 2019. A survey was implemented to increase understanding of the clinical profile and treatments used.ResultsA prevalence rate of 0.9/50 000 inhabitants was estimated for 2019. In the same year, an estimated 317 HAE type 1 patients were recorded in the NHS, aged ≥11 years old. The most frequent clinical symptoms were cutaneous edema (67.5%) and abdominal pain (47.9%). A severe episode with laryngeal edema appeared in 27.5% of cases. Acute episodes were mainly moderate to severe (77.0%), with an annual per capita frequency of emergency visits of 7.6 patient-year (range 1-12/patient-year). The main reasons for hospitalization corresponded to laryngeal facial, tongue, and abdominal edemas, representing 73.3% of annual ICD 10 D84.1 reported hospitalizations. The main treatments that patients with HAE received were fresh frozen plasma for acute attacks and danazol for short-term prophylaxis (STP).ConclusionsDespite efforts to make HAE visible, according to this study, cases recognized and treated in the NHS represent only 16.6% of the estimated prevalence.
| S-EPMC10506135 | biostudies-literature
Project description:BackgroundEffective self-care is an important factor in the successful management of patients with heart failure (HF). Despite the importance of self-care, most patients with HF are not adequately taught the wide range of skills required to become proficient in self-care. Digital health technology (DHT) may provide a novel solution to support patients at home in effective self-care, with the view to enhancing the quality of life and ultimately improving patient outcomes. However, many of the solutions developed to date have failed to consider users' perspectives at the point of design, resulting in poor effectiveness. Leveraging a human-centered design (HCD) approach to the development of DHTs may lead to the successful promotion of self-care behaviors in patients with HF.ObjectiveThis study aimed to outline the HCD, development, and evaluation process of a DHT designed to promote effective self-care in patients with HF.MethodsA design thinking approach within the HCD framework was undertaken, as described in the International Organization for Standardization 9241-210:2019 regulations, using a 5-step process: empathize, ideate, design, develop, and test. Patients with HF were involved throughout the design and evaluation of the system. The designed system was grounded in behavior change theory using the Theoretical Domains Framework and included behavior change techniques. Mixed methods were used to evaluate the DHT during the testing phase.ResultsSteps 1 to 3 of the process resulted in a set of evidence- and user-informed design requirements that were carried forward into the iterative development of a version 1 system. A cross-platform (iOS and Android) mobile app integrated with Fitbit activity trackers and smart scales was developed. A 2-week user testing phase highlighted the ease of use of the system, with patients demonstrating excellent adherence. Qualitative analysis of semistructured interviews identified the early potential for the system to positively influence self-care. Specifically, users perceived that the system increased their confidence and motivation to engage in key self-care behaviors, provided them with skills and knowledge that made them more aware of the importance of self-care behaviors, and might facilitate timely help seeking.ConclusionsThe use of an HCD methodology in this research has resulted in the development of a DHT that may engage patients with HF and potentially affect their self-care behaviors. This comprehensive work lays the groundwork for further development and evaluation of this solution before its implementation in health care systems. A detailed description of the HCD process used in this research will help guide the development and evaluation of future DHTs across a range of disease use cases.
| S-EPMC9131139 | biostudies-literature
Project description:BackgroundThe prevalence of abuse, diversion, and web-based endorsement of tapentadol (extended-release [ER], immediate-release [IR]) has been characterized as low compared with other prescription opioids. Little is known about individual experience with tapentadol nonmedical use (NMU).ObjectiveThis study aims to pilot web-based survey technologies to investigate the motivation for tapentadol NMU, sources of procurement, routes of administration, tampering methods, doses used, and impressions of tapentadol products (Nucynta and Nucynta ER).MethodsRecruitment flyers and banner advertisements were placed on the Bluelight website [DragonByte Technologies Ltd] with a link to a web-based survey (Qualtrics) designed to query about individuals' lifetime tapentadol NMU. This web-based survey was followed by an interactive web-based chat (Cryptocat) with respondents who were willing to be contacted. Respondents were queried about sources for obtaining tapentadol, motives for use, routes of administration, tampering methods, drugs used in combination, tablet strengths and dosages, and reasons for continued or discontinued use. Desirability and attractiveness for NMU was rated.ResultsWeb-based recruitment successfully attracted difficult-to-find study participants. A total of 78 participants reported that tapentadol was obtained from friends and family (ER 11/30, 37%; IR 18/67, 27%), the internet (ER 11/30, 37%; IR 12/67, 18%) or participants' own prescriptions from a doctor (ER 9/30, 30%; IR 17/67, 25%). It was used nonmedically for pain relief (ER 18/30, 60%; IR 33/67, 49%) and multiple psychotropic effects, including relaxation (ER 13/30, 43%; IR 29/67, 43%), reduction in depression or anxiety (ER 7/30, 23%; IR 30/67, 45%), or getting high (ER 12/30, 40%; IR 33/67, 49%). Tapentadol was primarily swallowed (ER 22/30, 73%; IR 55/67, 82%), although snorting (ER 2/30, 7%; IR 8/67, 12%) and injection (ER 2/30, 7%; IR 5/67, 8%) were also reported. The preferred dose for NMU was 100 mg (both ER and IR). The participants reported tapentadol use with benzodiazepines (ER 12/21, 57%; IR 28/47, 60%). Most participants had discontinued tapentadol NMU at the time of survey completion (ER 22/30, 73%; IR 55/67, 82%). Reasons for discontinued ER NMU included side effects (10/22, 46%) and lack of effective treatment (10/22, 46%). Reasons for discontinued IR NMU included lack of access (26/55, 47%) and better NMU options (IR 21/55, 38%). Few individuals were willing to divulge identifying information about themselves for the interactive chat (8/78, 10%), demonstrating the strength of anonymous, web-based surveys. Interactive chat supported the survey findings. A subgroup of participants (4/78, 5%) reported hallucinogenic side effects with high doses.ConclusionsWeb-based surveys can successfully recruit individuals who report drug NMU and those who are difficult to find. Tapentadol NMU appears to occur primarily for pain relief and for its psychotropic effects. Although it was liked by some, tapentadol did not receive a robust pattern of endorsement for NMU.
| S-EPMC9233245 | biostudies-literature
Project description:IntroductionThe National Institute for Health and Care Excellence (NICE) recommends Cognitive-Behavioural therapy (CBT) as the psychotherapeutic treatment of choice for adults with Attention Deficit Hyperactivity Disorder (ADHD) in the UK. However, the literature often refers to adapted CBT programs tailored for ADHD and provides limited insight into how adults with ADHD experience and perceive this form of treatment in routine clinical practice.MethodsThis mixed-methods study aims to explore ADHD individuals' experience and perception of CBT delivered in routine clinical practice, to gain a better understanding of this treatment's helpfulness and perceived effectiveness.ResultsA survey (n=46) and semi-structured in-depth interviews (n=10) were conducted to explore the experience of CBT and its perceived effectiveness in managing ADHD. The interviews were analysed using thematic analysis and the survey was synthesised using descriptive narratives. The thematic analysis highlighted three key themes: difficulties with the CBT framework, difficulties with CBT therapists, and consequences of CBT. The survey highlighted similar findings. Participants described the CBT framework as, generic, rigid, and too short, and described the CBT therapist as unspecialised, unempathetic, and not sufficiently adapting CBT to ADHD-related difficulties.DiscussionsOverall, participants found non-adapted, generic CBT in the UK to be unhelpful, overwhelming, and at times harmful to their mental well-being. Therefore, it is necessary for clinical bodies in the UK, while following the indicated NICE guidelines, to be mindful of adapting CBT delivery of CBT, to be most effective for people with ADHD and to mitigate potential harm.
| S-EPMC11221408 | biostudies-literature