Dataset Information

Identifying behaviour change techniques in 287 randomized controlled trials of audit and feedback interventions targeting practice change among healthcare professionals.

ABSTRACT:

Background

Audit and feedback (A&F) is among the most widely used implementation strategies, providing healthcare professionals with summaries of their practice performance to prompt behaviour change and optimize care. Wide variability in effectiveness of A&F has spurred efforts to explore why some A&F interventions are more effective than others. Unpacking the variability of the content of A&F interventions in terms of their component behaviours change techniques (BCTs) may help advance our understanding of how A&F works best. This study aimed to systematically specify BCTs in A&F interventions targeting healthcare professional practice change.

Methods

We conducted a directed content analysis of intervention descriptions in 287 randomized trials included in an ongoing Cochrane systematic review update of A&F interventions (searched up to June 2020). Three trained researchers identified and categorized BCTs in all trial arms (treatment & control/comparator) using the 93-item BCT Taxonomy version 1. The original BCT definitions and examples in the taxonomy were adapted to include A&F-specific decision rules and examples. Two additional BCTs ('Education (unspecified)' and 'Feedback (unspecified)') were added, such that 95 BCTs were considered for coding.

Results

In total, 47/95 BCTs (49%) were identified across 360 treatment arms at least once (median = 5.0, IQR = 2.3, range = 129 per arm). The most common BCTs were 'Feedback on behaviour' (present 89% of the time; e.g. feedback on drug prescribing), 'Instruction on how to perform the behaviour' (71%; e.g. issuing a clinical guideline), 'Social comparison' (52%; e.g. feedback on performance of peers), 'Credible source' (41%; e.g. endorsements from respected professional body), and 'Education (unspecified)' (31%; e.g. giving a lecture to staff). A total of 130/287 (45%) control/comparator arms contained at least one BCT (median = 2.0, IQR = 3.0, range = 0-15 per arm), of which the most common were identical to those identified in treatment arms.

Conclusions

A&F interventions to improve healthcare professional practice include a moderate range of BCTs, focusing predominantly on providing behavioural feedback, sharing guidelines, peer comparison data, education, and leveraging credible sources. We encourage the use of our A&F-specific list of BCTs to improve knowledge of what is being delivered in A&F interventions. Our study provides a basis for exploring which BCTs are associated with intervention effectiveness.

Trial registrations

N/A.

SUBMITTER: Crawshaw J

PROVIDER: S-EPMC10664600 | biostudies-literature | 2023 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Identifying behaviour change techniques in 287 randomized controlled trials of audit and feedback interventions targeting practice change among healthcare professionals.

Crawshaw Jacob J Meyer Carly C Antonopoulou Vivi V Antony Jesmin J Grimshaw Jeremy M JM Ivers Noah N Konnyu Kristin K Lacroix Meagan M Presseau Justin J Simeoni Michelle M Yogasingam Sharlini S Lorencatto Fabiana F

Implementation science : IS 20231121 1

<h4>Background</h4>Audit and feedback (A&F) is among the most widely used implementation strategies, providing healthcare professionals with summaries of their practice performance to prompt behaviour change and optimize care. Wide variability in effectiveness of A&F has spurred efforts to explore why some A&F interventions are more effective than others. Unpacking the variability of the content of A&F interventions in terms of their component behaviours change techniques (BCTs) may help advance ...[more]

PMID: 37990269

Similar Datasets

Project description:BackgroundThis article addresses the role of audit and feedback (A&F) to support change behaviour and quality improvement work in healthcare organisations. It contributes to the sparse literature on primary care centre (PCC) managers´ views on A&F practices, taking into account the broad scope of primary care. The purpose was to explore if and how different types of A&F support change behaviour by influencing different forms of motivation and learning, and what contextual facilitators and barriers enable or obstruct change behaviour in primary care.MethodsA qualitative research approach was used. We explored views about the impact of A&F across managers of 27 PCCs, in five Swedish regions, through semi-structured interviews. A purposeful sampling was used to identify both regions and PCC managers, in order to explore multiple perspectives. We used the COM-B framework, which describes how Capability, Opportunity and Motivation interact and generate change behaviour and how different factors might act as facilitators or barriers, when collecting and analysing data.ResultsExisting forms of A&F were perceived as coercive top-down interventions to secure adherence to contractual obligations, financial targets and clinical guidelines. Support to bottom-up approaches and more complex change at team and organisational levels was perceived as limited. We identified five contextual factors that matter for the impact of A&F on change behaviour and quality improvement work: performance of organisations, continuity in staff, size of organisations, flexibility in leadership and management, and flexibility offered by the external environment.ConclusionsExternal A&F, perceived as coercive by recipients of feedback, can have an impact on change behaviour through 'know-what' and 'know-why' types of knowledge and 'have-to' commitment but provide limited support to complex change. 'Want-to' commitment and bottom-up driven processes are important for more complex change. Similar to previous research, identified facilitators and barriers of change consisted of factors that are difficult to influence by A&F activities. Future research is needed on how to ensure co-development of A&F models that are perceived as legitimate by health care professionals and useful to support more complex change.

Project description:BackgroundAudit and feedback is a common intervention for supporting clinical behaviour change. Increasingly, health data are available in electronic format. Yet, little is known regarding if and how electronic audit and feedback (e-A&F) improves quality of care in practice.ObjectiveThe study aimed to assess the effectiveness of e-A&F interventions in a primary care and hospital context and to identify theoretical mechanisms of behaviour change underlying these interventions.MethodsIn August 2016, we searched five electronic databases, including MEDLINE and EMBASE via Ovid, and the Cochrane Central Register of Controlled Trials for published randomised controlled trials. We included studies that evaluated e-A&F interventions, defined as a summary of clinical performance delivered through an interactive computer interface to healthcare providers. Data on feedback characteristics, underlying theoretical domains, effect size and risk of bias were extracted by two independent review authors, who determined the domains within the Theoretical Domains Framework (TDF). We performed a meta-analysis of e-A&F effectiveness, and a narrative analysis of the nature and patterns of TDF domains and potential links with the intervention effect.ResultsWe included seven studies comprising of 81,700 patients being cared for by 329 healthcare professionals/primary care facilities. Given the extremely high heterogeneity of the e-A&F interventions and five studies having a medium or high risk of bias, the average effect was deemed unreliable. Only two studies explicitly used theory to guide intervention design. The most frequent theoretical domains targeted by the e-A&F interventions included 'knowledge', 'social influences', 'goals' and 'behaviour regulation', with each intervention targeting a combination of at least three. None of the interventions addressed the domains 'social/professional role and identity' or 'emotion'. Analyses identified the number of different domains coded in control arm to have the biggest role in heterogeneity in e-A&F effect size.ConclusionsGiven the high heterogeneity of identified studies, the effects of e-A&F were found to be highly variable. Additionally, e-A&F interventions tend to implicitly target only a fraction of known theoretical domains, even after omitting domains presumed not to be linked to e-A&F. Also, little evaluation of comparative effectiveness across trial arms was conducted. Future research should seek to further unpack the theoretical domains essential for effective e-A&F in order to better support strategic individual and team goals.

Project description:There is a plethora of interventions and policies aimed at changing practice habits of primary healthcare professionals, but it is unclear which are the most appropriate, sustainable, and effective. We aimed to evaluate the evidence on behavior change interventions and policies directed at healthcare professionals working in primary healthcare centers.Study design: overview of reviews.MEDLINE (Ovid), Embase (Ovid), The Cochrane Library (Wiley), CINAHL (EbscoHost), and grey literature (January 2005 to July 2015).two reviewers independently, and in duplicate, identified systematic reviews, overviews of reviews, scoping reviews, rapid reviews, and relevant health technology reports published in full-text in the English language.two reviewers extracted data pertaining to the types of reviews, study designs, number of studies, demographics of the professionals enrolled, interventions, outcomes, and authors' conclusions for the included studies. We evaluated the methodological quality of the included studies using the AMSTAR scale. For the comparative evaluation, we classified interventions according to the behavior change wheel (Michie et al.).Of 2771 citations retrieved, we included 138 reviews representing 3502 individual studies. The majority of systematic reviews (91%) investigated behavior and practice changes among family physicians. Interactive and multifaceted continuous medical education programs, training with audit and feedback, and clinical decision support systems were found to be beneficial in improving knowledge, optimizing screening rate and prescriptions, enhancing patient outcomes, and reducing adverse events. Collaborative team-based policies involving primarily family physicians, nurses, and pharmacists were found to be most effective. Available evidence on environmental restructuring and modeling was found to be effective in improving collaboration and adherence to treatment guidelines. Limited evidence on nurse-led care approaches were found to be as effective as general practitioners in patient satisfaction in settings like asthma, cardiovascular, and diabetes clinics, although this needs further evaluation. Evidence does not support the use of financial incentives to family physicians, especially for long-term behavior change.Behavior change interventions including education, training, and enablement in the context of collaborative team-based approaches are effective to change practice of primary healthcare professionals. Environmental restructuring approaches including nurse-led care and modeling need further evaluation. Financial incentives to family physicians do not influence long-term practice change.

Project description:IntroductionPharmacists, as experts in medicines, are increasingly employed in general practices and undertake a range of responsibilities. Audit and feedback (A&F) interventions are effective in achieving behaviour change, including prescribing. The extent of pharmacist involvement in A&F interventions to influence prescribing is unknown. This review aimed to assess the effectiveness of A&F interventions involving pharmacists on prescribing in general practice compared with no A&F/usual care and to describe features of A&F interventions and pharmacist characteristics.MethodsElectronic databases (MEDLINE, EMBASE, CINAHL, Cochrane Central Register of Controlled Trials, (Social) Science Citation Indexes, ISI Web of Science) were searched (2012, 2019, 2020). Cochrane systematic review methods were applied to trial identification, selection, and risk of bias. Results were summarized descriptively and heterogeneity was assessed. A random-effects meta-analysis was conducted where studies were sufficiently homogenous in design and outcome.ResultsEleven cluster-randomized studies from 9 countries were included. Risk of bias across most domains was low. Interventions focussed on older patients, specific clinical area(s), or specific medications. Meta-analysis of 6 studies showed improved prescribing outcomes (pooled risk ratio: 0.78, 95% confidence interval: 0.64-0.94). Interventions including both verbal and written feedback or computerized decision support for prescribers were more effective. Pharmacists who received study-specific training, provided ongoing support to prescribers or reviewed prescribing for individual patients, contributed to more effective interventions.ConclusionsA&F interventions involving pharmacists can lead to small improvements in evidence-based prescribing in general practice settings. Future implementation of A&F within general practice should compare different ways of involving pharmacists to determine how to optimize effectiveness.PRISMA-compliant abstract included in Supplementary Material 1.

Project description:BackgroundAudit and feedback (A&F) is a common strategy for helping health providers to implement evidence into practice. Despite being extensively studied, health care A&F interventions remain variably effective, with overall effect sizes that have not improved since 2003. Contributing to this stagnation is the fact that most health care A&F interventions have largely been designed without being informed by theoretical understanding from the behavioral and social sciences. To determine if the trend can be improved, the objective of this study was to develop a list of testable, theory-informed hypotheses about how to design more effective A&F interventions.MethodsUsing purposive sampling, semi-structured 60-90-min telephone interviews were conducted with experts in theories related to A&F from a range of fields (e.g., cognitive, health and organizational psychology, medical decision-making, economics). Guided by detailed descriptions of A&F interventions from the health care literature, interviewees described how they would approach the problem of designing improved A&F interventions. Specific, theory-informed hypotheses about the conditions for effective design and delivery of A&F interventions were elicited from the interviews. The resulting hypotheses were assigned by three coders working independently into themes, and categories of themes, in an iterative process.ResultsWe conducted 28 interviews and identified 313 theory-informed hypotheses, which were placed into 30 themes. The 30 themes included hypotheses related to the following five categories: A&F recipient (seven themes), content of the A&F (ten themes), process of delivery of the A&F (six themes), behavior that was the focus of the A&F (three themes), and other (four themes).ConclusionsWe have identified a set of testable, theory-informed hypotheses from a broad range of behavioral and social science that suggest conditions for more effective A&F interventions. This work demonstrates the breadth of perspectives about A&F from non-healthcare-specific disciplines in a way that yields testable hypotheses for healthcare A&F interventions. These results will serve as the foundation for further work seeking to set research priorities among the A&F research community.

Project description:BackgroundThe evidence on what strategies can improve recruitment to clinical trials in maternity care is lacking. As trial recruiters, maternity healthcare professionals (MHCPs) perform behaviours (e.g. talking about trials with potential participants, distributing trial information) they may not ordinarily do outside of the trial. Most trial recruitment interventions do not provide any theoretical basis for the potential effect (on behaviour) or describe if stakeholders were involved during development. The study aim was to use behavioural theory in a co-design process to develop an intervention for MHCPs tasked with approaching all eligible potential participants and inviting them to join a maternity trial and to assess the acceptability and feasibility of such an intervention.MethodsThis study applied a step-wise sequential mixed-methods approach. Key stages were informed by the Theoretical Domains Framework and Behaviour Change Techniques (BCT) Taxonomy to map the accounts of MHCPs, with regard to challenges to trial recruitment, to theoretically informed behaviour change strategies. Our recruitment intervention was co-designed during workshops with MHCPs and maternity service users. Acceptability and feasibility of our intervention was assessed using an online questionnaire based on the Theoretical Framework of Acceptability (TFA) and involved a range of trial stakeholders.ResultsTwo co-design workshops, with a total of nine participants (n = 7 MHCP, n = 2 maternity service users), discussed thirteen BCTs as potential solutions. Ten BCTs, broadly covering Consequences and Reframing, progressed to intervention development. Forty-five trial stakeholders (clinical midwives, research midwives/nurses, doctors, allied health professionals and trial team members) participated in the online TFA questionnaire. The intervention was perceived effective, coherent, and not burdensome to engage with. Core areas for future refinement included Anticipated opportunity and Self-efficacy.ConclusionWe developed a behaviour change recruitment intervention which is based on the accounts of MHCP trial recruiters and developed in a co-design process. Overall, the intervention was deemed acceptable. Future evaluation of the intervention will establish its effectiveness in enabling MHCPs to invite all eligible people to participate in a maternity care trial, and determine whether this translates into an increase in maternity trial recruitment rates.

Dataset Information

Identifying behaviour change techniques in 287 randomized controlled trials of audit and feedback interventions targeting practice change among healthcare professionals.

Background

Methods

Results

Conclusions

Trial registrations

Publications

Identifying behaviour change techniques in 287 randomized controlled trials of audit and feedback interventions targeting practice change among healthcare professionals.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets