Dataset Information

Prioritizing measures to assess performance of drug treatment services: a Delphi process with funders, treatment providers and service-users.

ABSTRACT:

Background and aim

While many studies have examined outcome measurement as part of clinical trials and routine outcome collection at the person-level in alcohol and other drug (AOD) treatment services, there has been limited attention to measures required to assess performance at the service-level. In Australia, non-government services are primarily funded by government using public funds; however, there is no standardized approach to performance measurement. This study sought to establish a finite list of performance measures that represented consensus between funders, treatment providers and service-users.

Method

A three-round Delphi process was undertaken with (i) funders of treatment (n = 10), (ii) treatment providers (n = 10) and (iii) treatment service-users (n = 10). Participants were asked to rate a range of measures on a 10-point Likert scale on how important they were to be included in contracts with funders. Measures with a median score > 7 and agreement among participants above 70% were the criteria for inclusion in the final set of measures. Qualitative data in the form of text responses provided by participants for their ratings in rounds 1 and 2 were also analysed.

Results

Participants rated 93 measures in round 1, which reduced to 78 measures in round 2 and 32 measures in round 3. Fifteen service-level measures and two system-level measures met criteria for inclusion in the final set of performance measures. The final set of measures cover a range of measurement types: outcomes (n = 5), access (n = 3), structural (n = 3), experience (n = 2), input (n = 2), process (n = 1) and output (n = 1).

Conclusion

In Australia, performance measures for alcohol and other drug treatment services that represent a consensus among service-users, providers and funders focus upon demonstrating accountability for public funds, improving services and communicating key measures of success to future service-users and the broader community.

SUBMITTER: Stirling R

PROVIDER: S-EPMC10087953 | biostudies-literature | 2023 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Prioritizing measures to assess performance of drug treatment services: a Delphi process with funders, treatment providers and service-users.

Stirling Robert R Nathan Sally S Ritter Alison A

Addiction (Abingdon, England) 20220911 1

<h4>Background and aim</h4>While many studies have examined outcome measurement as part of clinical trials and routine outcome collection at the person-level in alcohol and other drug (AOD) treatment services, there has been limited attention to measures required to assess performance at the service-level. In Australia, non-government services are primarily funded by government using public funds; however, there is no standardized approach to performance measurement. This study sought to establi ...[more]

PMID: 36043344

Similar Datasets

Project description:BackgroundReliable contraception enables women and men to plan their family sizes and avoid unintended pregnancies, which can cause distress and anxiety, but also increase maternal mortality. This study explored potential barriers to contraceptive use for women in the Gaza Strip, Palestine from user and provider perspectives.MethodsA convenient sample was used to recruit women, who were current contraception users, from three healthcare clinics that provide family planning care, two governmental and one non-governmental. A 16-item questionnaire was completed by 204 women, including socio-demographic data, contraceptive use and eight questions exploring user experience. Additionally, 51 women attended focus groups for a deeper insight into their contraceptive use experience and potential barriers. Furthermore, 14 healthcare providers were interviewed about their experience with service provision. Quantitative data are presented as means and frequencies and qualitative data were analysed item by item and are presented in themes jointly with the quantitative data.ResultsWomen reported usage of only three main modern methods of contraception with 35.2% using intrauterine devices, 25.8% combined oral contraception and 16.4% condoms, while only 3.1% used the hormonal implant. Expectations from family planning services were low with most women attending the clinic having already decided their contraceptive method with decisions being made by husbands (41.2%) or women jointly with their partner (33.3%), only 13.7% took advice from service providers. Healthcare providers experienced high prevalence of beliefs that modern contraceptives cause infertility and cancer. Main barriers to effective family planning services were misconceptions of potential harm, poor availability and limited choice of contraceptive methods.ConclusionWomen's contraceptive choices in Gaza are limited by prevalent misconceptions and fears as well as recurring shortages, negatively impacting fertility control. Men are a major factor in choosing a contraceptive method, however, they have limited access to information and therefore, potentially more misconceptions. Therefore, male community members need to be included in the delivery of information on contraceptives to increase women's choice. Furthermore, greater access to long-acting reversible contraceptives, such as the hormonal implant, and improved availability might be key factors in improving contraceptive uptake in Gaza and, thus, reducing unintended pregnancies.

Project description:BackgroundIn Tanzania, residential treatment centers for alcohol and other drugs, locally known as "sober houses," play a critical role in the treatment of people living with a substance use disorder (SUD), but little is known about the services they offer and service users' and providers' perceptions of those services. We aimed to address these gaps in knowledge and to better understand where evidence-based interventions may be able to address gaps in service provision.Materials and methodsThis study used a mixed-methods approach across four sober houses in Dar es Salaam, Tanzania. We conducted 48 semi-structured interviews with a sub-sample of sober house service users (n = 38) and service providers (n = 10). Eighty-six (86) service users also completed a written survey to capture demographic information and assess knowledge of HIV and willingness to use HIV preventive care. All interviews were audio-recorded, translated into English, and then coded according to constructs developed with the Recovery Capital Framework. Following coding, a thematic analysis was conducted for the qualitative data using the framework developed by Braun and Clarke.ResultsService users were generally positive about the treatment they were receiving but identified gaps in health service provision related to HIV, as well as a lack of preparation to address the employment-related challenges they face in the community after completing treatment. Service providers largely agreed with users' perceptions of needs and identified a lack of clinical personnel in sober houses and funding challenges as barriers to meeting these needs.ConclusionSober houses provide treatment services to Tanzanians with SUD that service users largely view as positive. This evaluation identified employment challenges after treatment completion and gaps related to HIV care in the sober house. Further research is needed to investigate how interventions can be adapted to the sober house setting to meet these needs.

Project description:BackgroundHigh levels of aggression towards staff in healthcare settings have been reported. It seems likely that workers in Opioid Substitution Therapy (OST) would be at increased risk of adverse events and their consequences.ObjectivesThis study aimed to establish if practitioners who provide OST are experiencing negative outcomes, specifically aggression, distress, and burnout, and to identify if workload and professional affiliation were associated with these risks.MethodsA survey was conducted of OST practitioners in a single geographical region of New Zealand (population approx. 344,000). The survey asked for demographics (including caseloads), Perception of Patient Aggression Scale New Zealand Revision (POPAS-NZ), Kessler 10 (K10), Short Post-Traumatic Stress Disorder Rating Interview (SPRINT), and Abbreviated Maslach Burnout Inventory (aMBI) and two qualitative questions asking about the best and worst aspects of working in OST.ResultsAll recorded OST workers in the region (n = 181) were invited to participate, 95 practitioners responded to the survey (52.4%). This group included pharmacists, doctors, nurses, social workers and addiction workers. Results indicated aggression, distress, and burnout were being experienced by practitioners. Number of patients seen by a practitioner significantly increased risk of aggression (F(1,90) = 14.14, p < 0.001). Psychiatrists were the most at risk profession (p = 0.016). Burnout responses were high for around 20% of practitioners, with low numbers meeting criteria for distress and PTSD. Positive things about working in OST were relationships with patients, appreciating patient outcomes and positive team environments. Negative aspects were patient behaviours, maintaining empathy, and, administration tasks.ConclusionsAggression was a workplace hazard for OST clinicians. Low rates of distress and PTSD symptoms were reported and some evidence of practitioner burnout. Practitioners reported positive relationships, making a difference and teamwork may have been improving this area of mental health work.

Project description:BackgroundA significantly higher proportion of UK Black ethnic adults live with overweight or obesity, compared to their White British counterparts. The role of obesity in excess infection rates and mortality from COVID-19 has increased the need to understand if weight management interventions are appropriate and effective for Black ethnic groups. There is a paucity of existing research on weight management services in Black populations, and whether anticipated or experienced institutional and interpersonal racism in the healthcare and more widely affects engagement in these services. Understanding the lived experience of target populations and views of service providers delivering programmes is essential for timely service improvement.MethodsA qualitative study using semi-structured interviews was conducted in June-October 2021 among 18 Black African and Black Caribbean men and women interested in losing weight and 10 weight management service providers.ResultsThe results highlighted a positive view of life in the United Kingdom (UK), whether born in the UK or born abroad, but one which was marred by racism. Weight gain was attributed by participants to unhealthy behaviours and the environment, with improving appearance and preventing ill health key motivators for weight loss. Participants relied on self-help to address their overweight, with the role of primary care in weight management contested as a source of support. Anticipated or previously experienced racism in the health care system and more widely, accounted for some of the lack of engagement with services. Participants and service providers agreed on the lack of relevance of existing services to Black populations, including limited culturally tailored resources. Community based, ethnically matched, and flexibly delivered weight management services were suggested as ideal, and could form the basis of a set of recommendations for research and practice.ConclusionCultural tailoring of existing services and new programmes, and cultural competency training are needed. These actions are required within systemic changes, such as interventions to address discrimination. Our qualitative insights form the basis for advancing further work and research to improve existing services to address the weight-related inequality faced by UK Black ethnic groups.

Project description:ObjectivesPatient medicines helpline services (PMHS) are available from some National Health Service (NHS) Trusts in the UK to provide medicines information to hospital patients and carers. To date, studies of PMHS have examined the views of service users via satisfaction surveys. This study used qualitative methods to explore service users' experiences of using a PMHS, including perceived benefits and areas for improvement.DesignQualitative, using semi-structured interviews.SettingThis study was conducted across seven NHS Trusts in England.ParticipantsForty users of PMHS were individually interviewed over the telephone. Interviews were audio-recorded, transcribed verbatim and analysed using Braun and Clarke's inductive reflexive thematic analysis. Ethical approval was obtained before study commencement.ResultsParticipants predominantly called a PMHS for themselves (82%; carers: 18%). Two main themes were generated. Theme 1: timeliness-PMHS provide support during the uncertain transition of care period from hospital to home, when patients and carers often feel vulnerable because support is less available. PMHS met service users' needs for timely and easily accessible support, and quick resolution of their issues. PMHS could be improved with staffing beyond typical work week hours, and by having staff available to answer calls instead of using an answerphone. Theme 2: PMHS are best-placed to help-PMHS were perceived as best-placed to answer enquiries that arose from hospital care. Service users felt reassured from speaking to pharmacy professionals, and PMHS were perceived as the optimal service in terms of knowledge and expertise regarding medicines-related questions. However, several participants were initially unaware that their PMHS existed.ConclusionsPMHS are perceived to be a valuable means of accessing timely medicines-related support when patients and carers may be feeling particularly vulnerable. However, their availability and promotion could be improved. We recommend that providers of PMHS consider whether this is achievable, in order to better meet the needs of service users.

Project description:BackgroundThe growth of urban dwelling populations globally has led to rapid increases of research and policy initiatives addressing associations between the built environment and physical activity (PA). Given this rapid proliferation, it is important to identify priority areas and research questions for moving the field forward. The objective of this study was to identify and compare research priorities on the built environment and PA among researchers and knowledge users (e.g., policy makers, practitioners).MethodsBetween September 2022 and April 2023, a three-round, modified Delphi survey was conducted among two independent panels of international researchers (n = 38) and knowledge users (n = 23) to identify similarities and differences in perceived research priorities on the built environment and PA and generate twin 'top 10' lists of the most important research needs.ResultsFrom a broad range of self-identified issues, both panels ranked in common the most pressing research priorities including stronger study designs such as natural experiments, research that examines inequalities and inequities, establishing the cost effectiveness of interventions, safety and injuries related to engagement in active transportation (AT), and considerations for climate change and climate adaptation. Additional priorities identified by researchers included: implementation science, research that incorporates Indigenous perspectives, land-use policies, built environments that support active aging, and participatory research. Additional priorities identified by knowledge users included: built environments and PA among people living with disabilities and a need for national data on trip chaining, multi-modal travel, and non-work or school-related AT.ConclusionsFive common research priorities between the two groups emerged, including (1) to better understand causality, (2) interactions with the natural environment, (3) economic evaluations, (4) social disparities, and (5) preventable AT-related injuries. The findings may help set directions for future research, interdisciplinary and intersectoral collaborations, and funding opportunities.

Project description:BackgroundThe COVID-19 pandemic has disproportionately affected all essential healthcare services delivery in low-resource settings. This study aimed to explore the challenges and experiences of providers and users of childhood immunisation services in Nepal during the COVID-19 pandemic.MethodsSemi-structured qualitative interviews were conducted with childhood immunisation service providers and users (i.e., parents of children) from Kathmandu valley, Nepal. All interviews were conducted through phone or internet-based tools, such as Zoom, WhatsApp, and messenger. All interviews were audio-recorded, transcribed verbatim, and analysed using theme-based content analysis in an Excel spreadsheet.ResultsA total of 15 participants (n = 7 service providers and n = 8 service users) participated. Six themes were identified, namely: (1) impact of COVID-19 and lockdown on childhood immunisation services; (2) motivation and resilience for childhood immunisation; (3) Biosafety practices and Personal Protective Equipment (PPE) availability during the COVID-19 pandemic; (4) service adjustments and guidelines during pandemic; (5) availability of vaccines; and (6) immunisation program resilience in view of COVID-19. Service providers mentioned facing disruptions in services and some parents had decided to delay scheduled immunisation. However, most service providers showed determinations to deliver the services with high morale, while most service users reported taking their children for immunisation. Families migrating from urban to rural areas during the pandemic led to service providers having no means to confirm complete immunisation of migrating children. Service providers also experienced lack of adequate guidance to deal with the pandemic and personal protective equipment to protect themselves and service users.ConclusionDespite experiencing disruptions in childhood immunisation service due to the COVID-19 pandemic, service users and providers were determined to vaccinate the children. There is an urgent need for effective preparedness plans to be in place to address the observed barriers and to ensure resilient immunisation services during ongoing and future pandemics.

Dataset Information

Prioritizing measures to assess performance of drug treatment services: a Delphi process with funders, treatment providers and service-users.

Background and aim

Method

Results

Conclusion

Publications

Prioritizing measures to assess performance of drug treatment services: a Delphi process with funders, treatment providers and service-users.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets