Quantitative measures used in empirical evaluations of mental health policy implementation: A systematic review.
Ontology highlight
ABSTRACT:
SUBMITTER: Pilar M
PROVIDER: S-EPMC9924289 | biostudies-literature | 2022 Jan-Dec
REPOSITORIES: biostudies-literature
Publications
Quantitative measures used in empirical evaluations of mental health policy implementation: A systematic review.
Pilar Meagan M Jost Eliot E Walsh-Bailey Callie C Powell Byron J BJ Mazzucca Stephanie S Eyler Amy A Purtle Jonathan J Allen Peg P Brownson Ross C RC
Implementation research and practice 20220101
<h4>Background</h4>Mental health is a critical component of wellness. Public policies present an opportunity for large-scale mental health impact, but policy implementation is complex and can vary significantly across contexts, making it crucial to evaluate implementation. The objective of this study was to (1) identify quantitative measurement tools used to evaluate the implementation of public mental health policies; (2) describe implementation determinants and outcomes assessed in the measure ...[more]
Similar Datasets
Project description:BackgroundPublic policy has tremendous impacts on population health. While policy development has been extensively studied, policy implementation research is newer and relies largely on qualitative methods. Quantitative measures are needed to disentangle differential impacts of policy implementation determinants (i.e., barriers and facilitators) and outcomes to ensure intended benefits are realized. Implementation outcomes include acceptability, adoption, appropriateness, compliance/fidelity, feasibility, penetration, sustainability, and costs. This systematic review identified quantitative measures that are used to assess health policy implementation determinants and outcomes and evaluated the quality of these measures.MethodsThree frameworks guided the review: Implementation Outcomes Framework (Proctor et al.), Consolidated Framework for Implementation Research (Damschroder et al.), and Policy Implementation Determinants Framework (Bullock et al.). Six databases were searched: Medline, CINAHL Plus, PsycInfo, PAIS, ERIC, and Worldwide Political. Searches were limited to English language, peer-reviewed journal articles published January 1995 to April 2019. Search terms addressed four levels: health, public policy, implementation, and measurement. Empirical studies of public policies addressing physical or behavioral health with quantitative self-report or archival measures of policy implementation with at least two items assessing implementation outcomes or determinants were included. Consensus scoring of the Psychometric and Pragmatic Evidence Rating Scale assessed the quality of measures.ResultsDatabase searches yielded 8417 non-duplicate studies, with 870 (10.3%) undergoing full-text screening, yielding 66 studies. From the included studies, 70 unique measures were identified to quantitatively assess implementation outcomes and/or determinants. Acceptability, feasibility, appropriateness, and compliance were the most commonly measured implementation outcomes. Common determinants in the identified measures were organizational culture, implementation climate, and readiness for implementation, each aspects of the internal setting. Pragmatic quality ranged from adequate to good, with most measures freely available, brief, and at high school reading level. Few psychometric properties were reported.ConclusionsWell-tested quantitative measures of implementation internal settings were under-utilized in policy studies. Further development and testing of external context measures are warranted. This review is intended to stimulate measure development and high-quality assessment of health policy implementation outcomes and determinants to help practitioners and researchers spread evidence-informed policies to improve population health.RegistrationNot registered.
| S-EPMC7304175 | biostudies-literature
Project description:BackgroundPatient-reported outcome measures (PROMs) are standardized and validated self-administered questionnaires that assess whether healthcare interventions and practices improve patients' health and quality of life. PROMs are commonly implemented in children and youth mental health services, as they increasingly emphasize patient-centered care. The objective of this study was to identify and describe the PROMs that are currently in use with children and youth living with mental health conditions (MHCs).MethodsThree databases (MEDLINE, EMBASE, and PsycINFO) were systematically searched that used PROMs with children and youth < 18 years of age living with at least one diagnosed MHC. All methods were noted according to Preferred Reporting Items for Systematic reviews and Meta-Analysis. Four independent reviewers extracted data, which included study characteristics (country, year), setting, the type of MHC under investigation, how the PROMs were used, type of respondent, number of items, domain descriptors, and the psychometric properties.ResultsOf the 5004 articles returned by the electronic search, 34 full-texts were included in this review. This review identified both generic and disease-specific PROMs, and of the 28 measures identified, 13 were generic, two were generic preference-based, and 13 were disease-specific.ConclusionThis review shows there is a diverse array of PROMs used in children and youth living with MHCs. Integrating PROMs into the routine clinical care of youth living with MHCs could improve the mental health of youth. Further research on how relevant these PROMs are children and youth with mental health conditions will help establish more uniformity in the use of PROMs for this population.
| S-EPMC9928989 | biostudies-literature
Project description:The formulation and implementation of a rural sports policy is an important means of promoting rural sports, improving the physical wellbeing of farmers, and enhancing the cohesion of rural communities. However, introducing such a policy faces problems in the process of specific policy practices, such as poor effective implementation, a lagging implementation effect, and goal cognitive bias. How to look at the current rural sports policy implementation blockage problem and the governance of the blockage, in order to improve the level of rural sports public service, is the focus of this paper's research. On this basis, this paper selects 56 policy texts, issued from 2002 to 2023, that are highly relevant to rural sports and have high timeliness and authority from the sports policies issued in China. Also, ROST CM6 software is used to count high-frequency words; this study then draws keyword social network mapping for the visual analysis of policy preferences and selects 20 rural sports policy texts as typical samples. Finally, a policy modeling research consistency (PMC) index model is used to evaluate the texts comprehensively and quantitatively. The results show that the overall design of China's rural sports policies is relatively reasonable. However, the consistency and effectiveness of their implementation need to be improved. Twenty representative policy texts have an average PMC index score of 5.96, with a concave index of 3.04 (which is good overall), with the highest mean value for rural sports policies at the national level. This is followed by the second highest value at the municipal and county levels, and the smallest at the provincial level. Therefore, in the future formulation and implementation of rural sports policies, a multi-dimensional rural sports policy system should be constructed. This would help to strengthen the consistency and effectiveness of the implementation of the policy system and promote the high-quality development of rural sports.
| S-EPMC11406341 | biostudies-literature
Project description:ObjectiveStrategies are needed to improve policy makers' evidence-informed decision making and the availability of evidence-based, state-supported services. This study examined whether academic-policy partnerships could promote these outcomes.MethodsData from two national surveys of state mental health agency representatives were used to compare barriers to implementation of evidence-based practices (EBPs) and policy makers' use of child mental health research in states with strong academic-policy partnerships in workforce training or in program implementation/evaluation (IE) with barriers in states with no or limited partnerships in these areas.ResultsStrong IE partnerships were associated with more confidence in research use and fewer issues with provider readiness and capacity but with more issues with EBP fidelity. Strong training partnerships were associated with fewer endorsements of lack of time as a barrier to research use.ConclusionsAcademic-policy partnerships had some benefit for states' research use and EBP implementation. Because these partnerships may reduce barriers, further research should explore characteristics of effective collaborations.
| S-EPMC8410622 | biostudies-literature
Project description:IntroductionWhile biosimilar medicines can contribute to the sustainability of healthcare systems, their utilization rate varies across European countries. This study aims to identify and systematize policy measures and instruments used in European countries to increase biosimilar market share.MethodsA systematic review was conducted according to PRISMA 2020 recommendations. Medline-PubMed, Web of Science and ScienceDirect databases were searched using inclusion criteria that required full articles published in English between January 2006 and November 2023. Reviews, letters, reports, editorials and comments or opinion articles were excluded from this study.ResultsOf the 1,137 articles, only 13 met the eligibility criteria for analysis, which covered a total of 28 European countries. Pricing regulation measures were found in 27 of these countries with tendering, price-linkage and internal reference price being the most used. Tendering was used by 27 countries to procure biosimilars in inpatient setting. Prescribing guidelines and recommendations were the widely used instrument. Some European countries adopted physician incentives, quotas, and prescription by international non-proprietary name.ConclusionAutomatic substitution was not commonly recommended or applied. Interchangeability and switching will become increasingly relevant issues. It is important that the positive results from some countries serve as an example for the future of these medicines in the European market.Systematic review registrationhttps://inplasy.com/, Identifier INPLASY2023120032.
| S-EPMC10932952 | biostudies-literature
Project description:BackgroundInsufficient funding is frequently identified as a critical barrier to the implementation and sustainment of evidence-based practices (EBPs). Thus, increasing access to funding is recognized as an implementation strategy. Policies that create earmarked taxes-defined as taxes for which revenue can only be spent on specific activities-are an increasingly common mental health financing strategy that could improve the reach of EBPs. This project's specific aims are to (1) identify all jurisdictions in the USA that have implemented earmarked taxes for mental health and catalogue information about tax design; (2) characterize experiences implementing earmarked taxes among local (e.g., county, city) mental health agency leaders and other government and community organization officials and assess their perceptions of the acceptability and feasibility of different types of policy implementation strategies; and (3) develop a framework to guide effect earmarked tax designs, inform the selection of implementation strategies, and disseminate the framework to policy audiences.MethodsThe project uses the Exploration, Preparation, Implementation, Sustainment (EPIS) framework to inform data collection about the determinants and processes of tax implementation and Leeman's typology of implementation strategies to examine the acceptability and feasibility strategies which could support earmarked tax policy implementation. A legal mapping will be conducted to achieve aim 1. To achieve aim 2, a survey will be conducted of 300 local mental health agency leaders and other government and community organization officials involved with the implementation of earmarked taxes for mental health. The survey will be followed by approximately 50 interviews with these officials. To achieve aim 3, quantitative and qualitative data will be integrated through a systematic framework development and dissemination process.DiscussionThis exploratory policy implementation process study will build the evidence base for outer-context implementation determinants and strategies by focusing on policies that earmarked taxes for mental health services.
| S-EPMC10067193 | biostudies-literature
Project description:BackgroundThis review assesses the utility of applying an automated content analysis method to the field of mental health policy development. We considered the possibility of using the Wordscores algorithm to assess research and policy texts in ways that facilitate the uptake of research into mental health policy.MethodsThe PRISMA framework and the McMaster appraisal tools were used to systematically review and report on the strengths and limitations of the Wordscores algorithm. Nine electronic databases were searched for peer-reviewed journal articles published between 2003 and 2016. Inclusion criteria were (1) articles had to be published in public health, political science, social science or health services disciplines; (2) articles had to be research articles or opinion pieces that used Wordscores; and (3) articles had to discuss both strengths and limitations of using Wordscores for content analysis.ResultsThe literature search returned 118 results. Twelve articles met the inclusion criteria. These articles explored a range of policy questions and appraised different aspects of the Wordscores method.DiscussionFollowing synthesis of the material, we identified the following as potential strengths of Wordscores: (1) the Wordscores algorithm can be used at all stages of policy development; (2) it is valid and reliable; (3) it can be used to determine the alignment of health policy drafts with research evidence; (4) it enables existing policies to be revised in the light of research; and (5) it can determine whether changes in policy over time were supported by the evidence. Potential limitations identified were (1) decreased accuracy with short documents, (2) words constitute the unit of analysis and (3) expertise is needed to choose 'reference texts'.ConclusionsAutomated content analysis may be useful in assessing and improving the use of evidence in mental health policies. Wordscores is an automated content analysis option for comparing policy and research texts that could be used by both researchers and policymakers.
| S-EPMC6238396 | biostudies-literature
Project description:BackgroundUnderstanding the mechanisms of implementation strategies (i.e., the processes by which strategies produce desired effects) is important for research to understand why a strategy did or did not achieve its intended effect, and it is important for practice to ensure strategies are designed and selected to directly target determinants or barriers. This study is a systematic review to characterize how mechanisms are conceptualized and measured, how they are studied and evaluated, and how much evidence exists for specific mechanisms.MethodsWe systematically searched PubMed and CINAHL Plus for implementation studies published between January 1990 and August 2018 that included the terms "mechanism," "mediator," or "moderator." Two authors independently reviewed title and abstracts and then full texts for fit with our inclusion criteria of empirical studies of implementation in health care contexts. Authors extracted data regarding general study information, methods, results, and study design and mechanisms-specific information. Authors used the Mixed Methods Appraisal Tool to assess study quality.ResultsSearch strategies produced 2277 articles, of which 183 were included for full text review. From these we included for data extraction 39 articles plus an additional seven articles were hand-entered from only other review of implementation mechanisms (total = 46 included articles). Most included studies employed quantitative methods (73.9%), while 10.9% were qualitative and 15.2% were mixed methods. Nine unique versions of models testing mechanisms emerged. Fifty-three percent of the studies met half or fewer of the quality indicators. The majority of studies (84.8%) only met three or fewer of the seven criteria stipulated for establishing mechanisms.ConclusionsResearchers have undertaken a multitude of approaches to pursue mechanistic implementation research, but our review revealed substantive conceptual, methodological, and measurement issues that must be addressed in order to advance this critical research agenda. To move the field forward, there is need for greater precision to achieve conceptual clarity, attempts to generate testable hypotheses about how and why variables are related, and use of concrete behavioral indicators of proximal outcomes in the case of quantitative research and more directed inquiry in the case of qualitative research.
| S-EPMC7164241 | biostudies-literature
Project description:Colombia's mental health services have a complex history shaped by 60 years of armed conflict, a predominantly clinical approach to mental health, and social factors such as inequities and stigma. The 1990 Caracas declaration proposed a shift towards decentralised community mental health services and interventions based on the recovery approach and emphasis on social determinants of mental health in the Americas. Colombia has adopted these approaches in its legal and practical framework in recent years, but implementation has been uneven. This systematic review aims to contribute to mental health services understanding in Colombia by examining the barriers and facilitators to the implementation of mental health services in Colombia. A search was conducted to explore available peer-reviewed studies on Colombian mental health services across five databases (Medline, PubMed, Scopus, Scielo and BVS) on quantitative and qualitative research papers published in the last ten years and without language restrictions. The Consolidated Framework for Implementation Research (CFIR) was used to structure the analysis and identify barriers and facilitators during the implementation of mental health services. We adapted the CFIR to attend to gender, race and age informed by the Socio-Political Economy of Global Mental Health framework, given the importance of these factors to the Colombian health landscape. Finally, narrative synthesis was used to summarise the data. 1 530 records were identified, and 12 articles met all inclusion criteria and were included in the analysis. 8 papers described substance use disorders services, 11 involved multidisciplinary healthcare professionals, and 7 were implemented at a local scale. The primary barriers to implementation were the lack of coordination, high workloads, and low funding. Facilitators included the use of protocols, and the involvement of communities, stakeholders, users, and external champions. Findings suggest the continued importance of community and recovery approaches and efforts to improve coordination between multi-sector actors involved in the mental health spaces (e.g., public, and private organisations, users and their families).
| S-EPMC10699609 | biostudies-literature
Project description:BackgroundOver the past three decades, policy actors and actions have been highly influential in supporting the implementation of evidence-based practices (EBPs) in mental health settings. An early examination of these actions resulted in the Policy Ecology Framework (PEF), which was originally developed as a tactical primer for state and local mental health regulators in the field of child mental health. However, the policy landscape for implementation has evolved significantly since the original PEF was published. An interrogation of the strategies originally proposed in the PEF is necessary to provide an updated menu of strategies to improve our understanding of the mechanisms of policy action and promote system improvement.ObjectivesThis paper builds upon the original PEF to address changes in the policy landscape for the implementation of mental health EBPs between 2009 and 2022. We review the current state of policy strategies that support the implementation of EBPs in mental health care and outline key areas for policy-oriented implementation research. Our review identifies policy strategies at federal, state, agency, and organizational levels, and highlights developments in the social context in which EBPs are implemented. Furthermore, our review is organized around some key changes that occurred across each PEF domain that span organizational, agency, political, and social contexts along with subdomains within each area.DiscussionWe present an updated menu of policy strategies to support the implementation of EBPs in mental health settings. This updated menu of strategies considers the broad range of conceptual developments and changes in the policy landscape. These developments have occurred across the organizational, agency, political, and social contexts and are important for policymakers to consider in the context of supporting the implementation of EBPs. The updated PEF expands and enhances the specification of policy levers currently available, and identifies policy targets that are underdeveloped (e.g., de-implementation and sustainment) but are becoming visible opportunities for policy to support system improvement. The updated PEF clarifies current policy efforts within the field of implementation science in health to conceptualize and better operationalize the role of policy in the implementation of EBPs.
| S-EPMC10629012 | biostudies-literature