Dataset Information

A comprehensive monitoring and evaluation framework for evidence to policy networks.

ABSTRACT:

Objective

To describe the development of a framework for monitoring and evaluating knowledge translation (KT) networks.

Method

The framework was developed using mixed methods over four phases, including i) a targeted literature review of KT networks, activities and indicators, ii) two scoping reviews to further enhance the set of indicators, iii) peer-reviews by international KT experts and an online expert consultation, and iv) piloting.

Results

A comprehensive theory of change (ToC) and indicators, both for the Network Secretariat and its participating member countries, were identified to develop the monitoring and evaluation framework. The framework includes (i) a ToC, including three key indicator domains across the results chain (outputs, short term outcomes, intermediate outcomes), and (ii) indicators for the three key domains, that can be selected depending on the stage of network maturity, along with suggested data collection methods. The three key indicator domains are 1) KT capacity and skill building; 2) network (structure, governance and leadership); and 3) KT/evidence-informed policy value and culture.

Conclusion

The monitoring and evaluation framework that links KT activities with policy and health outcomes fills an important gap in optimizing KT procedures, generating lessons learned and increasing accountability of major multipartner KT networks.

SUBMITTER: Kuchenmuller T

PROVIDER: S-EPMC7614046 | biostudies-literature | 2022 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A comprehensive monitoring and evaluation framework for evidence to policy networks.

Kuchenmüller Tanja T Chapman Evelina E Takahashi Ryoko R Lester Louise L Reinap Marge M Ellen Moriah M Haby Michelle M MM

Evaluation and program planning 20220218

<h4>Objective</h4>To describe the development of a framework for monitoring and evaluating knowledge translation (KT) networks.<h4>Method</h4>The framework was developed using mixed methods over four phases, including i) a targeted literature review of KT networks, activities and indicators, ii) two scoping reviews to further enhance the set of indicators, iii) peer-reviews by international KT experts and an online expert consultation, and iv) piloting.<h4>Results</h4>A comprehensive theory of c ...[more]

PMID: 35217289

Similar Datasets

Project description:BackgroundAll federal agencies are required to support appropriation requests with evidence and evaluation (US Public Law 115-435; the Evidence Act). The StrAtegic PoLicy EvIdence-Based Evaluation CeNTer (SALIENT) is 1 of 6 centers that help the Department of Veterans Affairs (VA) meet this requirement.ObjectiveWorking with the existing VA evaluation structure, SALIENT evaluations will contribute to (1) optimize policies and programs for veteran populations; (2) improve outcomes regarding health, equity, cost, and provider well-being; (3) advance the science of dissemination and knowledge translation; and (4) expand the implementation and dissemination science workforce.MethodsWe leverage the Lean Sprint methodology (iterative, incremental, rule-governed approach to clearly defined, and time-boxed work) and 3 cores to develop our evaluation plans collaboratively with operational partners and key stakeholders including veterans, policy experts, and clinicians. The Operations Core will work with evaluation teams to develop timelines, facilitate work, monitor progress, and guide quality improvement within SALIENT. The Methods Core will work with evaluation teams to identify the most appropriate qualitative, quantitative, and mixed methods approaches to address each evaluation, ensure that the analyses are conducted appropriately, and troubleshoot when problems with data acquisition and analysis arise. The Knowledge Translation (KT) Core will target key partners and decision makers using a needs-based market segmentation approach to ensure that needs are incorporated in the dissemination of knowledge. The KT Core will create communications briefs, playbooks, and other materials targeted at these market segments to facilitate implementation of evidence-based practices and maximize the impact of evaluation results.ResultsThe SALIENT team has developed a center infrastructure to support high-priority evaluations, often to be responsive to shifting operational needs and priorities. Our team has engaged in our core missions and operations to rapidly evaluate a high-priority areas, develop a comprehensive Lean Sprint systems redesign approach to training, and accelerate rapid knowledge translation.ConclusionsWith an array of interdisciplinary expertise, operational partnerships, and integrated resources, SALIENT has an established and evolving infrastructure to rapidly develop and implement high-impact evaluations. Projects are developed with sustained efficiency approaches that can pivot to new priorities as needed and effectively translate knowledge for key stakeholders and policy makers, while creating a learning health system infrastructure to foster the next generation of evaluation and implementation scientists.International registered report identifier (irrid)PRR1-10.2196/59830.

Project description:BACKGROUND:Policy analysis is considered essential for achieving successful reforms in health promotion and public health. The only framework for physical activity (PA) policy analysis was developed at a time when the field of PA policy research was in its early stages. PA policy research has since grown, and our understanding of what elements need to be included in a comprehensive analysis of PA policy is now more refined. This study developed a new conceptual framework for PA policy analysis - the Comprehensive Analysis of Policy on Physical Activity (CAPPA) framework. METHODS:The development of the CAPPA framework was based on: (i) an extensive review of literature; (ii) an open discussion between the authors; (iii) three rounds of a Delphi process; and (iv) two-rounds of consultations with PA policy stakeholders. RESULTS:The CAPPA framework specifies 38 elements of a comprehensive analysis of PA policies in the following six categories, which comprise the building blocks of the framework: (i) purpose of analysis (including auditing and assessment of policies); (ii) policy level (including: international; national; subnational; local; and institutional policies); (iii) policy sector (including: health; sport; recreation and leisure; education; transport; environment; urban/rural planning and design; tourism; work and employment; public finance; and research sectors); (iv) type of policy (including: formal written policies; unwritten formal statements; written standards and guidelines; formal procedures; and informal policies); (v) stage of policy cycle (including: agenda setting; formulation; endorsement/legitimisation; implementation; evaluation; maintenance; termination; and succession); and (vi) scope of analysis (including availability; context; processes; actors; political will; content; and effects). Based on the CAPPA framework, we also proposed broad and inclusive definitions of PA policy and PA policy analysis. CONCLUSION:The CAPPA framework may be used to guide future studies related to PA policy and to provide a context for the analysis of its specific components. The framework could be used in the same way for sedentary behaviour policy research. Future research should examine the extent to which PA policy analysis has covered each of the elements specified in the CAPPA framework and analyse the elements for which evidence is lacking. Future studies should also determine whether the existing tools allow for auditing and assessment of all the CAPPA elements and develop new tools if needed to allow for a more comprehensive PA policy analysis.

Project description:BackgroundTobacco control is an area where the translation of evidence into policy would seem to be straightforward, given the wealth of epidemiological, behavioural and other types of research available. Yet, even here challenges exist. These include information overload, concealment of key (industry-funded) evidence, contextualization, assessment of population impact, and the changing nature of the threat.MethodsIn the context of Israel's health targeting initiative, Healthy Israel 2020, we describe the steps taken to develop a comprehensive tobacco control strategy. We elaborate on the following: a) scientific issues influencing the choice of tobacco control strategies; b) organization of existing evidence of effectiveness of interventions into a manageable form, and c) consideration of relevant philosophical and political issues. We propose a framework for developing a plan and illustrate this process with a case study in Israel.ResultsBroad consensus exists regarding the effectiveness of most interventions, but current recommendations differ in the emphasis they place on different strategies. Scientific challenges include integration of complex and sometimes conflicting information from authoritative sources, and lack of estimates of population impact of interventions. Philosophical and political challenges include the use of evidence-based versus innovative policymaking, the importance of individual versus governmental responsibility, and whether and how interventions should be prioritized.The proposed framework includes: 1) compilation of a list of potential interventions 2) modification of that list based on local needs and political constraints; 3) streamlining the list by categorizing interventions into broad groupings of related interventions; together these groupings form the basis of a comprehensive plan; and 4) refinement of the plan by comparing it to existing comprehensive plans.ConclusionsDevelopment of a comprehensive tobacco control plan is a complex endeavour, involving crucial decisions regarding intervention components. "Off the shelf" plans, which need to be adapted to local settings, are available from a variety of sources, and a multitude of individual recommendations are available. The proposed framework for adapting existing approaches to the local social and political climate may assist others planning for smoke-free societies. Additionally, this experience has implications for development of evidence-based health plans addressing other risk factors.

Project description:BackgroundOver the past three decades, policy actors and actions have been highly influential in supporting the implementation of evidence-based practices (EBPs) in mental health settings. An early examination of these actions resulted in the Policy Ecology Framework (PEF), which was originally developed as a tactical primer for state and local mental health regulators in the field of child mental health. However, the policy landscape for implementation has evolved significantly since the original PEF was published. An interrogation of the strategies originally proposed in the PEF is necessary to provide an updated menu of strategies to improve our understanding of the mechanisms of policy action and promote system improvement.ObjectivesThis paper builds upon the original PEF to address changes in the policy landscape for the implementation of mental health EBPs between 2009 and 2022. We review the current state of policy strategies that support the implementation of EBPs in mental health care and outline key areas for policy-oriented implementation research. Our review identifies policy strategies at federal, state, agency, and organizational levels, and highlights developments in the social context in which EBPs are implemented. Furthermore, our review is organized around some key changes that occurred across each PEF domain that span organizational, agency, political, and social contexts along with subdomains within each area.DiscussionWe present an updated menu of policy strategies to support the implementation of EBPs in mental health settings. This updated menu of strategies considers the broad range of conceptual developments and changes in the policy landscape. These developments have occurred across the organizational, agency, political, and social contexts and are important for policymakers to consider in the context of supporting the implementation of EBPs. The updated PEF expands and enhances the specification of policy levers currently available, and identifies policy targets that are underdeveloped (e.g., de-implementation and sustainment) but are becoming visible opportunities for policy to support system improvement. The updated PEF clarifies current policy efforts within the field of implementation science in health to conceptualize and better operationalize the role of policy in the implementation of EBPs.

Project description:Over the years, IVF/ICSI protocols have continued to evolve with efforts to improve outcomes. As a result, treatment success may be related to certain procedural factors, including number of embryos transferred and stage at which they are transferred. This review aims to assess the safety and effectiveness of IVF/ICSI in comparison to spontaneous conception and less invasive ARTs and the impact of procedure-related factors on the outcomes of IVF/ICSI in order to support the development of local clinical and policy guidance. Following Cochrane Collaboration guidelines and the PRISMA statement, a comprehensive systematic review of literature examining the impact of procedural characteristics on the safety or effectiveness of IVF/ICSI from 2007 to date was performed. 33 systematic reviews and 3 primary studies evaluating the impact of procedural differences, IVF/ICSI in comparison to less invasive ARTs, and ARTs in comparison to spontaneous conception were found. IVF was shown to offer significant benefits over no treatment and IUI in achieving pregnancy and live birth among couples with endometriosis or unexplained infertility. Frozen and blastocyst-stage embryo transfers were as effective as fresh and cleavage-stage embryo transfers, respectively. In comparison to single embryo transfer, double embryo transfer significantly increased pregnancy, live birth and multiple pregnancy/birth rates. IVF/ICSI was associated with more complications during pregnancy and delivery, and in infants compared to naturally conceived pregnancies, particularly when multiple embryo transfer was used. Frozen embryo transfer had fewer adverse events during pregnancy and delivery than fresh embryo transfer, and was at least as safe in terms of infant outcomes. The potential complications of IVF/ICSI may be minimized through procedural choices, but such choices often impact effectiveness. Thus, in developing clinical and policy guidance around IVF/ICSI, the risk-benefit trade-offs patients and providers are willing to accept must be carefully considered.

Dataset Information

A comprehensive monitoring and evaluation framework for evidence to policy networks.

Objective

Method

Results

Conclusion

Publications

A comprehensive monitoring and evaluation framework for evidence to policy networks.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets