Organizational readiness and implementation fidelity of an early childhood education and care-specific physical activity policy intervention: findings from the Play Active trial.
Ontology highlight
ABSTRACT: Background
Many children do not accumulate sufficient physical activity for good health and development at early childhood education and care (ECEC). This study examined the association between ECEC organizational readiness and implementation fidelity of an ECEC-specific physical activity policy intervention.Methods
Play Active aimed to improve the ECEC educator's physical activity practices. We investigated the implementation of Play Active using a Type 1 hybrid study (January 2021-March 2022). Associations between organizational readiness factors and service-level implementation fidelity were examined using linear regressions. Fidelity data were collected from project records, educator surveys and website analytics.Results
ECEC services with higher levels of organizational commitment and capacity at pre-implementation reported higher fidelity scores compared to services with lower organizational commitment and capacity (all Ps < 0.05). Similarly, services who perceived intervention acceptability and appropriateness at pre-implementation to be high had higher fidelity scores (P < 0.05). Perceived feasibility and organizational efficacy of Play Active were associated with higher but nonsignificant fidelity scores.Conclusions
Results indicate that organizational readiness factors may influence the implementation of ECEC-specific physical activity policy interventions. Therefore, strategies to improve organizational readiness should be developed and tested. These findings warrant confirmation in the ECEC and other settings and with other health behavior interventions.
SUBMITTER: Wenden EJ
PROVIDER: S-EPMC10901271 | biostudies-literature | 2024 Feb
REPOSITORIES: biostudies-literature
Publications
Organizational readiness and implementation fidelity of an early childhood education and care-specific physical activity policy intervention: findings from the Play Active trial.
Wenden Elizabeth J EJ Budgeon Charley A CA Pearce Natasha L NL Christian Hayley E HE
Journal of public health (Oxford, England) 20240201 1
<h4>Background</h4>Many children do not accumulate sufficient physical activity for good health and development at early childhood education and care (ECEC). This study examined the association between ECEC organizational readiness and implementation fidelity of an ECEC-specific physical activity policy intervention.<h4>Methods</h4>Play Active aimed to improve the ECEC educator's physical activity practices. We investigated the implementation of Play Active using a Type 1 hybrid study (January 2 ...[more]
Similar Datasets
Project description:BackgroundPolicy interventions to increase physical activity in early childhood education and care (ECEC) services are effective in increasing physical activity among young children. However, a large proportion of ECEC services do not have nor implement a physical activity policy. Play Active is an evidence-informed physical activity policy intervention with implementation support strategies to enable ECEC services to successfully implement their policy. This study examined the effectiveness, implementation, and process outcomes of Play Active.MethodsA pragmatic cluster randomised trial in 81 ECEC services in Perth, Western Australia was conducted in 2021. Services implemented their physical activity policy over a minimum of three months. The effectiveness outcomes were changes in educator practices related to daily time provided for total physical activity and energetic play. Implementation outcomes included changes in director- and educator-reported uptake of policy practices and director-reported uptake of high impact and low effort policy practices. Process evaluation outcomes included awareness, fidelity, reach, and acceptability of the intervention and implementation strategies. Analysis involved descriptive statistics and generalised linear mixed effects models.ResultsThere was a significant increase in the uptake of director-reported policy practices (p = 0.034), but no change in the uptake of the subset of high impact and low effort policy practices. Intervention group educators reported high awareness of the Play Active policy recommendations (90%). Play Active acceptability was high among educators (83%) and directors (78%). Fidelity and reach were high for most implementation support strategies (> 75%). There were no significant changes in the amount of physical activity or energetic play educators provided to children or in the proportion of educators providing the policy recommended ≥ 180 min of physical activity/day or ≥ 30 min of energetic play/day for intervention compared to wait-listed comparison services.ConclusionsPlay Active resulted in significantly higher uptake of physical activity practices. However, there was no change in the amount of physical activity provided to children, which may be explained by the relatively short policy implementation period. Importantly, Play Active had high awareness, fidelity, reach, and acceptability. Future research should investigate the effectiveness of Play Active over longer implementation periods and its scalability potential.Trial registrationAustralian New Zealand Clinical Trials Registry (reference number 12620001206910, registered 13/11/2020, https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=378304&isReview=true ).
| S-EPMC10118225 | biostudies-literature
Project description:BackgroundDaily physical activity is critical during the early years of life for facilitating children's health and development. A large proportion of preschool children do not achieve the recommended 3 h of daily physical activity. Early childhood education and care (ECEC) services are a key setting to intervene to increase physical activity. There is a significant need for ECEC specific physical activity policy, including clearer guidelines on the amount of physical activity children should do during care, and strategies for implementation of these guidelines.MethodsThis study is a pragmatic cluster randomised trial to evaluate the effectiveness of the Play Active physical activity policy intervention to improve early childhood education and care educator's physical activity-related practices. The central component of Play Active is an evidence-informed physical activity policy template which includes 25 practices to support nine age-specific recommendations on the amount of physical activity and sedentary time, including screen time, young children should do while in care. There are six implementation support strategies to facilitate physical activity policy implementation: (i) personalise policy (services select at least five of the 25 practices to focus on initially); (ii) policy review and approval; (iii) a resource guide; (iv) a brief assessment tool for monitoring children's energetic play; (v) professional development; and (vi) Project Officer implementation support (phone calls). A total of 60 early childhood education and care services will be recruited from metropolitan Perth, Western Australia. After baseline assessment, services will be randomly allocated to either intervention or wait-listed comparison conditions. Primary (educator-reported frequency and amount of daily time provided for children's physical activity, sedentary and screen time) and secondary (educator physical activity-related practices, self-efficacy, motivation, attitudes and beliefs, social support, and supportive physical environment) outcomes will be assessed at baseline and post-intervention, after intervention services have had a minimum 3 months of policy implementation within their service.DiscussionThe Play Active trial will rigorously evaluate a novel physical activity policy intervention with implementation support that promotes positive physical activity behaviours in educators and children attending ECEC. If effective, the program could be adapted, scaled-up and delivered in ECEC services nationally.Trial registrationAustralian New Zealand Clinical Trials Registry ACTRN12620001206910 (date of registration 13/11/2020).
| S-EPMC8842565 | biostudies-literature
Project description:UnlabelledBackgroundThere is widespread interest in measuring organizational readiness to implement evidence-based practices in clinical care. However, there are a number of challenges to validating organizational measures, including inferential bias arising from the halo effect and method bias - two threats to validity that, while well-documented by organizational scholars, are often ignored in health services research. We describe a protocol to comprehensively assess the psychometric properties of a previously developed survey, the Organizational Readiness to Change Assessment.ObjectivesOur objective is to conduct a comprehensive assessment of the psychometric properties of the Organizational Readiness to Change Assessment incorporating methods specifically to address threats from halo effect and method bias.Methods and designWe will conduct three sets of analyses using longitudinal, secondary data from four partner projects, each testing interventions to improve the implementation of an evidence-based clinical practice. Partner projects field the Organizational Readiness to Change Assessment at baseline (n = 208 respondents; 53 facilities), and prospectively assesses the degree to which the evidence-based practice is implemented. We will conduct predictive and concurrent validities using hierarchical linear modeling and multivariate regression, respectively. For predictive validity, the outcome is the change from baseline to follow-up in the use of the evidence-based practice. We will use intra-class correlations derived from hierarchical linear models to assess inter-rater reliability. Two partner projects will also field measures of job satisfaction for convergent and discriminant validity analyses, and will field Organizational Readiness to Change Assessment measures at follow-up for concurrent validity (n = 158 respondents; 33 facilities). Convergent and discriminant validities will test associations between organizational readiness and different aspects of job satisfaction: satisfaction with leadership, which should be highly correlated with readiness, versus satisfaction with salary, which should be less correlated with readiness. Content validity will be assessed using an expert panel and modified Delphi technique.DiscussionWe propose a comprehensive protocol for validating a survey instrument for assessing organizational readiness to change that specifically addresses key threats of bias related to halo effect, method bias and questions of construct validity that often go unexplored in research using measures of organizational constructs.
| S-EPMC3157428 | biostudies-literature
Project description:BackgroundOrganizational readiness is a key factor for successful implementation of evidence-based interventions (EBIs), but a valid and reliable measure to assess readiness across contexts and settings is needed. The R = MC2 heuristic posits that organizational readiness stems from an organization's motivation, capacity to implement a specific innovation, and its general capacity. This paper describes a process used to examine the face and content validity of items in a readiness survey developed to assess organizational readiness (based on R = MC2) among federally qualified health centers (FQHC) implementing colorectal cancer screening (CRCS) EBIs.MethodsWe conducted 20 cognitive interviews with FQHC staff (clinical and non-clinical) in South Carolina and Texas. Participants were provided a subset of items from the readiness survey to review. A semi-structured interview guide was developed to elicit feedback from participants using "think aloud" and probing techniques. Participants were recruited using a purposive sampling approach and interviews were conducted virtually using Zoom and WebEx. Participants were asked 1) about the relevancy of items, 2) how they interpreted the meaning of items or specific terms, 3) to identify items that were difficult to understand, and 4) how items could be improved. Interviews were transcribed verbatim and coded in ATLAS.ti. Findings were used to revise the readiness survey.ResultsKey recommendations included reducing the survey length and removing redundant or difficult to understand items. Additionally, participants recommended using consistent terms throughout (e.g., other units/teams vs. departments) the survey and changing pronouns (e.g., people, we) to be more specific (e.g., leadership, staff). Moreover, participants recommended specifying ambiguous terms (e.g., define what "better" means).ConclusionUse of cognitive interviews allowed for an engaged process to refine an existing measure of readiness. The improved and finalized readiness survey can be used to support and improve implementation of CRCS EBIs in the clinic setting and thus reduce the cancer burden and cancer-related health disparities.
| S-EPMC9881511 | biostudies-literature
Project description:BackgroundKnowledge about the development of organizational readiness for implementation (ORI) is limited. ORI, referred to as the willingness and capacity of all relevant stakeholders to change practice, is critical for increasing the adoption rate of evidence-based practices and improving implementation outcomes. However, no methodology currently guides ORI's enhancement or addresses differences in readiness needs across an organization. This study used the transtheoretical model (TTM) as a framework for classifying a well-established compilation of implementation strategies into three readiness stages: pre-contemplation, contemplation, and preparation.MethodsA modified Delphi method was used to establish consensus among a panel of purposefully selected research and field implementation experts. The Delphi process involved three rounds of online questionnaires. The third round also included a live video discussion to clarify definitions in an effort to increase consensus among experts.ResultsOf the 73 strategies reviewed, the experts identified 75% (n = 55) as relevant for pre-implementation and reached a high-level agreement on the assignment of 7% (n = 5) of the strategies to the pre-contemplation stage (ORI-1), 25% (n = 18) to the contemplation stage (ORI-2), and 52% (n = 38) to the preparation stage (ORI-3). Several strategies were identified as relevant to more than one stage.ConclusionsParticipating experts were able to reach high-level agreement on the relevance of specific sets of implementation strategies to each of the three ORI stages. The lowest number of strategies was assigned to ORI-1 and the highest number to ORI-3. Given the overlap of strategies across ORI stages, there is a need to better understand the specific utilization of such strategies at different stages. Future studies are needed to empirically evaluate the relevance and applicability of this expert-informed typology based on implementers' experiences in the field.
| S-EPMC8194182 | biostudies-literature
Project description:BackgroundImplementation researchers recognize the influential role of organizational factors and, thus, seek to assess these factors using quantitative measurement instruments. However, researchers are hindered by instruments that measure similar constructs but rely on different nomenclature and/or definitions. The Consolidated Framework for Implementation Research (CFIR) provides a taxonomy of constructs derived from prior frameworks and empirical studies of implementation-related constructs. The CFIR includes constructs based on the original Promoting Action on Research Implementation in Health Services (PARiHS) framework which highlights the key roles of strength of evidence for a specific evidence-based intervention (EBI), favorability of organizational context for change, and capacities to facilitate implementation of the EBI. Although the CFIR is among the most frequently used implementation frameworks, it does not include quantitative measures. The Organizational Resource and Context Assessment (ORCA) is a quantitative measurement instrument that was developed based on PARiHS, assessing its three domains. Factors within these three domains are conceptually similar to constructs in the CFIR but do not match directly. The aim of this work was to map ORCA survey items to CFIR constructs to enable direct comparisons and syntheses of findings across studies using the CFIR and/or ORCA.MethodsTwo distinct, independent research teams, each used rigorous constant comparative techniques with deliberation and consensus to map individual items from the ORCA to the five domains and 39 constructs of CFIR.ResultsORCA items were mapped primarily to three of five CFIR domains: Inner Setting, Process, and Intervention Characteristics. The two research teams agreed on 88% of mappings at the higher domain level; at the lower construct level, their mappings aligned for 62.2% of the ORCA items.ConclusionsMapping results reveal that the ORCA focuses measurement prominently on Inner Setting, Process, and Intervention Characteristics. This mapping guide can help improve consistency in measurement and reporting, enabling more efficient comparison and synthesis of findings that use either the ORCA instrument or the CFIR framework. The guide helps advance implementation science utilizing mixed methods by providing CFIR users with quantitative measures for selected constructs and enables ORCA users to map their findings to CFIR constructs.
| S-EPMC7881456 | biostudies-literature
Project description:BackgroundOrganizational readiness is a known barrier to implementing evidence-based practices (EBPs) in community mental health services. A robust methodology for enhancing organizational readiness for implementation (ORI) has the potential to improve implementation outcomes of EBPs and ensure better services for people with a psychiatric disability. Prior work established a framework of implementation strategies targeting ORI enhancement by asking a group of implementation experts from various fields to categorize strategies from the "Expert Recommendations for Implementing Change" (ERIC) Project into three readiness stages, consistent with the pre-action stages of the Transtheoretical Model of behavioral change: Pre-contemplation, Contemplation, and Preparation. The current study provides initial confirmation and refinement to this expert-driven typology based on community mental health field experiences.MethodsWe conducted in-depth interviews with stakeholders involved in a recent EBP implementation project. Participants included staff (n=9) from four community mental health agencies and the implementation team who facilitated the project (n=3). Their pre-implementation experiences were compared with the experts' typology to identify consistencies and discrepancies.ResultsThe participants' experiences were congruent with two thirds of the strategies identified by the experts for specific ORI stages. The refinements included 12 strategies used in additional stages beyond the experts' classification, four strategies from the ERIC list that were not included in the ORI typology, and five new strategies.ConclusionsThis study provides initial confirmation and refinements to the previously published ORI typology. The results offer guidance as to how ORI could be enhanced in the community mental health field.
| S-EPMC8889398 | biostudies-literature
Project description:BackgroundAdaptations for scale-up are ubiquitous but are rarely described in detail. Adaptations may be a key reason for the "scale-up penalty" which is when there is a reduction in intervention effect size following scale-up. The Play Active intervention consists of a physical activity policy for early childhood education and care (ECEC) services, with accompanying implementation support strategies. It was first implemented with 81 ECEC services in Perth, Western Australia, in 2021 - with significant positive changes in physical activity practice uptake. The aim of this paper is to describe the extent, type, fidelity consistency, goals, size, scope, and proposed impact of proposed adaptations to the implementation support strategies for scaling-up Play Active.MethodsProposed adaptations were defined as planned changes, made prior to making the intervention available. The authors created a list of adaptations from a comparison of the Play Active implementation support strategies, before and after adaptation for proposed statewide availability across Western Australia, Queensland and South Australia, Australia. We used the Framework for Reporting Adaptations and Modifications-Enhanced Implementation Strategies (FRAME-IS) to code adaptations to implementation support strategies. Three authors coded each adaptation and rated their size, scope and proposed impact.ResultsFifty-three adaptations to Play Active were identified. Most (68%) were proposed for the 'content' of implementation strategies, including aspects of their delivery. In practice, this involved changing the delivery mode of implementation support strategies from phone call and email support, to website-based delivery. More than half (56%) of adaptations involved 'adding elements' for scale-up. Most adaptations were 'fidelity consistent' (95%). The main goals for adaptations were related to 'increasing the acceptability, appropriateness, or feasibility' (45%), 'decreasing the costs' (19%) and 'increasing adoption of the evidence-based practice' (19%). Adaptations were small to medium in size, with most proposed to have a positive (87%) or neutral (8%) effect on the effectiveness of the intervention, rather than negative (4%).ConclusionsA large number of small, fidelity-consistent, adaptations were proposed for Play Active scale-up. Overall, the process of reporting adaptations was found to be feasible. To understand the impact of these adaptations, it will be important to re-evaluate implementation, effectiveness and process outcomes, at-scale.
| S-EPMC10233970 | biostudies-literature
Project description:BackgroundInstilling healthy dietary habits and active play in early childhood is an important public health focus. Interventions supporting the establishment of nutrition and active play behaviours in the first years of life have shown positive outcomes and long-term cost-effectiveness, however, most are research trials, with limited evidence regarding real-world application. Implementation science theories, models and frameworks (TMFs) can guide the process of research translation from trial to real-world intervention. The application of TMFs within nutrition and active play intervention studies in early childhood (< 5 years) is currently unknown. This systematic review identified the use of TMFs and barriers/ enablers associated with intervention adoption, implementation, and sustainability in early childhood nutrition and active play interventions implemented under real-world conditions.MethodsSix databases were searched for peer-reviewed publications between 2000-2021. Studies were included if primary outcomes reported improvement in diet, physical activity or sedentary behaviours amongst children aged < 5 years and interventions were delivered under real-world conditions within a community and/or healthcare setting. Two reviewers extracted and evaluated studies, cross checked by a third and verified by all authors. Quality assessment of included studies was completed by two authors using the Mixed Methods Appraisal Tool (MMAT).ResultsEleven studies comprising eleven unique interventions were included. Studies represented low, middle and high-income countries, and were conducted across a range of settings. Five TMFs were identified representing four of Nilsen's implementation model categories, predominantly 'evaluation models'. Ninety-nine barriers/facilitators were extracted across the three intervention phases-Implementation (n = 33 barriers; 33 facilitators), Sustainability (n = 19 barriers; n = 9 facilitators), Adoption (n = 2 barriers; n = 3 facilitators). Identified barriers/facilitators were mapped to the five domains of the Durlak and DuPre framework, with 'funding', 'compatibility' and 'integration of new programming' common across the three intervention phases.ConclusionsFindings demonstrate that there is no systematic application of TMFs in the planning, implementation and/or evaluation of early childhood nutrition and active play interventions in real-world settings, and selective and sporadic application of TMFs occurs across the intervention lifespan. This apparent limited uptake of TMFs is a missed opportunity to enhance real-world implementation success.Trial registrationPROSPERO (CRD42021243841).
| S-EPMC10029282 | biostudies-literature
Project description:Implementation evaluations have increasingly taken into account how features of local context help determine implementation outcomes. The purpose of this study was to determine which contextual features of organizational capacity led directly to the RE-AIM Framework implementation outcomes of intervention reach and number of days taken to implement, in an implementation trial of a series of cancer education workshops conducted across 13 African American churches in Maryland. We used a configurational approach with Coincidence Analysis to identify specific features of organizational capacity that uniquely distinguished churches with implementation success from those that were less successful. Aspects of organizational capacity (e.g., congregation size, staffing/volunteers, health ministry experience) were drawn from an existing measure of church organizational capacity for health promotion. Solution pathways leading to higher intervention reach included: having a health ministry in place for 1-4 years; or having fewer than 100 members; or mid-size churches that had conducted health promotion activities in 1-4 different topics in the past 2 years. Solution pathways to implementing the intervention in fewer number of days included: having conducted 1-2 health promotion activities in the past 2 years; or having 1-5 part-time staff and a pastor without additional outside employment; or churches with a doctorally prepared pastor and a weekly attendance of 101-249 members. Study findings can inform future theory, research, and practice in implementation of evidence-based health promotion interventions delivered in faith-based and other limited-resource community settings. Findings support the important role of organizational capacity in implementation outcomes in these settings.
| S-EPMC8983006 | biostudies-literature