Dataset Information

Evaluating the impact of community health worker certification in Massachusetts: Design, methods, and anticipated results of the Massachusetts community health worker workforce survey.

ABSTRACT:

Background

Professional certification of community health workers (CHWs) is a debated topic. Although intended to promote CHWs, certification may have unintended impacts given the grassroots nature of the workforce. As such, both intended effects and unintended adverse effects should be carefully evaluated. However, there is a lack of published literature describing such effective evaluations with a robust methodology. In this methods paper, we describe a key component of evaluating CHW certification in Massachusetts-the Massachusetts CHW Workforce Survey.

Methods

Design of the surveys was informed by a program theory framework that delineated both positive and negative potential impacts of Massachusetts CHW certification on CHWs and CHW employers. Using this framework, we developed measures of interest and preliminary CHW and CHW employer surveys. To validate and refine the surveys, we conducted cognitive interviews with CHWs and CHW employers. We then finalized survey tools with input from state and national stakeholders, CHWs, and CHW employers. Our sample consisted of three frames based on where CHWs are most likely to be employed in Massachusetts: acute care hospitals, community-based organizations, and ambulatory care health centers, primarily community health centers and federally qualified health centers. We then undertook extensive outreach efforts to determine whether each organization employed CHWs and to obtain CHW and CHW employer contact information. Our statistical analysis of the data utilized inverse probability score weighting accounting for organizational, site, and individual response.

Anticipated results

Wave one of the survey was administered in 2016 prior to launch of Massachusetts CHW certification and wave two in 2021. We report descriptive statistics of the three sample frames and response rates of each survey for each wave. Further, we describe select anticipated results related to certification, including outcomes of the program theory framework.

Conclusions

The Massachusetts CHW Workforce Survey is the culmination of 5 years of effort to evaluate the impact of CHW certification in Massachusetts. Our comprehensive description of our methodology addresses an important gap in CHW research literature. The rigorous design, administration, and analysis of our surveys ensure our findings are robust, valid, and replicable, which can be leveraged by others evaluating the CHW workforce.

SUBMITTER: Nielsen VM

PROVIDER: S-EPMC9877511 | biostudies-literature | 2022

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Evaluating the impact of community health worker certification in Massachusetts: Design, methods, and anticipated results of the Massachusetts community health worker workforce survey.

Nielsen Victoria M VM Ursprung W W Sanouri WWS Song Glory G Hirsch Gail G Mason Theresa T Santarelli Claire C Guimaraes Erica E Marshall Erica E Allen Caitlin G CG Lei Pei-Pei PP Brown Diane D Behl-Chadha Bittie B

Frontiers in public health 20230112

<h4>Background</h4>Professional certification of community health workers (CHWs) is a debated topic. Although intended to promote CHWs, certification may have unintended impacts given the grassroots nature of the workforce. As such, both intended effects and unintended adverse effects should be carefully evaluated. However, there is a lack of published literature describing such effective evaluations with a robust methodology. In this methods paper, we describe a key component of evaluating CHW ...[more]

PMID: 36711392

Similar Datasets

Project description:BackgroundCommunity Health Workers (CHWs) are considered to be a cost-effective and inclusive solution to address the persistent health workforce shortage in many low and middle-income countries. In recent years, microfinance institutions (MFIs) got increasingly engaged in providing health services delivered by CHWs. Despite their growing importance, little is known about the impacts and implementation barriers of these mostly small-scale initiatives. This paper evaluates an MFI-led CHW program in the Philippines and studies the role of microfinance group networks in influencing program outreach and impact. The intervention aims at disseminating information in poor communities, improving health monitoring through increased check-ups and raising social support.MethodsClustered randomized controlled trial in 70 communities in the greater area of Metro Manila, the Philippines. The main data was collected in a baseline and follow-up survey and is complemented with extensive sociometric network and geographical data. The main outcome variable is a composite health index based on 10 indicators. The role of the health worker's embeddedness and connectedness in the community for program success is tested using tools of social network analysis.ResultsThe intervention led to a 3.8% (95% confidence interval (CI) = 1.3, 6.4) improvement in the composite health outcome. Effects across indicators are mixed and mainly driven by changes in immediate health monitoring behavior: The probability for routine examinations increased in the treatment group by 10.6% (95% CI = 3.2, 18.1), for regular blood pressure checks by 9.6% (95% CI = 3.3, 15.9), and for having access to a health care provider by 7.2% (95% CI = 0.93, 13.5). No statistical effects on general knowledge and social support are observable. Social networks are a key driver of program outreach and impact. Close friends and acquaintances of health workers used and benefited substantially more from the program than more distant ties.ConclusionsDespite the promising immediate behavioral impacts, it remains questionable to what extent such small-scale MFI initiatives can bring transformative and sustainable changes without external support. Microfinance group networks played an important role for the success of the health intervention and further research is needed to better understand how these affect the health care utilization decisions of the clients.

Project description:ObjectivesTo produce and evaluate a novel virtual reality (VR) training for public health emergency responders.DesignFollowing a VR training designed to test key public health emergency responder competencies, a prospective cohort of participants completed surveys rating self-assessed skill levels and perceptions of training methods.SettingThe VR training sessions were administered in a quiet room at the US Centers for Disease Control and Prevention (CDC), Atlanta, Georgia.ParticipantsAll participants volunteered from a list of CDC emergency international surge responders.Outcome measuresPerceived impact of the training on responder skills was self-reported via a Likert 5-point scale questionnaire. Assessments were modelled according to the Expanded Technology Acceptance Model measuring participant perceived usefulness of and intention to use the new technology. Inductive coding of qualitative feedback resulted in the identification of central themes.ResultsFrom November 2019 to January 2020, 61 participants were enrolled. Most (98%) participants self-rated above neutral for all skills (mean 4.3; range 1.21-5.00). Regression modelling showed that the perceived ease of use of the VR and ability to produce demonstrable results as likely drivers of further use. Participants agreed that others would benefit from the training (97%), it was representative of actual response scenarios (72%) and they would use lessons learnt in the field (71%). Open-response feedback highlighted feeling being immersed in the training and its utility for public health responders.ConclusionsAt a time when a trained emergency public health workforce is a critical need, VR may be an option for addressing this gap. Participants' impressions and feedback, in the setting of their high skill level and experience, highlighted the utility and benefit of using VR to deliver training. Further research is needed to determine skill acquisition through VR training among a pool of future responders with limited to no response experience.

Project description:Supportive supervision is an important element of community health worker (CHW) programmes and is believed to improve CHW motivation and performance. A group supervision intervention, which included training and mentorship of supervisors, was implemented in Ethiopia, Kenya, Malawi and Mozambique. In three of the countries, this was combined with individual and/or peer supervision. A mixed-methods implementation study was conducted to assess the effect of the supervision intervention on CHWs' perceptions of supervision and CHW motivation-related outcomes. In total, 153 in-depth interviews were conducted with CHWs, their supervisors and managers. In addition, questionnaires assessing perceived supervision and motivation-related outcomes (organizational and community commitment, job satisfaction and conscientiousness) were administered to a total of 278 CHWs pre- and post-intervention, and again after 1 year. Interview transcripts were thematically analysed using a coding framework. Changes in perceived supervision and motivation-related outcomes were assessed using Friedman's ANOVA and post hoc Wilcoxon signed-rank tests. Interview participants reported that the supervision intervention improved CHW motivation. In contrast, the quantitative survey found no significant changes for measures of perceived supervision and inconsistent changes in motivation-related outcomes. With regard to the process of supervision, the problem-solving focus, the sense of joint responsibilities and team work, cross-learning and skill sharing, as well as the facilitating and coaching role of the supervisor, were valued. The empowerment and participation of supervisees in decision making also emerged in the analysis, albeit to a lesser extent. Although qualitative and quantitative findings differed, which could be related to the slightly different focus of methods used and a 'ceiling effect' limiting the detection of observable differences from the survey, the study suggests that there is potential for integrating supportive group supervision models in CHW programmes. A combination of group with individual or peer supervision, preferably accompanied with methods that assess CHW performance and corresponding feedback systems, could yield improved motivation and performance.

Project description:BackgroundRacial/ethnic minorities have experienced disproportionate opioid-related overdose death rates in recent years. In this context, we examined inequities in community-based naloxone access across racial/ethnic groups in Massachusetts.MethodsWe used data from: the Massachusetts Department of Public Health on community-based overdose education and naloxone distribution (OEND) programs; the Massachusetts Office of the Chief Medical Examiner on opioid-related overdose deaths, and; the United States Census American Community Survey for regional demographic/socioeconomic details to estimate community populations by race/ethnicity and racial segregation between African American/Black and white residents. Race/ethnicity groups included in the analysis were African American/Black (non-Hispanic), Hispanic, white (non-Hispanic), and "other" (non-Hispanic). We evaluated racial/ethnic differences in naloxone distribution across regions in Massachusetts and neighborhoods in Boston descriptively and spatially, plotting the race/ethnicity-specific number of kits per opioid-related overdose death per jurisdiction. Lastly, we constructed generalized estimating equations models with a negative binomial distribution to compare the race/ethnicity-specific naloxone distribution rate by OEND programs.ResultsFrom 2016-2019, the median annual rate of naloxone kits received from OEND programs in Massachusetts per racial/ethnicity group ranged between 160 and 447 per 100,000. In a multivariable analysis, we found that the naloxone distribution rates for racial/ethnic minorities were lower than the rate for white residents. We also found naloxone was more likely to be distributed in racially segregated communities than non-segregated communities.ConclusionWe identified racial/ethnic inequities in naloxone receipt by individuals in Massachusetts. Additional resources focused on designing and implementing OEND programs for racial/ethnic minorities are warranted to ensure equitable access to naloxone.

Dataset Information

Evaluating the impact of community health worker certification in Massachusetts: Design, methods, and anticipated results of the Massachusetts community health worker workforce survey.

Background

Methods

Anticipated results

Conclusions

Publications

Evaluating the impact of community health worker certification in Massachusetts: Design, methods, and anticipated results of the Massachusetts community health worker workforce survey.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets