Dataset Information

Outcomes and Costs of the Transition From a Paper-Based Immunization System to a Digital Immunization System in Vietnam: Mixed Methods Study.

ABSTRACT:

Background

The electronic National Immunization Information System (NIIS) was introduced nationwide in Vietnam in 2017. Health workers were expected to use the NIIS alongside the legacy paper-based system. Starting in 2018, Hanoi and Son La provinces transitioned to paperless reporting. Interventions to support this transition included data guidelines and training, internet-based data review meetings, and additional supportive supervision visits.

Objective

This study aims to assess (1) changes in NIIS data quality and use, (2) changes in immunization program outcomes, and (3) the economic costs of using the NIIS versus the traditional paper system.

Methods

This mixed methods study took place in Hanoi and Son La provinces. It aimed to analyses pre- and postintervention data from various sources including the NIIS; household and health facility surveys; and interviews to measure NIIS data quality, data use, and immunization program outcomes. Financial data were collected at the national, provincial, district, and health facility levels through record review and interviews. An activity-based costing approach was conducted from a health system perspective.

Results

NIIS data timeliness significantly improved from pre- to postintervention in both provinces. For example, the mean number of days from birth date to NIIS registration before and after intervention dropped from 18.6 (SD 65.5) to 5.7 (SD 31.4) days in Hanoi (P<.001) and from 36.1 (SD 94.2) to 11.7 (40.1) days in Son La (P<.001). Data from Son La showed that the completeness and accuracy improved, while Hanoi exhibited mixed results, possibly influenced by the COVID-19 pandemic. Data use improved; at postintervention, 100% (667/667) of facilities in both provinces used NIIS data for activities beyond monthly reporting compared with 34.8% (202/580) in Hanoi and 29.4% (55/187) in Son La at preintervention. Across nearly all antigens, the percentage of children who received the vaccine on time was higher in the postintervention cohort compared with the preintervention cohort. Up-front costs associated with developing and deploying the NIIS were estimated at US $0.48 per child in the study provinces. The commune health center level showed cost savings from changing from the paper system to the NIIS, mainly driven by human resource time savings. At the administrative level, incremental costs resulted from changing from the paper system to the NIIS, as some costs increased, such as labor costs for supportive supervision and additional capital costs for equipment associated with the NIIS.

Conclusions

The Hanoi and Son La provinces successfully transitioned to paperless reporting while maintaining or improving NIIS data quality and data use. However, improvements in data quality were not associated with improvements in the immunization program outcomes in both provinces. The COVID-19 pandemic likely had a negative influence on immunization program outcomes, particularly in Hanoi. These improvements entail up-front financial costs.

SUBMITTER: Dang TTH

PROVIDER: S-EPMC10985597 | biostudies-literature | 2024 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Outcomes and Costs of the Transition From a Paper-Based Immunization System to a Digital Immunization System in Vietnam: Mixed Methods Study.

Dang Thi Thanh Huyen TTH Carnahan Emily E Nguyen Linh L Mvundura Mercy M Dao Sang S Duong Thi Hong TH Nguyen Trung T Nguyen Doan D Nguyen Tu T Werner Laurie L Ryman Tove K TK Nguyen Nga N

Journal of medical Internet research 20240318

<h4>Background</h4>The electronic National Immunization Information System (NIIS) was introduced nationwide in Vietnam in 2017. Health workers were expected to use the NIIS alongside the legacy paper-based system. Starting in 2018, Hanoi and Son La provinces transitioned to paperless reporting. Interventions to support this transition included data guidelines and training, internet-based data review meetings, and additional supportive supervision visits.<h4>Objective</h4>This study aims to asses ...[more]

PMID: 38498020

Similar Datasets

Project description:The Vietnam National Expanded Program on Immunization (NEPI) has been successfully implementing a nationwide immunization system since 1985. From the start, the program has increased the immunization coverage rate; however, data on immunization coverage in Vietnam are gathered and aggregated from commune health centers in routine, paper-based reports, which have shortcomings. Also, calculations of coverage are inconsistent at subnational levels, which lead to uncertainty about the size of the target population used as the denominator in coverage calculations. The growth of mobile networks in Vietnam provides an opportunity to apply mHealth to improve the immunization program. In 2012, PATH and the Vietnam NEPI developed and piloted a digital immunization registry, ImmReg, to overcome the challenges of the paper system. A final evaluation was conducted in 2015 to assess the impact of ImmReg, including its use of SMS reminders, on improving the immunization program.The study population comprised all children born in Ben Tre province in September and October of 2013, 2014, and 2015, representing pre-intervention, post-intervention, and one year post-intervention, respectively. Data exported from ImmReg were used to compare the immunization rate, dropout rate, and timeliness of vaccination before and after the intervention. Additionally, a rapid survey was conducted to understand the willingness of parents with children due for vaccination to pay for SMS reminder messages on the immunization schedule.Timely administration of oral polio vaccine, Quinvaxem, and measles 1 vaccine significantly increased over time from baseline to post-intervention to one year post-intervention. In particular, the timeliness of vaccination with the third dose of Quinvaxem increased from 53.6% to 65.8% to 77.2%. For measles 1 vaccine, the rate increased from 70.4% to 76.2% to 92.3%. In addition, the dropout rate from Quinvaxem 1 to Quinvaxem 3 declined from 4.2% in 2013 to 0% in 2015, and the dropout rate from Bacillus Calmette-Guérin (BCG) to measles 1 fell from 12.8% in 2013 to 0% in 2015. Full immunization coverage of children under one year old increased significantly from 75.4% in 2013 to 81.7% in 2014 to 99.2% in 2015. Also, survey results indicated that 93.3% of interviewees were willing to pay for SMS reminders for immunization.A digital immunization registry that includes SMS reminders can improve immunization coverage and timeliness of vaccination, thereby strengthening the quality and effectiveness of immunization programs. Integrating this system into the national health information system and leveraging it for other health programs, such as maternal and child health and nutrition as well as infectious disease control, can bring more benefits to the health care system in Vietnam.

Project description:BackgroundSince the introduction of digital health technologies in National Health Service (NHS), health professionals are starting to use email, text, and other digital methods to consult with their patients in a timely manner. There is lack of evidence regarding the economic impact of digital consulting in the United Kingdom (UK) NHS.ObjectiveThis study aimed to estimate the direct costs associated with digital consulting as an adjunct to routine care at 18 clinics serving young people aged 16-24 years with long-term conditions.MethodsThis study uses both quantitative and qualitative approaches. Semistructured interviews were conducted with 173 clinical team members on the impacts of digital consulting. A structured questionnaire was developed and used for 115 health professionals across 12 health conditions at 18 sites in the United Kingdom to collect data on time and other resources used for digital consulting. A follow-up semistructured interview was conducted with a single senior clinician at each site to clarify the mechanisms through which digital consulting use might lead to outcomes relevant to economic evaluation. We used the two-part model to see the association between the time spent on digital consulting and the job role of staff, type of clinic, and the average length of the working hours using digital consulting.ResultsWhen estimated using the two-part model, consultants spent less time on digital consulting compared with nurses (95.48 minutes; P<.001), physiotherapists (55.3 minutes; P<.001), and psychologists (31.67 minutes; P<.001). Part-time staff spent less time using digital consulting than full-time staff despite insignificant result (P=.15). Time spent on digital consulting differed across sites, and no clear pattern in using digital consulting was found. Health professionals qualitatively identified the following 4 potential economic impacts for the NHS: decreasing adverse events, improving patient well-being, decreasing wait lists, and staff workload. We did not find evidence to suggest that the clinical condition was associated with digital consulting use.ConclusionsNurses and physiotherapists were the greatest users of digital consulting. Teams appear to use an efficient triage system with the most expensive members digitally consulting less than lower-paid team members. Staff report showed concerns regarding time spent digitally consulting, which implies that direct costs increase. There remain considerable gaps in evidence related to cost-effectiveness of digital consulting, but this study has highlighted important cost-related outcomes for assessment in future cost-effectiveness trials of digital consulting.

Project description:BackgroundThe project of scaling up noncommunicable disease (NCD) interventions in Southeast Asia aimed to strengthen the prevention and control of hypertension and diabetes, focusing on primary health care and community levels. In Vietnam, health volunteers who were members of the Intergenerational Self-Help Clubs (ISHCs) implemented community-based NCD screening and health promotion activities in communities. The ISHC health volunteers used an app based on District Health Information Software, version 2 (DHIS2) tracker (Society for Health Information Systems Programmes, India) to record details of participants during screening and other health activities.ObjectiveThis study aimed to assess the strengths, barriers, and limitations of the NCD screening app used by the ISHC health volunteers on tablets and to provide recommendations for further scaling up.MethodsA mixed methods observational study with a convergent parallel design was performed. For the quantitative data analysis, 2 rounds of screening data collected from all 59 ISHCs were analyzed on completeness and quality. For the qualitative analysis, 2 rounds of evaluation of the screening app were completed. Focus group discussions with ISHC health volunteers and club management boards and in-depth interviews with members of the Association of the Elderly and Commune Health Station staff were performed.ResultsIn the quantitative analysis, data completeness of all 6704 screenings (n=3485 individuals) was very high. For anthropomorphic measurements, such as blood pressure, body weight, and abdominal circumference, less than 1% errors were found. The data on NCD risk factors were not adequately recorded in 1908 (29.5%) of the screenings. From the qualitative analysis, the NCD screening app was appreciated by ISHC health volunteers and supervisors, as an easier and more efficient way to report to higher levels, secure data, and strengthen relationships with relevant stakeholders, using tablets to connect to the internet and internet-based platforms to access information for self-learning and sharing to promote a healthy lifestyle as the strengths. The barriers and limitations reported by the respondents were a non-age-friendly app, incomplete translation of parts of the app into Vietnamese, some issues with the tablet's display, lack of sharing of responsibilities among the health volunteers, and suboptimal involvement of the health sector; limited digital literacy among ISHC health volunteers. Recommendations are continuous capacity building, improving app issues, improving tablet issues, and involving relevant stakeholders or younger members in technology adoption to support older people.ConclusionsThe implementation of the NCD screening app by ISHC volunteers can be an effective way to improve community-led NCD screening and increase the uptake of NCD prevention and management services at the primary health care level. However, our study has shown that some barriers need to be addressed to maximize the efficient use of the app by ISHC health volunteers to record, report, and manage the screening data.

Project description:BackgroundHealth care organizations understand the importance of new technology implementations; however, the best strategy for implementing successful digital transformations is often unclear. Digital health maturity assessments allow providers to understand the progress made toward technology-enhanced health service delivery. Existing models have been criticized for their lack of depth and breadth because of their technology focus and neglect of meaningful outcomes.ObjectiveWe aimed to examine the perceived impacts of digital health reported by health care staff employed in health care organizations across a spectrum of digital health maturity.MethodsA mixed methods case study was conducted. The digital health maturity of public health care systems (n=16) in Queensland, Australia, was examined using the quantitative Digital Health Indicator (DHI) self-assessment survey. The lower and upper quartiles of DHI scores were calculated and used to stratify sites into 3 groups. Using qualitative methods, health care staff (n=154) participated in interviews and focus groups. Transcripts were analyzed assisted by automated text-mining software. Impacts were grouped according to the digital maturity of the health care worker's facility and mapped to the quadruple aims of health care: improved patient experience, improved population health, reduced health care cost, and enhanced provider experience.ResultsDHI scores ranged between 78 and 193 for the 16 health care systems. Health care systems in the high-maturity category (n=4, 25%) had a DHI score of ≥166.75 (the upper quartile); low-maturity sites (n=4, 25%) had a DHI score of ≤116.75 (the lower quartile); and intermediate-maturity sites (n=8, 50%) had a DHI score ranging from 116.75 to 166.75 (IQR). Overall, 18 perceived impacts were identified. Generally, a greater number of positive impacts were reported in health care systems of higher digital health maturity. For patient experiences, higher maturity was associated with maintaining a patient health record and tracking patient experience data, while telehealth enabled access and flexibility across all digital health maturity categories. For population health, patient journey tracking and clinical risk mitigation were reported as positive impacts at higher-maturity sites, and telehealth enabled health care access and efficiencies across all maturity categories. Limited interoperability and organizational factors (eg, strategy, policy, and vision) were universally negative impacts affecting health service delivery. For health care costs, the resource burden of ongoing investments in digital health and a sustainable skilled workforce was reported. For provider experiences, the negative impacts of poor usability and change fatigue were universal, while network and infrastructure issues were negative impacts at low-maturity sites.ConclusionsThis is one of the first studies to show differences in the perceived impacts of digital maturity of health care systems at scale. Higher digital health maturity was associated with more positive reported impacts, most notably in achieving outcomes for the population health aim.

Project description:BackgroundHeart failure (HF) affects 6.2 million Americans and is a leading cause of hospitalization. The mainstay of the management of HF is adherence to pharmacotherapy. Despite the effectiveness of HF pharmacotherapy, effectiveness is closely linked to adherence. Measuring adherence to HF pharmacotherapy is difficult; most clinical measures use indirect strategies such as calculating pharmacy refill data or using self-report. While helpful in guiding treatment adjustments, indirect measures of adherence may miss the detection of suboptimal adherence and co-occurring structural barriers associated with nonadherence. Digital pill systems (DPSs), which use an ingestible radiofrequency emitter to directly measure medication ingestions in real-time, represent a strategy for measuring and responding to nonadherence in the context of HF pharmacotherapy. Previous work has demonstrated the feasibility of using DPSs to measure adherence in other chronic diseases, but this strategy has yet to be leveraged for individuals with HF.ObjectiveWe aim to explore through qualitative interviews the facilitators and barriers to using DPS technology to monitor pharmacotherapy adherence among patients with HF.MethodsWe conducted individual, semistructured qualitative interviews and quantitative assessments between April and August 2022. A total of 20 patients with HF who were admitted to the general medical or cardiology service at an urban quaternary care hospital participated in this study. Participants completed a qualitative interview exploring the overall acceptability of and willingness to use DPS technology for adherence monitoring and perceived barriers to DPS use. Quantitative assessments evaluated HF history, existing medication adherence strategies, and attitudes toward technology. We analyzed qualitative data using applied thematic analysis and NVivo software (QSR International).ResultsMost participants (12/20, 60%) in qualitative interviews reported a willingness to use the DPS to measure HF medication adherence. Overall, the DPS was viewed as useful for increasing accountability and reinforcing adherence behaviors. Perceived barriers included technological issues, a lack of need, additional costs, and privacy concerns. Most were open to sharing adherence data with providers to bolster clinical care and decision-making. Reminder messages following detected nonadherence were perceived as a key feature, and customization was desired. Suggested improvements are primarily related to the design and usability of the Reader (a wearable device).ConclusionsOverall, individuals with HF perceived the DPS to be an acceptable and useful tool for measuring medication adherence. Accurate, real-time ingestion data can guide adherence counseling to optimize adherence management and inform tailored behavioral interventions to support adherence among patients with HF.

Dataset Information

Outcomes and Costs of the Transition From a Paper-Based Immunization System to a Digital Immunization System in Vietnam: Mixed Methods Study.

Background

Objective

Methods

Results

Conclusions

Publications

Outcomes and Costs of the Transition From a Paper-Based Immunization System to a Digital Immunization System in Vietnam: Mixed Methods Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets