Dataset Information

"It reminds me and motivates me": Human-centered design and implementation of an interactive, SMS-based digital intervention to improve early retention on antiretroviral therapy: Usability and acceptability among new initiates in a high-volume, public clinic in Malawi.

ABSTRACT:

Background

Early retention of people living with HIV (PLHIV) in antiretroviral therapy (ART) programs is critical to improve individual clinical outcomes and viral load suppression. Although many mobile health (mHealth) interventions aim to improve retention in care, there is still lack of evidence on mHealth success or failure, including from patient's perspectives. We describe the human-centered design (HCD) process and assess patient usability and acceptability of a two-way texting (2wT) intervention to improve early retention among new ART initiates at Lighthouse Trust clinic in Lilongwe, Malawi.

Methods

An iterative HCD approach focused on patient and provider users' needs, incorporating feedback from multidisciplinary teams to adapt 2wT for the local, public clinic context. We present mixed-methods usability and acceptability results from 100 participants, 50 at 3-months and 50 at 6-months, post 2wT enrollment, and observations of these same patients completing core tasks of the 2wT system.

Results

Among the 100 usability respondents, 95% were satisfied with visit reminders, and 88% would recommend reminders and motivational messages to friends; however, 17% were worried about confidentiality. In observation of participant task completion, 94% were able to successfully confirm visit attendance and 73% could request appointment date change. More participants in 4-6 months group completed tasks correctly compared to 1-3 months group, although not significantly different (78% vs. 66%, p = 0.181). Qualitative results were overwhelmingly positive, but patients did note confusion with transfer reporting and concern that 2wT would not reach patients without mobile phones or with lower literacy.

Conclusion

The 2wT app for early ART retention appears highly usable and acceptable, hopefully creating a solid foundation for lifelong engagement in care. The HCD approach put the local team central in this process, ensuring that both patients' and Lighthouse's priorities, policies, and practices were forefront in 2wT optimization, raising the likelihood of 2wT success in other routine program contexts.

SUBMITTER: Huwa J

PROVIDER: S-EPMC10358959 | biostudies-literature | 2023

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

"It reminds me and motivates me": Human-centered design and implementation of an interactive, SMS-based digital intervention to improve early retention on antiretroviral therapy: Usability and acceptability among new initiates in a high-volume, public clinic in Malawi.

Huwa Jacqueline J Tweya Hannock H Mureithi Maryanne M Kiruthu-Kamamia Christine C Oni Femi F Chintedza Joseph J Chiwaya Geldert G Waweru Evelyn E Kudzala Aubrey A Wasunna Beatrice B Ndhlovu Dumisani D Bisani Pachawo P Feldacker Caryl C

PloS one 20230720 7

<h4>Background</h4>Early retention of people living with HIV (PLHIV) in antiretroviral therapy (ART) programs is critical to improve individual clinical outcomes and viral load suppression. Although many mobile health (mHealth) interventions aim to improve retention in care, there is still lack of evidence on mHealth success or failure, including from patient's perspectives. We describe the human-centered design (HCD) process and assess patient usability and acceptability of a two-way texting (2 ...[more]

PMID: 37471383

Similar Datasets

Project description:New initiates on antiretroviral therapy (ART) are at high risk of treatment discontinuation, putting their health at risk. In low- and middle-income countries, like Malawi, appropriate digital health applications (apps) must fit into local clinic, connectivity and resource constraints. We describe the human centered design (HCD) and development process of an open-source, hybrid, two-way texting (2wT) system to improve ART retention. We detail the critical role of diverse healthcare workers (HCWs) in the HCD process to inform app usability, create buy-in, and ensure appropriate optimization for the local context. We optimized 2wT usability and acceptability over three HCD phases: 1) informal feedback sessions with diverse 2wT stakeholders, 2) a small pilot, and 3) key informant interviews. Phase one included four sessions with diverse HCWs, including "expert ART clients", clinical, technical, supervisory, and evaluation teams to inform 2wT design. In phase 2, a small pilot with 50 participating ART clients aimed to inform implementation improvement. Phase three included interviews with ten HCWs to deepen understanding of 2wT acceptability and usability, documenting strengths and weaknesses to inform optimization. Multi-phase feedback sessions with HCWs helped refine 2wT language and message timing for both weekly and tailored client-specific visit reminders. The pilot led to improvements in educational materials to guide client responses and ease interaction with HCWs. In interviews, the HCWs appreciated the HCD co-creation process, suggested ways to increase access for low-literacy clients or those without consistent phone access, and felt integrating 2wT with other eHealth platforms would improve scalability. Inclusion of HCWs across phases of HCD design, adaption, and optimization increased 2wT usability and acceptability among HCWs in this setting. Engaging HCWs into 2wT co-ownership from inception appears successful in co-creation of an app that will meet HCW needs, and therefore, enhance support for 2wT clients to attend visits and remain in care.

Project description:IntroductionUptake of voluntary medical male circumcision (VMMC) remains a challenge in many settings. Innovative implementation strategies are required to scale-up VMMC uptake.MethodologyRITe was a multi-faceted intervention comprising transport reimbursement (R), intensified health education (IHE) and SMS/Telephone tracing (Te), which increased the uptake of VMMC among uncircumcised men with sexually transmitted infections (STIs) in Malawi. Using a concurrent exploratory mixed-method approach, we assessed the intervention's acceptability, feasibility and appropriateness among men with STIs and healthcare workers (HCWs) at Bwaila District Hospital. Participants completed Likert scale surveys and participated in-depth interviews (IDIs) and focus group discussions (FGDs). We calculated percentages of responses to survey items and summarized common themes using thematic analysis. Median scores and interquartile ranges (IQR) were calculated for acceptability, feasibility and appropriateness of each strategy at baseline and end-line and compared using the Wilcoxon signed rank test.ResultsA total of 300 surveys, 17 IDIs and 4 FGDs were conducted with men and HCWs between baseline and end-line. The mean age for men in the survey was 29 years (SD ±8) and most were married/cohabiting (59.3%). Mean age for HCWs was 38.5 years (SD ±7), and most were female (59.1%). For acceptability, participants agreed that RITe was welcome, approvable, and likable. Despite participants agreeing that RITe was a good idea, fit and suitability influenced appropriateness, particularly at baseline, which improved at end-line for Te and R. For feasibility, HCWs agreed that RITe was easy to implement, but expressed concerns that R (end-line median = 4, IQR: 2, 4) and Te (end-line median = 4, IQR: 4, 4), were unsustainable. Interviews corroborated the survey results. Participants reported that IHE provided important information, Te was a good reminder and R was attractive, but they reported barriers to R and Te such as electricity, limited access to phones and distrust in the government.ConclusionsThe RITe intervention was acceptable, feasible and appropriate. However, culture/religion and structural barriers affected perceptions of appropriateness and feasibility, respectively. Continued awareness raising on VMMC and addressing setting-specific structural factors are required to overcome barriers that impede demand-creation interventions for VMMC.

Project description:BackgroundTo address challenges related to medication management in underserved settings, we developed a system for Prescription Management And General Inventory Control, or RxMAGIC, in collaboration with the Birmingham Free Clinic in Pittsburgh, Pennsylvania. RxMAGIC is an interoperable, web-based medication management system designed to standardize and streamline the dispensing practice and improve inventory control in a free clinic setting. This manuscript describes the processes used to design, develop, and deploy RxMAGIC.MethodsWe transformed data from previously performed mixed-methods needs assessment studies into functional user requirements using agile development methods. Requirements took the form of user stories that were prioritized to drive implementation of RxMAGIC as a web-application. A functional prototype was developed and tested to understand its perceived usefulness before developing a production system. Prior to deployment, we evaluated the usability of RxMAGIC with six users to diagnose potential interaction challenges that may be avoided through redesign. The results from this study were similarly prioritized and informed the final features of the production system.ResultsWe developed 45 user stories that acted as functional requirements to incrementally build RxMAGIC. Integrating with the electronic health record at the clinic was a requirement for deployment. We utilized health data standards to communicate with the existing order entry system; an outgoing electronic prescribing framework was leveraged to send prescription data to RxMAGIC. The results of the usability study were positive, with all tested features receiving a mean score of four or five (i.e. somewhat easy or easy, respectively) on a five-point Likert scale assessing ease of completion, thus demonstrating the system's simplicity and high learnability. RxMAGIC was deployed at the clinic in October 2016 over a two-week period.ConclusionsWe built RxMAGIC, an open-source, pharmacist-facing dispensary management information system that augments the pharmacist's ability to efficiently deliver medication services in a free clinic setting. RxMAGIC provides electronic dispensing and automated inventory management and alerting capabilities. We deployed RxMAGIC at the Birmingham Free Clinic and measured its usability with potential users. In future work, we plan to continue to measure the impact of RxMAGIC on pharmacist efficiency and satisfaction.

Project description:BackgroundUsing an HIV pretest screening tool to identify children most at risk for HIV infection may be a more efficient and cost-effective approach to identify children living with HIV in resource-limited settings. These tools seek to reduce overtesting of children by increasing the positive predictive value while ensuring a high negative predictive value for those screened for HIV.MethodsThis qualitative study in Malawi evaluated acceptability and usability of a modified version of the Zimbabwe HIV screening tool to identify children aged 2-14 years most-at-risk. The tool included additional questions about previous hospitalisations due to malaria and prior documented diagnoses. Sixteen interviews were conducted with expert clients (ECs), trained peer-supporters, which administered the screening tool and 12 interviews with biological and non-biological caregivers of screened children. All interviews were audiorecorded, transcribed and translated. Transcripts were analysed manually using a short-answer analysis, compiling responses for each question by study participant group. Summary documents were generated, identifying common and outlier perspectives.ResultsThe HIV paediatric screening tool was generally accepted by caregivers and ECs, with both groups seeing the benefit of the tool and promoting its use. The ECs who were primarily responsible for implementing the tool initially struggled with acceptance of the tool but started to accept it after additional training and mentorship was provided. Overall, caregivers accepted having their children tested for HIV, although non-biological caregivers expressed hesitancy in giving consent for HIV testing. ECs reported challenges with the ability for non-biological caregivers to answer some questions.ConclusionThis study found general acceptance of paediatric screening tools in children in Malawi and identified some minor challenges that raise important considerations for tool implementation. These include the need for a thorough orientation of the tools for the healthcare workers and caregivers, appropriate space at the facility, and adequate staffing and commodities.

Project description:BackgroundPeople with advanced ovarian cancer and their caregivers report unmet supportive care needs. We developed a Collaborative Agenda-Setting Intervention (CASI) to elicit patients' and caregivers' needs through the patient portal before a clinic visit and to communicate these needs to clinicians using the electronic health record.ObjectiveWe aimed to assess the usability and acceptability of the CASI and identify barriers to and facilitators of its implementation.MethodsWe recruited English- and Spanish-speaking patients, caregivers, and clinicians from the gynecologic oncology program at a comprehensive cancer center. Participants used the CASI prototype and then completed individual cognitive interviews and surveys. We assessed usability with the System Usability Scale (scores range 0-100, scores ≥70 indicate acceptable usability) and acceptability with the Acceptability of Intervention Measure and Intervention Appropriateness Measure (scores for both measures range from 1 to 5, higher scores indicate greater acceptability). Interviews were audio recorded, transcribed, and analyzed using directed content analysis. Domains and constructs from the Consolidated Framework for Implementation Research comprised the initial codebook. We analyzed survey data using descriptive statistics and compared usability and acceptability scores across patients, caregivers, and clinicians using analyses of variance.ResultsWe enrolled 15 participants (5 patients, 5 caregivers, and 5 clinicians). The mean System Usability Scale score was 72 (SD 16). The mean Acceptability of Intervention Measure and Intervention Appropriateness Measure scores were 3.9 (SD 1.0) and 4.1 (SD 0.8), respectively. Participants viewed the CASI content and format positively overall. Several participants appreciated the CASI's integration into the clinical workflow and its potential to increase attention to psychosocial concerns. Suggestions to refine the CASI included removing redundant items, simplifying item language, and adding options to request a conversation or opt out of supportive care referrals. Key barriers to implementing the CASI include its complexity and limited resources available to address patients' and caregivers' needs.ConclusionsThe CASI is usable and acceptable to patients with advanced ovarian cancer, caregivers, and clinicians. We identified several barriers to and facilitators of implementing the CASI. In future research, we will apply these insights to a pilot randomized controlled trial to assess the feasibility of comparing the CASI to usual care in a parallel group-randomized efficacy trial.

Project description:BackgroundAlthough research continues to support task-shifting as an effective model of delivering evidence-based practices (EBPs), little scholarship has focused how to scale up and sustain task-shifting in low- and middle-income countries, including how to sustainably supervise lay counselors. Ongoing supervision is critical to ensure EBPs are delivered with fidelity; however, the resources and expertise required to provide ongoing supervision may limit the potential to scale up and sustain task shifting. Opportunities may exist to leverage mobile technology to replace or supplement in-person supervision in low-resource contexts, but contextual variables, such as network connectivity and lay counselor preferences surrounding mobile technology, must be examined and considered when designing and implementing mobile technology supervision.MethodsThis study builds from an existing randomized trial in Kenya, wherein teachers and community health volunteers have been trained to provide trauma-focused cognitive behavioral therapy as lay counselors. The study will use an iterative and mixed methods approach, with qualitative interviews and a Human-Centered Design (HCD) workshop informing a non-randomized pilot trial. Semi-structured interviews will be conducted with lay counselors and supervisors to understand how mobile technology is currently being used for supervision and determine the barriers and facilitators to mobile technology supervision. Data from these interviews will inform an HCD workshop, where lay counselors and supervisors "re-design" supervision to most effectively leverage mobile technology. Workshop participants will also participate in focus groups to gather perceptions on the use of HCD techniques. The final outcome of the workshop will be a set of refined workflows, which will be tested in a mixed method, nonrandomized pilot with newly trained lay counselors and existing supervisors. The pilot trial will evaluate the acceptability, feasibility, and usability of mobile technology supervision through self-report questionnaires as well as perceptions of effectiveness through qualitative interviews with a subset of lay counselors and all supervisors.DiscussionThis study will provide a launching point for future research on supervision and methods to engage stakeholders to design and tailor interventions and implementation supports to fit low-resourced contexts.Trial registrationThe parent trial from which this study builds was registered on ClinicalTrials.gov on August 9, 2017 ( NCT03243396 ).

Project description:BackgroundSleep disorders are common and disproportionately affect marginalized populations. Technology, such as wearable devices, holds the potential to improve sleep quality and reduce sleep disparities, but most devices have not been designed or tested with racially, ethnically, and socioeconomically diverse patients. Inclusion and engagement of diverse patients throughout digital health development and implementation are critical to achieving health equity.ObjectiveThis study aims to evaluate the usability and acceptability of a wearable sleep monitoring device-SomnoRing-and its accompanying mobile app among patients treated in a safety net clinic.MethodsThe study team recruited English- and Spanish-speaking patients from a mid-sized pulmonary and sleep medicine practice serving publicly insured patients. Eligibility criteria included initial evaluation of obstructed sleep apnea, which is most appropriate for limited cardiopulmonary testing. Patients with primary insomnia or other suspected sleep disorders were not included. Patients tested the SomnoRing over a 7-night period and participated in a 1-hour semistructured web-based qualitative interview covering perceptions of the device, motivators and barriers to use, and general experiences with digital health tools. The study team used inductive or deductive processes to code interview transcripts, guided by the Technology Acceptance Model.ResultsA total of 21 individuals participated in the study. All participants owned a smartphone, almost all (19/21) felt comfortable using their phone, and few already owned a wearable (6/21). Almost all participants wore the SomnoRing for 7 nights and found it comfortable. The following four themes emerged from qualitative data: (1) the SomnoRing was easy to use compared to other wearable devices or traditional home sleep testing alternatives, such as the standard polysomnogram technology for sleep studies; (2) the patient's context and environment, such as family and peer influence, housing status, access to insurance, and device cost affected the overall acceptance of the SomnoRing; (3) clinical champions motivated use in supporting effective onboarding, interpretation of data, and, ongoing technical support; and (4) participants desired more assistance and information to best interpret their own sleep data summarized in the companion app.ConclusionsRacially, ethnically, and socioeconomically diverse patients with sleep disorders perceived a wearable as useful and acceptable for sleep health. Participants also uncovered external barriers related to the perceived usefulness of the technology, such as housing status, insurance coverage, and clinical support. Future studies should further examine how to best address these barriers so that wearables, such as the SomnoRing, can be successfully implemented in the safety net health setting.

Dataset Information

"It reminds me and motivates me": Human-centered design and implementation of an interactive, SMS-based digital intervention to improve early retention on antiretroviral therapy: Usability and acceptability among new initiates in a high-volume, public clinic in Malawi.

Background

Methods

Results

Conclusion

Publications

"It reminds me and motivates me": Human-centered design and implementation of an interactive, SMS-based digital intervention to improve early retention on antiretroviral therapy: Usability and acceptability among new initiates in a high-volume, public clinic in Malawi.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets