Dataset Information

Detecting user experience issues from mHealth apps that support stroke caregiver needs: an analysis of user reviews.

ABSTRACT:

Background

Existing research has demonstrated the potential of mHealth apps in improving the caregiving outcomes of stroke. Since most of the apps were published in commercially available app stores without explaining their design and evaluation processes, it is necessary to identify the user experience issues to promote long-term adherence and usage.

Objective

The purpose of this study was to utilize published user reviews of commercially available apps to determine the user experience issues to guide future app development in stroke caregiving.

Methods

User reviews were extracted from the previously identified 46 apps that support stroke caregiving needs using a python-scraper. The reviews were pre-processed and filtered using python scripts to consider English reviews that described issues faced by the user. The final corpus was categorized based on TF-IDF vectorization and k-means clustering technique, and the issues extracted from the various topics were classified based on the seven dimensions of user experience to highlight factors that may affect the usage of the app.

Results

A total of 117,364 were extracted from the two app stores. After filtration, 13,368 reviews were included and classified based on the user experience dimensions. Findings highlight critical issues that affect the usability, usefulness, desirability, findability, accessibility, credibility, and value of the app that contribute to decreased satisfaction and increased frustration.

Conclusion

The study identified several user experience issues due to the inability of the app developers to understand the needs of the user. Further, the study describes the inclusion of a participatory design approach to promote an improved understanding of user needs; therefore, limiting any issues and ensuring continued use.

SUBMITTER: Lobo EH

PROVIDER: S-EPMC10247988 | biostudies-literature | 2023

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Detecting user experience issues from mHealth apps that support stroke caregiver needs: an analysis of user reviews.

Lobo Elton H EH Abdelrazek Mohamed M Frølich Anne A Rasmussen Lene J LJ Livingston Patricia M PM Islam Sheikh Mohammed Shariful SMS Kensing Finn F Grundy John J

Frontiers in public health 20230525

<h4>Background</h4>Existing research has demonstrated the potential of mHealth apps in improving the caregiving outcomes of stroke. Since most of the apps were published in commercially available app stores without explaining their design and evaluation processes, it is necessary to identify the user experience issues to promote long-term adherence and usage.<h4>Objective</h4>The purpose of this study was to utilize published user reviews of commercially available apps to determine the user expe ...[more]

PMID: 37304084

Similar Datasets

Project description:BACKGROUND:Many adolescents and young adults with chronic illness or disability often fail to develop the self-management skills necessary to independently handle medical and self-management routines. In light of these needs, we are developing iMHere 2.0 (Interactive Mobile Health and Rehabilitation), a mobile health (mHealth) system to support a self-management program. OBJECTIVE:Our objective was to gather data from persons with brain and spinal cord anomalies (BSA) and their caregivers to better understand how mHealth would be most helpful in supporting them to proactively manage daily self-care routines and to access medical care as needed. The specific purpose was not only to gather feedback and to gain increased insight into the design of the new version of iMHere, but also to gather perspectives of new groups, namely adolescents as young as 12 years and their parents and/or caregivers. METHODS:Our project employed focus group sessions and surveys to collect data from participants with BSA, as well as their caregivers. A total of six focus group sessions were conducted on four separate occasions until the data gathered reached saturation. The objectives of our focus group sessions were to better understand ways to develop mHealth systems to support self-management, to promote independence, to motivate long-term system use, and to prevent medical problems that lead to hospitalizations and emergency room visits for youth and young adults with BSA. RESULTS:A total of 16 youth and young adults with BSA and 11 caregivers participated in the sessions. Within and among our groups, the following five overarching themes emerged from the data: (1) make it easy, (2) engage, (3) educate and prepare, (4) motivate and support, and (5) personalize. Participants shared their perspectives and detailed information about mHealth apps that would be important for independence in self-care and self-management. CONCLUSIONS:Our findings suggest that most individuals keep their mobile phones with them at all times and typically use a mobile phone for social media, music, photos, and texting. Our qualitative analysis indicates that youth and young adults with BSA, as well as their caregivers, acknowledge the importance of being actively engaged in developing and using mHealth apps that monitor and manage their health care needs. Information gleaned from these focus group sessions and surveys have provided data to refine the iMHere 2.0 mHealth prototype platform that we have developed.

Project description:BackgroundHundreds of mental health apps are available to the general public. With increasing pressures on health care systems, they offer a potential way for people to support their mental health and well-being. However, although many are highly rated by users, few are evidence-based. Equally, our understanding of what makes apps engaging and valuable to users is limited.ObjectiveThe aim of this paper was to analyze functionality and user opinions of mobile apps purporting to support cognitive behavioral therapy for depression and to explore key factors that have an impact on user experience and support engagement.MethodsWe systematically identified apps described as being based on cognitive behavioral therapy for depression. We then conducted 2 studies. In the first, we analyzed the therapeutic functionality of apps. This corroborated existing work on apps' fidelity to cognitive behavioral therapy theory, but we also extended prior work by examining features designed to support user engagement. Engagement features found in cognitive behavioral therapy apps for depression were compared with those found in a larger group of apps that support mental well-being in a more general sense. Our second study involved a more detailed examination of user experience, through a thematic analysis of publicly available user reviews of cognitive behavioral therapy apps for depression.ResultsWe identified 31 apps that purport to be based on cognitive behavioral therapy for depression. Functionality analysis (study 1) showed that they offered an eclectic mix of features, including many not based on cognitive behavioral therapy practice. Cognitive behavioral therapy apps used less varied engagement features compared with 253 other mental well-being apps. The analysis of 1287 user reviews of cognitive behavioral therapy apps for depression (study 2) showed that apps are used in a wide range of contexts, both replacing and augmenting therapy, and allowing users to play an active role in supporting their mental health and well-being. Users, including health professionals, valued and used apps that incorporated both core cognitive behavioral therapy and non-cognitive behavioral therapy elements, but concerns were also expressed regarding the unsupervised use of apps. Positivity was seen as important to engagement, for example, in the context of automatic thoughts, users expressed a preference to capture not just negative but also positive ones. Privacy, security, and trust were crucial to the user experience.ConclusionsCognitive behavioral therapy apps for depression need to improve with respect to incorporating evidence-based cognitive behavioral therapy elements. Equally, a positive user experience is dependent on other design factors, including consideration of varying contexts of use. App designers should be able to clearly identify the therapeutic basis of their apps, but they should also draw on evidence-based strategies to support a positive and engaging user experience. The most effective apps are likely to strike a balance between evidence-based cognitive behavioral therapy strategies and evidence-based design strategies, including the possibility of eclectic therapeutic techniques.

Project description:BackgroundUser experience and engagement are critical elements of mental health apps' abilities to support users. However, work examining the relationships among user experience, engagement, and popularity has been limited. Understanding how user experience relates to engagement with and popularity of mental health apps can demonstrate the relationship between subjective and objective measures of app use. In turn, this may inform efforts to develop more effective and appealing mental health apps and ensure that they reach wide audiences.ObjectiveWe aimed to examine the relationship among subjective measures of user experience, objective measures of popularity, and engagement in mental health apps.MethodsWe conducted a preregistered secondary data analysis in a sample of 56 mental health apps. To measure user experience, we used expert ratings on the Mobile App Rating Scale (MARS) and consumer ratings from the Apple App Store and Google Play. To measure engagement, we acquired estimates of monthly active users (MAU) and user retention. To measure app popularity, we used download count, total app revenue, and MAU again.ResultsMARS total score was moderately positively correlated with app-level revenue (Kendall rank [T]=0.30, P=.002), MAU (T=0.39, P<.001), and downloads (T=0.41, P<.001). However, the MARS total score and each of its subscales (Engagement, Functionality, Aesthetics, and Information) showed extremely small correlations with user retention 1, 7, and 30 days after downloading. Furthermore, the total MARS score only correlated with app store rating at T=0.12, which, at P=.20, did not meet our threshold for significance.ConclusionsMore popular mental health apps receive better ratings of user experience than less popular ones. However, user experience does not predict sustained engagement with mental health apps. Thus, mental health app developers and evaluators need to better understand user experience and engagement, as well as to define sustained engagement, what leads to it, and how to create products that achieve it. This understanding might be supported by better collaboration between industry and academic teams to advance a science of engagement.

Project description:BackgroundTeletherapy apps have emerged as a promising alternative to traditional in-person therapy, especially after the COVID-19 pandemic, as they help overcome a range of geographical and emotional barriers to accessing care. However, the rapid proliferation of teletherapy apps has occurred in an environment in which development has outpaced the various regulatory and ethical considerations of this space. Thus, researchers have raised concerns about the ethical implications and potential risks of teletherapy apps given the lack of regulation and oversight. Teletherapy apps have distinct aims to more directly replicate practices of traditional care, as opposed to mental health apps, which primarily provide supplemental support, suggesting a need to examine the ethical considerations of teletherapy apps from the lens of existing ethical guidelines for providing therapy.ObjectiveIn this study, we examined user reviews of commercial teletherapy apps to understand user perceptions of whether and how ethical principles are followed and incorporated.MethodsWe identified 8 mobile apps that (1) provided teletherapy on 2 dominant mobile app stores (Google Play and Apple App Store) and (2) had received >5000 app reviews on both app stores. We wrote Python scripts (Python Software Foundation) to scrape user reviews from the 8 apps, collecting 3268 user reviews combined across 2 app stores. We used thematic analysis to qualitatively analyze user reviews, developing a codebook drawing from the ethical codes of conduct for psychologists, psychiatrists, and social workers.ResultsThe qualitative analysis of user reviews revealed the ethical concerns and opportunities of teletherapy app users. Users frequently perceived unprofessionalism in their teletherapists, mentioning that their therapists did not listen to them, were distracted during therapy sessions, and did not keep their appointments. Users also noted technical glitches and therapist unavailability on teletherapy apps that might affect their ability to provide continuity of care. Users held varied opinions on the affordability of those apps, with some perceiving them as affordable and others not. Users further brought up that the subscription model resulted in unfair pricing and expressed concerns about the lack of cost transparency. Users perceived that these apps could help promote access to care by overcoming geographical and social constraints.ConclusionsOur study suggests that users perceive commercial teletherapy apps as adhering to many ethical principles pertaining to therapy but falling short in key areas regarding professionalism, continuity of care, cost fairness, and cost transparency. Our findings suggest that, to provide high-quality care, teletherapy apps should prioritize fair compensation for therapists, develop more flexible and transparent payment models, and invest in measures to ensure app stability and therapist availability. Future work is needed to develop standards for teletherapy and improve the quality and accessibility of those services.

Project description:IntroductionReviews of commercial and publicly available smartphone (mobile) health applications (mHealth app reviews) are being undertaken and published. However, there is variation in the conduct and reporting of mHealth app reviews, with no existing reporting guidelines. Building on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, we aim to develop the Consensus for APP Review Reporting Items (CAPPRRI) guidance, to support the conduct and reporting of mHealth app reviews. This scoping review of published mHealth app reviews will explore their alignment, deviation, and modification to the PRISMA 2020 items for systematic reviews and identify a list of possible items to include in CAPPRRI.Method and analysisWe are following the Joanna Briggs Institute approach and Arksey and O'Malley's five-step process. Patient and public contributors, mHealth app review, digital health research and evidence synthesis experts, healthcare professionals and a specialist librarian gave feedback on the methods. We will search SCOPUS, CINAHL Plus, AMED, EMBASE, Medline, APA PsycINFO and the ACM Digital Library for articles reporting mHealth app reviews and use a two-step screening process to identify eligible articles. Information on whether the authors have reported, or how they have modified the PRISMA 2020 items in their reporting, will be extracted. Data extraction will also include the article characteristics, protocol and registration information, review question frameworks used, information about the search and screening process, how apps have been evaluated and evidence of stakeholder engagement. This will be analysed using a content synthesis approach and presented using descriptive statistics and summaries. This protocol is registered on OSF (https://osf.io/5ahjx).Ethics and disseminationEthical approval is not required. The findings will be disseminated through peer-reviewed journal publications (shared on our project website and on the EQUATOR Network website where the CAPPRRI guidance has been registered as under development), conference presentations and blog and social media posts in lay language.

Dataset Information

Detecting user experience issues from mHealth apps that support stroke caregiver needs: an analysis of user reviews.

Background

Objective

Methods

Results

Conclusion

Publications

Detecting user experience issues from mHealth apps that support stroke caregiver needs: an analysis of user reviews.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets