Dataset Information

Remote Cognitive Screening Of Healthy Older Adults for Primary Care With the MyCog Mobile App: Iterative Design and Usability Evaluation.

ABSTRACT:

Background

Annual cognitive screening in adults aged >65 years can improve early detection of cognitive impairment, yet less than half of all cases are identified in primary care. Time constraints in primary care settings present a major barrier to routine screening. A remote cognitive screener completed on a patient's own smartphone before a visit has the potential to save primary care clinics time, encourage broader screening practices, and increase early detection of cognitive decline.

Objective

We described the iterative design and proposed the implementation of a remote cognitive screening app, MyCog Mobile, to be completed on a patient's smartphone before an annual wellness visit. The research questions were as follows: What would motivate primary care clinicians and clinic administrators to implement a remote cognitive screening process? How might we design a remote cognitive screener to fit well with existing primary care workflows? What would motivate an older adult patient to complete a cognitive screener on a smartphone before a primary care visit? How might we optimize the user experience of completing a remote cognitive screener on a smartphone for older adults?

Methods

To address research questions 1 and 2, we conducted individual interviews with clinicians (n=5) and clinic administrators (n=3). We also collaborated with clinic administrators to create user journey maps of their existing and proposed MyCog Mobile workflows. To address research questions 3 and 4, we conducted individual semistructured interviews with cognitively healthy older adults (n=5) and solicited feedback from a community stakeholder panel (n=11). We also tested and refined high-fidelity prototypes of the MyCog Mobile app with the older adult interview participants, who rated the usability on the Simplified System Usability Scale and After-Scenario Questionnaire.

Results

Clinicians and clinic administrators were motivated to adopt a remote cognitive screening process if it saved time in their workflows. Findings from interviews and user journey mapping informed the proposed implementation and core functionality of MyCog Mobile. Older adult participants were motivated to complete cognitive screeners to ensure that they were cognitively healthy and saw additional benefits to remote screening, such as saving time during their visit and privacy. Older adults also identified potential challenges to remote smartphone screening, which informed the user experience design of the MyCog Mobile app. The average rating across prototype versions was 91 (SD 5.18) on the Simplified System Usability Scale and 6.13 (SD 8.40) on the After-Scenario Questionnaire, indicating above-average usability.

Conclusions

Through an iterative, human-centered design process, we developed a viable remote cognitive screening app and proposed an implementation strategy for primary care settings that was optimized for multiple stakeholders. The next steps include validating the cognitive screener in clinical and healthy populations and piloting the finalized app in a community primary care clinic.

SUBMITTER: Young SR

PROVIDER: S-EPMC9875000 | biostudies-literature | 2023 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Remote Cognitive Screening Of Healthy Older Adults for Primary Care With the MyCog Mobile App: Iterative Design and Usability Evaluation.

Young Stephanie Ruth SR Lattie Emily Gardiner EG Berry Andrew B L ABL Bui Lynn L Byrne Greg Joseph GJ Yoshino Benavente Julia Noelani JN Bass Michael M Gershon Richard C RC Wolf Michael S MS Nowinski Cindy J CJ

JMIR formative research 20230110

<h4>Background</h4>Annual cognitive screening in adults aged >65 years can improve early detection of cognitive impairment, yet less than half of all cases are identified in primary care. Time constraints in primary care settings present a major barrier to routine screening. A remote cognitive screener completed on a patient's own smartphone before a visit has the potential to save primary care clinics time, encourage broader screening practices, and increase early detection of cognitive decline ...[more]

PMID: 36626223

Similar Datasets

Project description:IntroductionThe early detection of cognitive impairment is one of the most important challenges in Alzheimer's disease (AD) research. The use of brief, short-term repeated test sessions via mobile app has demonstrated similar or better reliability and validity compared to standard in-clinic assessments in adult samples. The present study examined adherence, acceptability, and reliability for a remote, app-based cognitive screening protocol in healthy older adults.MethodsCognitively unimpaired older adults (N = 52, ages 60-80) completed three brief cognitive testing sessions per day within morning, afternoon, and evening time windows, for 8 consecutive days using a mobile app-based cognitive testing platform. Cognitive tasks assessed visual working memory, processing speed, and episodic memory.ResultsParticipants completed an average of 93% (M = 22.3 sessions, standard deviation = 10.2) of the 24 assigned sessions within 8 to 9 days. Average daily adherence ranged from 95% of sessions completed on day 2 to 88% of sessions completed on day 8. There was a statistically significant effect of session time on adherence between the morning and afternoon sessions only F (1, 51) = 9.15, P = .004, η p 2 = 0.152, with fewer afternoon sessions completed on average. The within-person reliabilities of average scores, aggregated across all 24 sessions, were exceptionally high, ranging from 0.89 to 0.97. Performance on the episodic memory task was positively and significantly associated with total score and word list recall score on the Telephone Interview for Cognitive Status. In an exit survey, 65% of participants reported that they "definitely" would complete the sessions again.DiscussionThese findings suggests that remote, mobile app-based cognitive testing in short bursts is both highly feasible and reliable in a motivated sample of cognitively normal older adults. Limitations include the limited diversity and generalizability of the sample; this was a largely White, highly educated, and motivated sample self-selected for AD research.

Project description:BackgroundA challenge facing researchers conducting mobile health (mHealth) research is the amount of resources required to develop mobile apps. This can be a barrier to generating relevant knowledge in a timely manner. The recent rise of "no-code" software development platforms may overcome this challenge and enable researchers to decrease the cost and time required to develop mHealth research apps.ObjectiveWe aimed to describe the development process and the lessons learned to build Pathverse, a no-code mHealth app design platform.MethodsThe study took place between November 2019 and December 2021. We used a participatory research framework to develop the mHealth app design platform. In phase 1, we worked with researchers to gather key platform feature requirements and conducted an exploratory literature search to determine needs related to this platform. In phase 2, we used an agile software framework (Scrum) to develop the platform. Each development sprint cycle was 4 weeks in length. We created a minimum viable product at the end of 7 sprint cycles. In phase 3, we used a convenience sample of adults (n=5) to gather user feedback through usability and acceptability testing. In phase 4, we further developed the platform based on user feedback, following the V-model software development process.ResultsOur team consulted end users (ie, researchers) and utilized behavior change technique taxonomy and behavior change models (ie, the multi-process action control framework) to guide the development of features. The first version of the Pathverse platform included features that allowed researchers to (1) design customized multimedia app content (eg, interactive lessons), (2) set content delivery logic (eg, only show new lessons when completing the previous lesson), (3) implement customized participant surveys, (4) provide self-monitoring tools, (5) set personalized goals, and (6) customize app notifications. Usability and acceptability testing revealed that researchers found the platform easy to navigate and that the features were intuitive to use. Potential improvements include the ability to deliver adaptive interventions and add features such as community group chat.ConclusionsTo our knowledge, Pathverse is the first no-code mHealth app design platform for developing mHealth interventions for behavior. We successfully used behavior change models and the behavior change technique taxonomy to inform the feature requirements of Pathverse. Overall, the use of a participatory framework, combined with the agile and hybrid-agile software development process, enabled our team to successfully develop the Pathverse platform.

Project description:BackgroundWeb-based and mobile interventions to influence physical activity behavior have had limited effects on sustained behavior change. One reason may be that the interventions aim to change largely habitual behavior. Following an identity-oriented approach could be a successful strategy to behavior change because people are committed to behave in line with their self-perception of identity.ObjectiveIn this paper, we take a closer look at the role of motivation in long-term adherence to lifestyle interventions. The paper outlines a method for web-based or mobile intervention development that allows exploration of integrating behavior change theory into the design process. We will describe the development of a mobile app that allows people to be self-determined and to value and self-regulate physical activity by adopting an identity-oriented approach.MethodsThis paper describes a Research through Design (RtD) process in which design activities are carried out as part of the knowledge-generating process. Two RtD phases were completed, followed by a conceptual design phase. In the first RtD phase, 8 participants used diary cards to study initial attitudes toward starting with small changes in physical activity. In the second RtD phase, 26 participants used a web-based app to study changes in physical activity. We used an adapted version of the Self-Report Habit Index (SRHI) to evaluate individuals' perceptions of a particular behavior with respect to the three facets of a habit. The conceptual design phase consolidated the results from first two RtD phases into a design of a mobile app that combines an identity approach with gamification principles. The conceptual design was evaluated in a user-experience study with 4 participants.ResultsIn the first RtD phase, we found that interacting daily with diary cards and reflecting on physical activity patterns is a promising strategy but works better through a digital medium. In the second RtD phase, SHRI ratings from all participants generally increased each week. In the conceptual design phase, we found that the concept of the mobile app was positively evaluated by participants. However, participants mentioned that terms such as "identity" do not resonate with them and that scenarios could be simpler.ConclusionsThis paper provides deeper insights into designing for electronic health (eHealth) interventions and services and suggests a new way that motivation can be shaped by the design of an intervention and adherence to physical activity. To the best of our knowledge, this was the first iterative design study in which the effects of adopting an identity approach to both motivation and physical activity were included and observed. Initial promising results were found for using a web-based intervention where habits and identification with the personal importance of a behavior were repetitively triggered.

Project description:BackgroundMobile device-based tools to help adolescents practice skills outside of cognitive behavioral therapy (CBT) sessions for treating an anxiety disorder may lead to greater treatment gains.ObjectiveThis study aimed to develop, design, and test the acceptability, learnability, heuristics, and usability of MindClimb, a smartphone-based app for adolescents with anxiety to use between CBT sessions to plan and complete exposure activities using skills (cognitive, relaxation, exposure practice, and reward) learned in treatment.MethodsThis 3-phase study took place from August 2015 to December 2018. In phase 1, the app was designed and developed in consultation with young people and CBT therapists to identify desired functions and content. Feedback was subjected to thematic analysis using a general inductive approach. In phase 2, we conducted 2 high-fidelity testing sessions using the think-aloud approach (acceptability, learnability, usability) and 10-item System Usability Scale with 10 adolescents receiving CBT. The high-fidelity MindClimb app was evaluated by 5 app developers based on Nielsen's usability heuristics and 5-point severity ranking scale. In phase 3, a total of 8 adolescents and 3 therapists assessed the usability of MindClimb during CBT sessions by recording the frequency of skills practice, use of MindClimb features, satisfaction with the app, and barriers and facilitators to app use during treatment.ResultsFeedback from phase 1 consultations indicated that the app should (1) be responsive to user needs and preferences, (2) be easy to use and navigate, (3) have relevant content to the practice of CBT for anxiety, and (4) be aesthetically appealing. Using this feedback as a guide, a fully functional app prototype for usability testing and heuristic evaluation was developed. In phase 2, think-aloud and usability data resulted in minor revisions to the app, including refinement of exposure activities. The average system usability score was 77 in both testing cycles, indicating acceptable usability. The heuristic evaluation by app developers identified only minor errors (eg, loading speed of app content, with a score of 1 on the severity ranking scale). In phase 3, adolescents considered app features for completing exposure (6.2/10) and relaxation (6.4/10) modestly helpful. Both adolescents (average score 11.3/15, SD 1.6) and therapists (average score 10.0/12, 2.6 SD) reported being satisfied with the app.ConclusionsThe user-centered approach to developing and testing MindClimb resulted in a mobile health app that can be used by adolescents during CBT for anxiety. Evaluation of the use of this app in a clinical practice setting demonstrated that adolescents and therapists generally felt it was helpful for CBT practice outside of therapy sessions. Implementation studies with larger youth samples are necessary to evaluate how to optimize the use of technology in clinical care and examine the impact of the app plus CBT on clinical care processes and patient outcomes.

Project description:BackgroundDementia is a widespread syndrome that currently affects more than 55 million people worldwide. Digital screening instruments are one way to increase diagnosis rates. Developing an app for older adults presents several challenges, both technical and social. In order to make the app user-friendly, feedback from potential future end users is crucial during this development process.ObjectiveThis study aimed to establish a user-centered design process for the development of digiDEM-SCREEN, a user-friendly app to support early identification of persons with slight symptoms of dementia.MethodsThis research used qualitative and quantitative methods and involved 3 key stakeholder groups: the digiDEM research team, the software development team, and the target user group (older adults ≥65 years with and without cognitive impairments). The development of the screening app was based on an already existing and scientifically analyzed screening test (Self-Administered Tasks Uncovering Risk of Neurodegeneration; SATURN). An initial prototype was developed based on the recommendations for mobile health apps and the teams' experiences. The prototype was tested in several iterations by various end users and continuously improved. The app's usability was evaluated using the System Usability Scale (SUS), and verbal feedback by the end users was obtained using the think-aloud method.ResultsThe translation process during test development took linguistic and cultural aspects into account. The texts were also adapted to the German-speaking context. Additional instructions were developed and supplemented. The test was administered using different randomization options to minimize learning effects. digiDEM-SCREEN was developed as a tablet and smartphone app. In the first focus group discussion, the developers identified and corrected the most significant criticism in the next version. Based on the iterative improvement process, only minor issues needed to be addressed after the final focus group discussion. The SUS score increased with each version (score of 72.5 for V1 vs 82.4 for V2), while the verbal feedback from end users also improved.ConclusionsThe development of digiDEM-SCREEN serves as an excellent example of the importance of involving experts and potential end users in the design and development process of health apps. Close collaboration with end users leads to products that not only meet current standards but also address the actual needs and expectations of users. This is also a crucial step toward promoting broader adoption of such digital tools. This research highlights the significance of a user-centered design approach, allowing content, text, and design to be optimally tailored to the needs of the target audience. From these findings, it can be concluded that future projects in the field of health apps would also benefit from a similar approach.

Dataset Information

Remote Cognitive Screening Of Healthy Older Adults for Primary Care With the MyCog Mobile App: Iterative Design and Usability Evaluation.

Background

Objective

Methods

Results

Conclusions

Publications

Remote Cognitive Screening Of Healthy Older Adults for Primary Care With the MyCog Mobile App: Iterative Design and Usability Evaluation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets