One Website to Gather them All: Usability Testing of the New German SKin Cancer INFOrmation (SKINFO) Website-A Mixed-methods Approach.
Ontology highlight
ABSTRACT:
SUBMITTER: Steeb T
PROVIDER: S-EPMC10366310 | biostudies-literature | 2023 Aug
REPOSITORIES: biostudies-literature
Publications
One Website to Gather them All: Usability Testing of the New German SKin Cancer INFOrmation (SKINFO) Website-A Mixed-methods Approach.
Steeb Theresa T Brütting Julia J Reinhardt Lydia L Hoffmann Julia J Weiler Nina N Heppt Markus V MV Erdmann Michael M Doppler Astrid A Weber Christiane C Schadendorf Dirk D Meier Friedegund F Berking Carola C
Journal of cancer education : the official journal of the American Association for Cancer Education 20221230 4
Skin cancer patients increasingly search the internet to acquire disease-related information. However, information on the internet may be misleading. Recently, SKINFO has been launched, a website exclusively created for German-speaking skin cancer patients providing information as well as additional resources of verified quality. Here, we describe the results of the first usability test of SKINFO using a mixed-methods approach. Ten adult patients with skin cancer were recruited for usability tes ...[more]
Similar Datasets
Project description:BackgroundMany individuals living with dementia want to live in their own homes for as long as possible. To do so, they frequently require assistance with activities of daily living, which is often provided by friends and relatives acting as informal care partners. In Canada, many informal care partners are currently overworked and overwhelmed. Although community-based dementia-inclusive resources are available to support them, care partners often struggle to find them. Dementia613.ca was created to make the process of finding community dementia-inclusive resources simpler and more straightforward by bringing them together in one eHealth website.ObjectiveThe objective of our study was to determine if dementia613.ca is meeting the goal of connecting care partners and persons living with dementia to dementia-inclusive resources in their community.MethodsA review and assessment of the website was conducted using 3 evaluation methods: web analytics, questionnaires, and task analysis. Google Analytics was used to collect data related to website use over a 9-month period. Data on site content and user characteristics were collected. Furthermore, 2 web-based self-administered questionnaires were developed: one intended for care partners and persons living with dementia, and the other intended for businesses and organizations interested in serving persons living with dementia. Both gathered data on user characteristics and included standard questions used in website evaluations. Responses were collected over a 6-month period. Scenarios, tasks, and questions were developed for the moderated, remote, and task-analysis sessions. These tasks and questions determined how effectively persons living with dementia and their care partners can use dementia613.ca. Overall, 5 sessions were held with persons experiencing moderate cognitive decline and with care partners of persons living with dementia.ResultsThis evaluation showed that the idea behind dementia613.ca is strong and appeals to persons living with dementia, their care partners, and the businesses and organizations serving this market. Participants indicated that it is a useful community resource that meets a previously unfulfilled need in the area, and highlighted the benefits of bringing community resources together on 1 website. In our questionnaire, >60% (19/29, 66%) of people living with dementia and their care partners and 70% (7/10) of businesses and organizations agreed that the website made it easier to find relevant dementia-inclusive resources. There is room for improvement; participants indicated that the navigation and search features could be further developed.ConclusionsWe believe that the dementia613.ca model could be used to inspire and guide the creation of dementia resource websites in other regions in Ontario and beyond. The framework behind it is generalizable and could be replicated to help care partners and persons living with dementia find local resources more easily.
| S-EPMC10160937 | biostudies-literature
Project description:Although patients express an interest in using mobile health (mHealth) interventions to manage their health and chronic conditions, many current mHealth interventions are difficult to use. Usability testing is critical for the success of novel mHealth interventions. Researchers recognize the utility of using qualitative and quantitative approaches for usability testing, but many mHealth researchers lack the awareness of integration approaches from advances in mixed methods research that can add value to mHealth technology. As efficient usability testing proceeds iteratively, we introduce a novel mixed methods design developed specifically for mHealth researchers. The iterative convergent mixed methods design involves simultaneous qualitative and quantitative data collection and analysis that continues cyclically through multiple rounds of mixed methods data collection and analysis until the mHealth technology under evaluation is found to work to the satisfaction of the researcher. In cyclical iterations, early development is more qualitatively driven but progressively becomes more quantitatively driven. Using this design, mHealth researchers can leverage mixed methods integration procedures in the research question, data collection, data analysis, interpretation, and dissemination dimensions. This study demonstrates how the iterative convergent mixed methods design provides a novel framework for generating unique insights into multifaceted phenomena impacting mHealth usability. Understanding these practices can help developers and researchers leverage the strengths of an integrated mixed methods design.
| S-EPMC6658163 | biostudies-literature
Project description:BackgroundThe prepandemic period saw a rise in web-based teaching. However, web-based tools for teaching the essential clinical skill of cognitive empathy (also known as perspective taking) remain limited. More of these tools are needed and require testing for ease of use and understanding by students.ObjectiveThis study aimed to evaluate the usability of the In Your Shoes web-based empathy training portal application for students using quantitative and qualitative methods.MethodsThis 3-phase formative usability study used a mixed methods design. In mid-2021, we conducted a remote observation of student participants interacting with our portal application. Their qualitative reflections were captured, followed by data analysis and iterative design refinements of the application. Overall, 8 third- and fourth-year nursing students from an undergraduate baccalaureate program at a Canadian university, in the western province of Manitoba, were included in this study. Participants in phases 1 and 2 were remotely observed by 3 research personnel while engaged in predefined tasks. In phase 3, two student participants were asked to use the application as they liked in their own environments, after which a video-recorded exit interview with a think-aloud process was conducted as participants responded to the System Usability Scale. We calculated descriptive statistics and performed content analysis to analyze the results.ResultsThis small study included 8 students with a range of technology skills. Usability themes were based on participants' comments on the application's appearance, content, navigation, and functionality. The biggest issues that participants experienced were with navigating the application's "tagging" features during video analysis and the length of educational material. We also observed variations in 2 participants' system usability scores in phase 3. This may be because of their different comfort levels with technology; however, additional research is required. We made iterative refinements to our prototype application (eg, added pop-up messages and provided a narrated video on the application's "tagging" function) based on participant feedback.ConclusionsWith increasing engagement in web-based teaching, technology has become an essential medium for receiving health care education. We developed a novel prototype application as a supplemental classroom tool to foster students' self-directed learning of empathy. This study provided direction for refinements to optimize the usability of and satisfaction with this innovative application. Qualitative feedback revealed favorable input toward learning perspective taking place on the web and helpful recommendations for improving user experiences with the application. We could not fully assess the application's key functions owing to the COVID-19 protocols. Thus, our next step is to obtain feedback from a larger sample of student users, whose experiences performing "live" video capture, annotation, and analysis will be more authentic and wholesome with the refined application. We discuss our findings in relation to research on nursing education, perspective taking, and adaptive e-learning.
| S-EPMC10131903 | biostudies-literature
Project description:BackgroundA Childhood Obesity Risk Estimation tool (SLOPE CORE) has been developed based on prediction models using routinely available maternity and early childhood data to estimate risk of childhood obesity at 4-5 years. This study aims to test the feasibility, acceptability and usability of SLOPE CORE within an enhanced health visiting (EHV) service in the UK, as one context in which this tool could be utilised.MethodsA mixed methods approach was used to assess feasibility of implementing SLOPE CORE. Health Visitors (HVs) were trained to use the tool, and in the processes for recruiting parents into the study. HVs were recruited using purposive sampling and parents by convenience sampling. HVs and parents were invited to take part in interviews or focus groups to explore their experiences of the tool. HVs were asked to complete a system usability scale (SUS) questionnaire.ResultsFive HVs and seven parents took part in the study. HVs found SLOPE CORE easy to use with a mean SUS of 84.4, (n = 4, range 70-97.5) indicating excellent usability. Five HVs and three parents took part in qualitative work. The tool was acceptable and useful for both parents and HVs. Parents expressed a desire to know their child's risk of future obesity, provided this was accompanied by additional information, or support to modify risk. HVs appreciated the health promotion opportunity that the tool presented and felt that it facilitated difficult conversations around weight, by providing 'clinical evidence' for risk, and placing the focus of the conversation onto the tool result, rather than their professional judgement. The main potential barriers to use of the tool included the need for internet access, and concerns around time needed to have a sensitive discussion around a conceptually difficult topic (risk).ConclusionsSLOPE CORE could potentially be useful in clinical practice. It may support targeting limited resources towards families most at risk of childhood obesity. Further research is needed to explore how the tool might be efficiently incorporated into practice, and to evaluate the impact of the tool, and any subsequent interventions, on preventing childhood obesity.
| S-EPMC10478378 | biostudies-literature
Project description:BackgroundReporting of medication errors is one of the essential mechanisms to identify risky health care systems and practices that lead to medication errors. Unreported medication errors are a real issue; one of the identified causes is a burdensome medication error reporting system. An anonymous and user-friendly mobile app for reporting medication errors could be an alternative method of reporting medication error in busy health care settings.ObjectiveThe objective of this paper is to report usability testing of the Medication Error Reporting App (MERA), a mobile app for reporting medication errors anonymously.MethodsQuantitative and qualitative methods were employed involving 45 different testers (pharmacists, doctors, and nurses) from a large tertiary hospital in Malaysia. Quantitative data was retrieved using task performance and rating of MERA and qualitative data were retrieved through focus group discussions. Three sessions, with 15 testers each session, were conducted from January to March 2018.ResultsThe majority of testers were pharmacists (23/45, 51%), female (35/45, 78%), and the mean age was 36 (SD 9) years. A total of 135 complete reports were successfully submitted by the testers (three reports per tester) and 79.2% (107/135) of the reports were correct. There was significant improvement in mean System Usability Scale scores in each session of the development process (P<.001) and mean time to report medication errors using the app was not significantly different between each session (P=.70) with an overall mean time of 6.7 (SD 2.4) minutes. Testers found the app easy to use, but doctors and nurses were unfamiliar with terms used especially medication process at which error occurred and type of error. Although, testers agreed the app can be used in the future for reporting, they were apprehensive about security, validation, and abuse of feedback featured in the app.ConclusionsMERA can be used to report medication errors easily by various health care personnel and it has the capacity to provide feedback on reporting. However, education on medication error reporting should be provided to doctors and nurses in Malaysia and the security of the app needs to be established to boost reporting by this method.
| S-EPMC6320434 | biostudies-literature
Project description:BackgroundA lack of information during an emergency visit leads to the experience of powerlessness for patients and their family members, who may also feel unprepared to cope with acute symptoms. The ever-changing nature and fast-paced workflow in the emergency department (ED) often affect how health care professionals can tailor information and communication to the needs of the patient.ObjectiveThis study aimed to evaluate the usability and experience of a newly developed information system. The system was developed together with patients and their family members to help provide the information needed in the ED.MethodsWe conducted a mixed methods study consisting of quantitative data obtained from the System Usability Scale questionnaire and qualitative interview data obtained from purposively selected participants included in the quantitative part of the study.ResultsA total of 106 patients and 14 family members (N=120) answered the questionnaire. A total of 10 patients and 3 family members participated in the interviews. Based on the System Usability Scale score, the information system was rated close to excellent, with a mean score of 83.6 (SD 12.8). Most of the participants found the information system easy to use and would like to use it again. The participants reported that the system helped them feel in control, and the information was useful. Simplifications were needed to improve the user experience for the older individuals.ConclusionsThis study demonstrates that the usability of the information system is rated close to excellent. It was perceived to be useful as it enabled understanding and predictability of the patient's trajectory in the ED. Areas for improvement include making the system more usable by older individuals. The study provides an example of how a technological solution can be used to diminish the information gap in an ED context.
| S-EPMC10918535 | biostudies-literature
Project description:The website Sexe Joves is a website on sexuality of the Department of Health of the Government of Catalonia (Spain). This study aims to understand the experiences and opinions of people aged 14 to 25 regarding this website, taking into account sex, gender identity, sexual orientation, socioeconomic status and location within Catalonia (urban, semiurban and rural areas). With the objective of improving the website and adpating the resources allocated to it, this study evaluates whether this population is familiar with it and uses it, as well as the website's usability and accessibility (digital equity), usefulness and the relevance of its content. A parallel convergent triangulation design is used: a qualitative study using a social constructivist perspective, and an observational, descriptive and cross-sectional quantitative study. We conduct a discourse analysis of participants and use an "ad hoc" questionnaire to collect quantitative data. A descriptive analysis of all variables is carried out. Affective-sexual education aimed at young people must stem from their participation and the whole range of sexual and gender diversity in order to reach the entire population equally. This analysis will contribute to the design of new strategies for the wesbite Sexe Joves, a public health resource, in order to improve affective-sexual education for young people.
| S-EPMC9778971 | biostudies-literature
Project description:BackgroundMusculoskeletal disorders negatively affect millions of patients worldwide, placing significant demand on health care systems. Digital technologies that improve clinical outcomes and efficiency across the care pathway are development priorities. We developed the musculoskeletal Digital Assessment Routing Tool (DART) to enable self-assessment and immediate direction to the right care.ObjectiveWe aimed to assess and resolve all serious DART usability issues to create a positive user experience and enhance system adoption before conducting randomized controlled trials for the integration of DART into musculoskeletal management pathways.MethodsAn iterative, convergent mixed methods design was used, with 22 adult participants assessing 50 different clinical presentations over 5 testing rounds across 4 DART iterations. Participants were recruited using purposive sampling, with quotas for age, habitual internet use, and English-language ability. Quantitative data collection was defined by the constructs within the International Organization for Standardization 9241-210-2019 standard, with user satisfaction measured by the System Usability Scale. Study end points were resolution of all grade 1 and 2 usability problems and a mean System Usability Scale score of ≥80 across a minimum of 3 user group sessions.ResultsAll participants (mean age 48.6, SD 15.2; range 20-77 years) completed the study. Every assessment resulted in a recommendation with no DART system errors and a mean completion time of 5.2 (SD 4.44, range 1-18) minutes. Usability problems were reduced from 12 to 0, with trust and intention to act improving during the study. The relationship between eHealth literacy and age, as explored with a scatter plot and calculation of the Pearson correlation coefficient, was performed for all participants (r=-0.2; 20/22, 91%) and repeated with a potential outlier removed (r=-0.23), with no meaningful relationships observed or found for either. The mean satisfaction for daily internet users was highest (19/22, 86%; mean 86.5, SD 4.48; 90% confidence level [CL] 1.78 or -1.78), with nonnative English speakers (6/22, 27%; mean 78.1, SD 4.60; 90% CL 3.79 or -3.79) and infrequent internet users scoring the lowest (3/22, 14%; mean 70.8, SD 5.44; 90% CL 9.17 or -9.17), although the CIs overlap. The mean score across all groups was 84.3 (SD 4.67), corresponding to an excellent system, with qualitative data from all participants confirming that DART was simple to use.ConclusionsAll serious DART usability issues were resolved, and a good level of satisfaction, trust, and willingness to act on the DART recommendation was demonstrated, thus allowing progression to randomized controlled trials that assess safety and effectiveness against usual care comparators. The iterative, convergent mixed methods design proved highly effective in fully evaluating DART from a user perspective and could provide a blueprint for other researchers of mobile health systems.International registered report identifier (irrid)RR2-10.2196/27205.
| S-EPMC9472040 | biostudies-literature
Project description:BackgroundMusculoskeletal conditions account for 16% of global disability, resulting in a negative effect on millions of patients and an increasing burden on health care utilization. Digital technologies that improve health care outcomes and efficiency are considered a priority; however, innovations are often inadequately developed and poorly adopted. Further, they are rarely tested with sufficient rigor in clinical trials-the gold standard for clinical proof of efficacy. We have developed a new musculoskeletal Digital Assessment Routing Tool (DART) that allows users to self-assess and be directed to the right care. DART requires usability testing in preparation for clinical trials.ObjectiveThis study will use the iterative convergent mixed methods design to assess and mitigate all serious usability issues to optimize user experience and adoption. Using this methodology, we will provide justifiable confidence to progress to full-scale randomized controlled trials when DART is integrated into clinical management pathways. This study protocol will provide a blueprint for future usability studies of mobile health solutions.MethodsWe will collect qualitative and quantitative data from 20-30 participants aged 18 years and older for 4 months. The exact number of participants recruited will be dependent on the number of iterative cycles required to reach the study end points. Building on previous internal testing and stakeholder involvement, quantitative data collection is defined by the constructs within the ISO 9241-210-2019 standard and the system usability scale, providing a usability score for DART. Guided by the participant responses to quantitative questioning, the researcher will focus the qualitative data collection on specific usability problems. These will then be graded to provide the rationale for further DART system improvements throughout the iterative cycles.ResultsThis study received approval from the Queen Mary University of London Ethics of Research Committee (QMREC2018/48/048) on June 4, 2020. At manuscript submission, study recruitment was on-going, with data collection to be completed and results published in 2021.ConclusionsThis study will provide evidence concerning mobile health DART system usability and acceptance determining system improvements required to support user adoption and minimize suboptimal system usability as a potential confounder within subsequent noninferiority clinical trials. Success should produce a safe effective system with excellent usability, facilitating quicker and easier patient access to appropriate care while reducing the burden on primary and secondary care musculoskeletal services. This deliberately rigorous approach to mobile health innovation could be used as a guide for other developers of similar apps.International registered report identifier (irrid)DERR1-10.2196/27205.
| S-EPMC8170557 | biostudies-literature
Project description:BackgroundIncreasingly, older adults and their informal caregivers are using the Internet to search for health-related information. There is a proliferation of health information online, but the quality of this information varies, often based on exaggerated or dramatic findings, and not easily comprehended by consumers. The McMaster Optimal Aging Portal (Portal) was developed to provide Internet users with high-quality evidence about aging and address some of these current limitations of health information posted online. The Portal includes content for health professionals coming from three best-in-class resources (MacPLUS, Health Evidence, and Health Systems Evidence) and four types of content specifically prepared for the general public (Evidence Summaries, Web Resource Ratings, Blog Posts, and Twitter messages).ObjectiveOur objectives were to share the findings of the usability evaluation of the Portal with particular focus on the content features for the general public and to inform designers of health information websites and online resources for older adults about key usability themes.MethodsData analysis included task performance during usability testing and qualitative content analyses of both the usability sessions and interviews to identify core themes.ResultsA total of 37 participants took part in 33 usability testing sessions and 21 focused interviews. Qualitative analysis revealed common themes regarding the Portal's strengths and challenges to usability. The strengths of the website were related to credibility, applicability, browsing function, design, and accessibility. The usability challenges included reluctance to register, process of registering, searching, terminology, and technical features.ConclusionsThe study reinforced the importance of including end users during the development of this unique, dynamic, evidence-based health information website. The feedback was applied to iteratively improve website usability. Our findings can be applied by designers of health-related websites.
| S-EPMC4880743 | biostudies-literature