Dataset Information

Face Validity of Four Preference-Weighted Quality-of-Life Measures in Residential Aged Care: A Think-Aloud Study.

ABSTRACT:

Objective

There is an increased use of preference-weighted quality-of-life measures in residential aged care to guide resource allocation decisions or for quality-of-care assessments. However, little is known about their face validity (i.e., how understandable, appropriate and relevant the measures are 'on their face' when respondents complete them). The aim of this study was to assess the face validity of four preference-weighted measures (i.e., EQ-5D-5L, EQ-HWB, ASCOT, QOL-ACC) in older people living in residential aged care.

Methods

Qualitative cognitive think-aloud interviews were conducted using both concurrent and retrospective think-aloud techniques. To reduce burden, each resident completed two measures, with the four measures randomised across participants. Audio recordings were transcribed and framework analysis was used for data analysis, based on an existing framework derived from the Tourangeau four-stage response model.

Results

In total, 24 interviews were conducted with residents living across three residential aged care facilities in Melbourne, Australia. Response issues were identified across all four measures, often related to comprehension and difficulty selecting a response level due to double-barrelled and ambiguous items that have different meanings in the residential aged care context. We also identified issues related to understanding instructions, non-adherence to the recall period, and noted positive responding that requires attention when interpreting the data.

Conclusions

Our findings provide further evidence on the appropriateness of existing measures, indicating numerous response issues that require further research to guide the selection process for research and practice.

SUBMITTER: Engel L

PROVIDER: S-EPMC10570159 | biostudies-literature | 2023 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Face Validity of Four Preference-Weighted Quality-of-Life Measures in Residential Aged Care: A Think-Aloud Study.

Engel Lidia L Kosowicz Leona L Bogatyreva Ekaterina E Batchelor Frances F Devlin Nancy N Dow Briony B Gilbert Andrew S AS Mulhern Brendan B Peasgood Tessa T Viney Rosalie R

The patient 20231006 6

<h4>Objective</h4>There is an increased use of preference-weighted quality-of-life measures in residential aged care to guide resource allocation decisions or for quality-of-care assessments. However, little is known about their face validity (i.e., how understandable, appropriate and relevant the measures are 'on their face' when respondents complete them). The aim of this study was to assess the face validity of four preference-weighted measures (i.e., EQ-5D-5L, EQ-HWB, ASCOT, QOL-ACC) in olde ...[more]

PMID: 37803217

Similar Datasets

Project description:BackgroundSituational judgment tests (SJTs) are used in health sciences education to measure examinee knowledge using case-based scenarios. Despite their popularity, there is a significant gap in the validity research on the response process that demonstrates how SJTs measure their intended constructs. A model of SJT response processes has been proposed in the literature by Robert Ployhart; however, few studies have explored and expanded the factors. The purpose of this study was to describe the factors involved in cognitive processes that examinees use as they respond to SJT items in a health professions education context.MethodsThirty participants-15 student pharmacists and 15 practicing pharmacists-completed a 12-item SJT designed to measure empathy. Each participant engaged in a think-aloud interview while completing the SJT, followed by a cognitive interview probing their decision-making processes. Interviews were transcribed and independently coded by three researchers to identify salient factors that contributed to response processes.ResultsThe findings suggest SJT response processes include all four stages (comprehension, retrieval, judgment, and response selection) as initially proposed by Ployhart. The study showed factors from other published research were present, including job-specific knowledge and experiences, emotional intelligence, and test-taking. The study also identified new factors not yet described, including identifying a task objective in the scenario, assumptions about the scenario, perceptions about the scenario, and the setting of the item.ConclusionsThis study provides additional SJT validity evidence by exploring participants' response processes through cognitive and think-aloud interviews. It also confirmed the four-stage model previously described by Ployhart and identified new factors that may influence SJT response processes. This study contributes to the literature with an expanded SJT response process model in a health professions education context and offers an approach to evaluate SJT response processes in the future.

Project description:ObjectivesTo determine the response process validity, feasibility of completion, acceptability and preferences for three patient-reported outcome measures that could be used in economic evaluation-the EQ-5D-5L, ICECAP-A and ICECAP-O-in people requiring kidney care.DesignParticipants were asked to 'think-aloud' while completing the EQ-5D-5L, ICECAP-A and ICECAP-O, followed by a semistructured interview. Five raters identified errors or struggles in completing the measures from the think-aloud component of the transcripts. Patient preferences for measures were extracted from the semistructured interview.SettingEligible patients were identified through a large UK secondary care renal centre.ParticipantsIn total, 30 participants were included in the study, consisting of patients attending renal outpatients for chronic kidney disease (n=18), with a functioning kidney transplant (n=6) and receiving haemodialysis (n=6).ResultsParticipants had few errors and struggles in completing the EQ-5D-5L (11% error rate, 3% struggle rate), ICECAP-A (2% error rate, 2% struggle rate) and ICECAP-O (4% error rate, 3% struggle rate). The main errors with the EQ-5D-5L were judgements that did not comply with the 'your health today' instruction. Comprehension errors were most prominent on ICECAP-O. Judgement errors were the only errors reported on ICECAP-A. Although the EQ-5D-5L had slightly more errors and struggles, it was the measure most preferred, with participants able to make a clearer link with EQ-5D-5L and their health condition.ConclusionsThe EQ-5D-5L, ICECAP-A and ICECAP-O are feasible for people requiring kidney care to complete and can be included in studies conducting economic evaluations of kidney care interventions. Further research is required to assess how health (eg, EQ-5D) and capability (eg, ICECAP) measures can be included in an economic evaluation simultaneously, as well as what ICECAP measure(s) to include when patient groups straddle the age ranges for ICECAP-A (18 years and older) and ICECAP-O (65 years and older).

Project description:BackgroundQuality of Life-Aged Care Consumers (QOL-ACC) is a new older-person-specific quality of life instrument designed for application in quality assessment and economic evaluation in aged care. The QOL-ACC was designed from its inception with older people receiving aged care services ensuring its strong content validity. Given that the QOL-ACC has already been validated in home care settings and a preference-weighted value set developed, we aimed to assess feasibility, construct validity and reliability of the QOL-ACC in residential aged care settings. METHODS: Individuals living in residential aged care facilities participated in an interviewer-facilitated survey. The survey included the QOL-ACC, QCE-ACC (quality of aged care experience measure) and two other preference-based quality of life instruments (ASCOT and EQ-5D-5L). Feasibility was assessed using missing data and ceiling/floor effects. Construct validity was assessed by exploring the relationship between the QOL-ACC and other instruments (convergent validity) and the QOL-ACC's ability to discriminate varying levels of self-rated health and quality of life. Internal consistency reliability was assessed using Cronbach's alpha (α).ResultsOf the 200 residents (mean age, 85 ± 7.7 years) who completed the survey, 60% were female and 69% were born in Australia. One in three participating residents self-rated their health as fair/poor. The QOL-ACC had no missing data but had small floor effects (0.5%) and acceptable ceiling effects (7.5%). It demonstrated moderate correlation with ASCOT (r = 0.51, p < 0.001) and EQ-5D-5L (r = 0.52, p < 0.001) and a stronger correlation with the QCE-ACC (r = 0.57, p < 0.001). Residents with poor self-rated health and quality of life had significantly lower scores on the QOL-ACC. The internal consistency reliability of the QOL-ACC and its dimensions was good (α = 0.70-0.77).ConclusionsThe QOL-ACC demonstrated good feasibility, construct validity and internal consistency reliability to assess aged care-related quality of life. Moderate correlations of the QOL-ACC and other instruments provide evidence of its construct validity and signifies that the QOL-ACC adds non-redundant and non-interchangeable information beyond the existing instruments. A stronger correlation with the QCE-ACC than other instruments may indicate that quality of life is more intimately connected with the care experience than either health- or social-related quality of life in residential aged care settings.

Project description:BackgroundSpending time in natural environments is beneficial for human health, but many older adults have limited or no access to natural environments. Virtual reality technology may be a means to facilitate nature experiences, and so, there is a need for knowledge on how to design virtual restorative natural environments for older adults.ObjectiveThe aim of this study was to identify, implement, and test older adults' preferences and ideas regarding virtual natural environments.MethodsA total of 14 older adults (mean age 75, SD 5.9 years) participated in an iterative process to design such an environment. We used think-aloud protocols and qualitative content analysis and established questionnaires that targeted usability, affective aspects, and side effects. These data guided the design decisions for incremental implementations of a prototype.ResultsThe participants' preferences included trueness to reality in terms of rendition and behavior; traces of human activity and natural processes that trigger the imagination and provide believability; the ability to roam, explore, and interact with the environment; and a familiar, relatable environment that evokes memories. The iterative design process resulted in a prototype featuring many of the participants' ideas and preferences, including a seated locomotion technique, animals, a boat ride, the discovery of a boat wreck, and apple picking. The questionnaire results indicated high perceived usability, interest, and enjoyment; low pressure and tension; moderate value and usefulness; and negligible side effects.ConclusionsWe suggested 3 principles for virtual natural environments for older adults: realness, interactivity, and relatedness. Virtual natural environments should also provide a diversity of content and activities to accommodate the heterogeneity in older adults' preferences. These results can contribute to a framework for designing virtual natural environments for older adults. However, these findings need to be tested and potentially revised in future studies.

Dataset Information

Face Validity of Four Preference-Weighted Quality-of-Life Measures in Residential Aged Care: A Think-Aloud Study.

Objective

Methods

Results

Conclusions

Publications

Face Validity of Four Preference-Weighted Quality-of-Life Measures in Residential Aged Care: A Think-Aloud Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets