Dataset Information

Suitability of the animated activity questionnaire for use as computer adaptive test: establishing the AAQ-CAT.

ABSTRACT:

Purpose

The animated activity questionnaire (AAQ) is a computer-based measure of activity limitations. To answer a question, patients choose the animation of a person performing an activity that matches their own level of limitation. The AAQ has not yet been tested for suitability to be applied as computer-adaptive test (CAT). Thus, the objective of this study was to develop and evaluate an AAQ-based CAT to facilitate the application of the AAQ in daily clinical care.

Methods

Patients (n = 1408) with hip/knee osteoarthritis from Brazil, Denmark, France, The Netherlands, Norway, Spain, and the UK responded to all 17 AAQ items. Assumptions of item-response theory (IRT) modelling were investigated. To establish item parameters for the CAT, a graded response model was estimated. To evaluate the performance of post-hoc simulated AAQ-based CATs, precision, test length, and construct validity (correlations with well-established measures of activity limitations) were evaluated.

Results

Unidimensionality (CFI = 0.95), measurement invariance (R²-change < 2%), and IRT item fit (S-X² p > .003) of the AAQ were supported. Performing simulated CATs, the mean test length was more than halved (≤ 8 items), while the range of precise measurement (standard error ≤ 0.3) was comparable to the full AAQ. The correlations between original AAQ scores and three AAQ-CAT versions were ≥ 0.95. Correlations of AAQ-CAT scores with patient-reported and performance measures of activity limitations were ≥ 0.60.

Conclusion

The almost non-verbal AAQ-CAT is an innovative and efficient tool in patients with hip/knee osteoarthritis from various countries, measuring activity limitations with lower respondent burden, but similar precision and construct validity compared to the full AAQ.

SUBMITTER: Liegl G

PROVIDER: S-EPMC10329068 | biostudies-literature | 2023 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Suitability of the animated activity questionnaire for use as computer adaptive test: establishing the AAQ-CAT.

Liegl Gregor G Roorda Leo D LD Terwee Caroline B CB Steultjens Martijn M Roos Ewa M EM Guillemin Francis F Benedetti Maria Grazia MG Dagfinrud Hanne H de Carvalho Bastone Alessandra A Peter Wilfred F WF

Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation 20230403 8

<h4>Purpose</h4>The animated activity questionnaire (AAQ) is a computer-based measure of activity limitations. To answer a question, patients choose the animation of a person performing an activity that matches their own level of limitation. The AAQ has not yet been tested for suitability to be applied as computer-adaptive test (CAT). Thus, the objective of this study was to develop and evaluate an AAQ-based CAT to facilitate the application of the AAQ in daily clinical care.<h4>Methods</h4>Pati ...[more]

PMID: 37010805

Similar Datasets

Project description:BackgroundThe Computer Adaptive Test version of the Community Reintegration of Injured Service Members measure (CRIS-CAT) consists of three scales measuring Extent of, Perceived Limitations in, and Satisfaction with community integration. The CRIS-CAT was developed using item response theory methods. The purposes of this study were to assess the reliability, concurrent, known group and predictive validity and respondent burden of the CRIS-CAT.The CRIS-CAT was developed using item response theory methods. The purposes of this study were to assess the reliability, concurrent, known group and predictive validity and respondent burden of the CRIS-CAT.MethodsThis was a three-part study that included a 1) a cross-sectional field study of 517 homeless, employed, and Operation Enduring Freedom/Operation Iraqi Freedom (OEF/OIF) Veterans; who completed all items in the CRIS item set, 2) a cohort study with one year follow-up study of 135 OEF/OIF Veterans, and 3) a 50-person study of CRIS-CAT administration. Conditional reliability of simulated CAT scores was calculated from the field study data, and concurrent validity and known group validity were examined using Pearson product correlations and ANOVAs. Data from the cohort were used to examine the ability of the CRIS-CAT to predict key one year outcomes. Data from the CRIS-CAT administration study were used to calculate ICC (2,1) minimum detectable change (MDC), and average number of items used during CAT administration.ResultsReliability scores for all scales were above 0.75, but decreased at both ends of the score continuum. CRIS-CAT scores were correlated with concurrent validity indicators and differed significantly between the three Veteran groups (P < .001). The odds of having any Emergency Room visits were reduced for Veterans with better CRIS-CAT scores (Extent, Perceived Satisfaction respectively: OR = 0.94, 0.93, 0.95; P < .05). CRIS-CAT scores were predictive of SF-12 physical and mental health related quality of life scores at the 1 year follow-up. Scales had ICCs >0.9. MDCs were 5.9, 6.2, and 3.6, respectively for Extent, Perceived and Satisfaction subscales. Number of items (mn, SD) administered at Visit 1 were 14.6 (3.8) 10.9 (2.7) and 10.4 (1.7) respectively for Extent, Perceived and Satisfaction subscales.ConclusionThe CRIS-CAT demonstrated sound measurement properties including reliability, construct, known group and predictive validity, and it was administered with minimal respondent burden. These findings support the use of this measure in assessing community reintegration.

Project description:BackgroundPeople with cerebral palsy experience limitations in performing activities of daily living. Rehabilitation practitioners seek valid instruments to measure changes in the performance of those activities. The Pediatric Evaluation of Disability Inventory Computer Adaptive Test (PEDI-CAT) is a new tool to assess functioning in children and youth with various health conditions. Its validity needs to be evaluated in a way that is consistent with the theoretical model on which it was based. We aimed to evaluate the fit of daily activity and mobility items and children with CP to the Rasch model and to compare the performance in daily activities and mobility of older children, adolescents, and young adults with CP based on manual function and gross motor function limitations.MethodsEighty-three parents of children and youth of 8-20 years old (mean age: 11.6) with different severity levels of cerebral palsy participated in this study. Ninety-one items of the PEDI-CAT Daily Activities and Mobility domains were analyzed through Rasch analysis to evaluate relative item difficulty and participant ability. Participants were described according to the Manual Ability (MACS) (level I: 21.7%; II: 32.5%; III: 24.1%; IV: 7.2% and V: 3.6%) and the Gross Motor Function (GMFCS) (level I: 37.3%; II: 26.5%; III: 6%; IV: 18.1%; and V: 7.2%) classification systems levels.ResultsOur data fit the Rasch Model. Parents had difficulty distinguishing some PEDI-CAT response categories. Participants from MACS and GMFCS levels IV and V showed lower ability to perform relatively more difficult items. There was a floor effect in both domains. Only 7.7% of the items presented differential item functioning when individuals with mild MACS and GMFCS levels (I, II) and moderate level (III) and individuals with moderate (III) and severe levels (IV, V) were compared.ConclusionsPEDI-CAT daily activities and mobility domains are valid to evaluate children, adolescents and youth with CP of different severities, but the addition of items to these domains is recommended in order to address their floor effect.

Dataset Information

Suitability of the animated activity questionnaire for use as computer adaptive test: establishing the AAQ-CAT.

Purpose

Methods

Results

Conclusion

Publications

Suitability of the animated activity questionnaire for use as computer adaptive test: establishing the AAQ-CAT.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets