Dataset Information

Harmonization of Four Delirium Instruments: Creating Crosswalks and the Delirium Item-Bank (DEL-IB).

ABSTRACT:

Objectives

Over 30 instruments are in current, active use for delirium identification. In a recent systematic review, we recommended 4 commonly used and well-validated instruments for clinical and research use. The goal of this study is to harmonize the four instruments on the same metric using modern methods in psychometrics.

Design

Secondary data analysis from 3 studies, and a simulation study based on the observed data.

Setting

Hospitalized (non-ICU) adults over 65 years old in the United States, Ireland, and Belgium.

Participants

The total sample comprised 600 participants, contributing 1,623 assessments.

Measurements

Confusion Assessment Method (long-form and short-form), Delirium Observation Screening Scale, Delirium Rating Scale-Revised-98 (DRS-R-98) (total and severity scores), and Memorial Delirium Assessment Scale.

Results

Using item response theory, we linked scores across instruments, placing all four instruments and their separate scorings on the same metric (the propensity to delirium). Kappa statistics comparing agreement in delirium identification among the instruments ranged from 0.37 to 0.75, with the highest agreement between the DRS-R-98 total score and MDAS. After linking scores, we created a harmonized item bank, called the Delirium Item Bank (DEL-IB), consisting of 50 items. The DEL-IB allowed us to create six crosswalks, to allow scores to be translated across instruments.

Conclusions

With our results, individual instrument scores can be directly compared to aid in clinical decision-making, and quantitatively combined in meta-analyses.

SUBMITTER: Helfand BKI

PROVIDER: S-EPMC8799777 | biostudies-literature | 2022 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Harmonization of Four Delirium Instruments: Creating Crosswalks and the Delirium Item-Bank (DEL-IB).

Helfand Benjamin K I BKI Detroyer Elke E Milisen Koen K Adamis Dimitrios D Metzger Eran D ED Boudreaux Edwin D ED Inouye Sharon K SK Jones Richard N RN

The American journal of geriatric psychiatry : official journal of the American Association for Geriatric Psychiatry 20210729 3

<h4>Objectives</h4>Over 30 instruments are in current, active use for delirium identification. In a recent systematic review, we recommended 4 commonly used and well-validated instruments for clinical and research use. The goal of this study is to harmonize the four instruments on the same metric using modern methods in psychometrics.<h4>Design</h4>Secondary data analysis from 3 studies, and a simulation study based on the observed data.<h4>Setting</h4>Hospitalized (non-ICU) adults over 65 years ...[more]

PMID: 34417086

Similar Datasets

Project description:BackgroundLimitations in physical functioning are a big concern especially for patients with chronic or musculoskeletal diseases. Therefore, physical functioning is often used as a core outcome of treatments. The generic patient-reported outcomes information system (PROMIS) physical function (PF) item bank has shown potential to measure PF with better precision, interpretability and lower respondent burden compared with traditional patient-reported outcome measures. This study provides an overview of the current evidence on the quality of the measurement properties of the translated Dutch-Flemish PROMIS-PF item bank and its subdomains, and their derived short forms and computer adaptive tests (CATs).MethodsPubMed was searched up to June 17th 2020 for validation studies of Dutch-Flemish PROMIS-PF in Dutch and Flemish adults. Quality assessment of the included studies was conducted using the COSMIN Risk of bias checklist. The COSMIN criteria for good measurement properties were used to judge the results of the studies, which were adjusted and added to where needed for this review, in the context of IRT instruments and item banks. The quality of evidence was summarized for each measurement property based on the Grading of Recommendation Assessment, Development, and Evaluation (GRADE) approach.ResultsEleven studies were included, evaluating the PROMIS-PF item bank, the Upper Extremity (UE) subdomain, and/or their derived short forms and CATs in different clinical populations. There is evidence for sufficient structural validity, measurement precision, construct validity, and cross-cultural validity of the Dutch-Flemish PROMIS-PF item bank. The upper extremity subdomain item bank shows high quality evidence for structural validity and measurement precision. Content validity of these item banks has not been thoroughly demonstrated in a Dutch-Flemish population. Furthermore, the derived instruments have far less robust evidence: there are fewer validation studies available and none examined their performance as stand-alone administered instruments.ConclusionsThe first studies into the Dutch-Flemish PROMIS-PF item bank and the UE subdomain show promising results, with especially high quality evidence for sufficient structural validity and measurement precision. However, more studies, and with higher methodological quality, are needed to study the instruments derived from these item banks. These studies should also evaluate content validity, reliability and responsiveness.

Project description:BackgroundAnterior cruciate ligament (ACL) registries do not all use the same patient-reported outcome measures, limiting comparisons and preventing pooling of data for meta-analysis. Our objective was to create a statistical crosswalk to convert cohort and registry mean Knee Injury and Osteoarthritis Outcome Scores (KOOS) to International Knee Documentation Committee-Subjective Knee Form (IKDC-SKF) scores and vice versa to allow these comparisons.MethodsData from 3 ACL registries were pooled (n = 14,412) and were separated into a training data set (70% of the sample) or a validation data set (30% of the sample). The KOOS and the IKDC-SKF scores were available prior to the operation and at 1, 2, and 5 or 6 years postoperatively. We used equipercentile equating methods to create crosswalks in the training data set and examined accuracy in the validation data set as well as bootstrapping analyses to assess the impact of sample size on accuracy.ResultsPreliminary analyses suggested that crosswalks could be attempted: large correlations between scores on the 2 measures (r = 0.84 to 0.94), unidimensionality of scores, and subpopulation invariance were deemed sufficient. When comparing actual scores with crosswalked scores in the validation data set, negligible bias was observed at the group level; however, individual score deviations were variable. The crosswalks are successful for the group level only.ConclusionsOur crosswalks successfully convert between the KOOS and the IKDC-SKF scores to allow for a group-level comparison of registry and other cohort data.Clinical relevanceThese crosswalks allow comparisons among different national ligament registries as well as other research cohorts and studies; they also allow data from different patient-reported outcome measures to be pooled for meta-analysis. These crosswalks have great potential to improve our understanding of recovery after ACL reconstruction and aid in our ongoing efforts to improve outcomes and patient satisfaction, as well as to allow the continued analysis of historical data.

Project description:BACKGROUND:Patient-reported outcome measures (PROMs) have become widely adopted in the care of patients with prostate cancer, but there is no validated crosswalk between two commonly used instruments, the Expanded Prostate Cancer Index Composite Short Form (EPIC-26) and the Memorial Sloan Kettering (MSK) instrument, which consists of the International Index of Erectile Function-6 (IIEF-6) questionnaire and the MSK radical prostatectomy urinary outcome scale. OBJECTIVE:To develop and validate bidirectional crosswalks between the sexual and urinary domains (single domain in MSK, separate incontinence and irritative/obstructive domains in EPIC-26) of the MSK and EPIC-26 instruments. DESIGN, SETTING, AND PARTICIPANTS:Radical prostatectomy (RP) patients completing instruments at MSK and Michigan Urological Surgery Improvement Collaborative (MUSIC) between January and May of 2017 were invited to enroll. Stratified random sampling (by institution, MSK urinary function score, and MSK erectile function score) was used to divide patient data into training and test sets. Models were developed to predict the domain score for each instrument using the other's item responses and domain scores. Performance was evaluated using capped root-mean-squared error and accuracy at established thresholds. RESULTS AND LIMITATIONS:We received 517 instruments at MSK and 1033 within MUSIC, which were assigned to training (825), post-RP test (412), and pre-RP test (313) sets. We found the crosswalks to have low error and high accuracy. Although the crosswalks are more accurate if responses to each item are known, it is possible to convert between instruments on the basis of a total domain score. CONCLUSIONS:The crosswalks are a valid way to convert between sexual and urinary domains of the MSK and EPIC-26 instruments. PATIENT SUMMARY:We developed and validated a set of formulas that allow conversion of sexual and urinary function scores between the Memorial Sloan Kettering and Expanded Prostate Cancer Index Composite Short Form patient-reported outcome questionnaires. These crosswalks allow seamless transition between the two questionnaires.

Project description:The development of new biological and chemical instruments for research and diagnostic applications is often slowed by the cost, specialization, and custom nature of these instruments. New instruments are built from components that are drawn from a host of different disciplines and not designed to integrate together, and once built, an instrument typically performs a limited number of tasks and cannot be easily adapted for new applications. Consequently, the process of inventing new instruments is very inefficient, especially for researchers or clinicians in resource-limited settings. To improve this situation, we propose that a family of standardized multidisciplinary components is needed, a set of "building blocks" that perform a wide array of different tasks and are designed to integrate together. Using these components, scientists, engineers, and clinicians would be able to build custom instruments for their own unique needs quickly and easily. In this work we present the foundation of this set of components, a system we call Multifluidic Evolutionary Components (MECs). "Multifluidic" conveys the wide range of fluid volumes MECs operate upon (from nanoliters to milliliters and beyond); "multi" also reflects the multiple disciplines supported by the system (not only fluidics but also electronics, optics, and mechanics). "Evolutionary" refers to the design principles that enable the library of MEC parts to easily grow and adapt to new applications. Each MEC "building block" performs a fundamental function that is commonly found in biological or chemical instruments, functions like valving, pumping, mixing, controlling, and sensing. Each MEC also has a unique symbol linked to a physical definition, which enables instruments to be designed rapidly and efficiently using schematics. As a proof-of-concept, we use MECs to build a variety of instruments, including a fluidic routing and mixing system capable of manipulating fluid volumes over five orders of magnitude, an acid-base titration instrument suitable for use in schools, and a bioreactor suitable for maintaining and analyzing cell cultures in research and diagnostic applications. These are the first of many instruments that can be built by researchers, clinicians, and students using the MEC system.

Project description:BackgroundData harmonization is a powerful method to equilibrate items in measures that evaluate the same underlying construct. There are multiple measures to evaluate dementia related behavioral symptoms. Pre-statistical harmonization of behavioral instruments in dementia research is the first step to develop a statistical crosswalk between measures. Studies that conduct pre-statistical harmonization of behavioral instruments rarely document their methods in a structured, reproducible manner. This is a crucial step which entails careful review, documentation and scrutiny of source data to ensure sufficient comparability between items prior to data pooling. Here, we document the pre-statistical harmonization of items measuring behavioral and psychological symptoms among people with dementia. We provide a box of recommended procedure for future studies.MethodsWe identified behavioral instruments that are used in clinical practice, a national survey, and randomized trials of dementia care interventions. We rigorously reviewed question content and scoring procedures to establish sufficient comparability across items as well as item quality prior to data pooling. Additionally, we standardized coding to Stata-readable format, which allowed us to automate approaches to identify potential cross-study differences in items and low-quality items. To ensure reasonable model fit for statistical co-calibration, we estimated two-parameter logistic Item Response Theory models within each of the eight studies.ResultsWe identified 59 items from 11 behavioral instruments across the eight datasets. We found considerable cross-study heterogeneity in administration and coding procedures for items that measure the same attribute. Discrepancies existed in terms of directionality and quantification of behavioral symptoms for even seemingly comparable items. We resolved item response heterogeneity, missingness and skewness, conditional dependency prior to estimation of item response theory models for statistical co-calibration. We used several rigorous data transformation procedures to address these issues, including re-coding and truncation.ConclusionsThis study highlights the importance of each aspect involved in the pre-statistical harmonization process of behavioral instruments. We provide guidelines and recommendations for how future research may detect and account for similar issues in pooling behavioral and related instruments.

Dataset Information

Harmonization of Four Delirium Instruments: Creating Crosswalks and the Delirium Item-Bank (DEL-IB).

Objectives

Design

Setting

Participants

Measurements

Results

Conclusions

Publications

Harmonization of Four Delirium Instruments: Creating Crosswalks and the Delirium Item-Bank (DEL-IB).

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets