Dataset Information

Accuracy, Validity, and Reliability of an Electronic Visual Analog Scale for Pain on a Touch Screen Tablet in Healthy Older Adults: A Clinical Trial.

ABSTRACT:

Background

New technology for clinical data collection is rapidly evolving and may be useful for both researchers and clinicians; however, this new technology has not been tested for accuracy, reliability, or validity.

Objective

This study aims to test the accuracy of visual analog scale (VAS) for pain on a newly designed application on the iPad (iPadVAS) and measure the reliability and validity of iPadVAS compared to a paper copy (paperVAS).

Methods

Accuracy was determined by physically measuring an iPad scale on screen and comparing it to the results from the program, with a researcher collecting 101 data points. A total of 22 healthy community dwelling older adults were then recruited to test reliability and validity. Each participant completed 8 VAS (4 using each tool) in a randomized order. Reliability was measured using interclass correlation coefficient (ICC) and validity measured using Bland-Altman graphs and correlations.

Results

Of the measurements for accuracy, 64 results were identical, 2 results were manually measured as being 1 mm higher than the program, and 35 as 1 mm lower. Reliability for the iPadVAS was excellent with individual ICC 0.90 (95% CI 0.82-0.95) and averaged ICC 0.97 (95% CI 0.95-1.0) observed. Linear regression demonstrated a strong relationship with a small negative bias towards the iPad (-2.6, SD 5.0) with limits of agreement from -12.4 to 7.1.

Conclusions

The iPadVAS provides a convenient, user-friendly, and efficient way of collecting data from participants in measuring their current pain levels. It has potential use in documentation management and may encourage participatory healthcare.

Trial registration

Australia New Zealand Clinical Trials Registry (ANZCTR): 367297; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=367297&isReview=true (Archived by Webcite at http://www.webcitation.org/6d9xYoUbD).

SUBMITTER: Bird ML

PROVIDER: S-EPMC4731681 | biostudies-literature | 2016 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Accuracy, Validity, and Reliability of an Electronic Visual Analog Scale for Pain on a Touch Screen Tablet in Healthy Older Adults: A Clinical Trial.

Bird Marie-Louise ML Callisaya Michele L ML Cannell John J Gibbons Timothy T Smith Stuart T ST Ahuja Kiran Dk KD

Interactive journal of medical research 20160114 1

<h4>Background</h4>New technology for clinical data collection is rapidly evolving and may be useful for both researchers and clinicians; however, this new technology has not been tested for accuracy, reliability, or validity.<h4>Objective</h4>This study aims to test the accuracy of visual analog scale (VAS) for pain on a newly designed application on the iPad (iPadVAS) and measure the reliability and validity of iPadVAS compared to a paper copy (paperVAS).<h4>Methods</h4>Accuracy was determined ...[more]

PMID: 26769149

Similar Datasets

Project description:BackgroundEarly detection of cognitive impairment is among the top research priorities aimed at reducing the global burden of dementia. Currently used screening tools have high sensitivity but lack specificity at their original cut-off, while decreasing the cut-off was repeatedly shown to improve specificity, but at the cost of lower sensitivity. In 2012, a new screening tool was introduced that aims to overcome these limitations - the Quick mild cognitive impairment screen (Qmci). The original English Qmci has been rigorously validated and demonstrated high diagnostic accuracy with both good sensitivity and specificity. We aimed to determine the optimal cut-off value for the German Qmci, and evaluate its diagnostic accuracy, reliability (internal consistency) and construct validity.MethodsWe retrospectively analyzed data from healthy older adults (HOA; n = 43) and individuals who have a clinical diagnosis of 'mild neurocognitive disorder' (mNCD; n = 37) with a biomarker supported characterization of the etiology of mNCD of three studies of the 'Brain-IT' project. Using Youden's Index, we calculated the optimal cut-off score to distinguish between HOA and mNCD. Receiver operating characteristic (ROC) curve analysis was performed to evaluate diagnostic accuracy based on the area under the curve (AUC). Sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were calculated. Reliability (internal consistency) was analyzed by calculating Cronbach's α. Construct validity was assessed by analyzing convergent validity between Qmci-G subdomain scores and reference assessments measuring the same neurocognitive domain.ResultsThe optimal cut-off score for the Qmci-G was ≤ 67 (AUC = 0.96). This provided a sensitivity of 91.9% and a specificity of 90.7%. The PPV and NPV were 89.5% and 92.9%, respectively. Cronbach's α of the Qmci-G was 0.71 (CI95% [0.65 to 0.78]). The Qmci-G demonstrated good construct validity for subtests measuring learning and memory. Subtests that measure executive functioning and/or visuo-spatial skills showed mixed findings and/or did not correlate as strongly as expected with reference assessments.ConclusionOur findings corroborate the existing evidence of the Qmci's good diagnostic accuracy, reliability, and construct validity. Additionally, the Qmci shows potential in resolving the limitations of commonly used screening tools, such as the Montreal Cognitive Assessment. To verify these findings for the Qmci-G, testing in clinical environments and/or primary health care and direct comparisons with standard screening tools utilized in these settings are warranted.

Project description:BackgroundWe developed five tablet-based tasks (applications) to measure multiple components of manual dexterity.Aimto test reliability and validity of tablet-based dexterity measures in healthy participants.MethodsTasks included: (1) Finger recognition to assess mental rotation capacity. The subject taps with the finger indicated on a virtual hand in three orientations (reaction time, correct trials). (2) Rhythm tapping to evaluate timing of finger movements performed with, and subsequently without, an auditory cue (inter-stimulus interval). (3) Multi-finger tapping to assess independent finger movements (reaction time, correct trials, unwanted finger movements). (4) Sequence tapping to assess production and memorization of visually cued finger sequences (successful taps). (5) Line-tracking to assess movement speed and accuracy while tracking an unpredictably moving line on the screen with the fingertip (duration, error). To study inter-rater reliability, 34 healthy subjects (mean age 35 years) performed the tablet tasks twice with two raters. Relative reliability (Intra-class correlation, ICC) and absolute reliability (Standard error of measurement, SEM) were established. Task validity was evaluated in 54 healthy subjects (mean age 49 years, range: 20-78 years) by correlating tablet measures with age, clinical dexterity assessments (time taken to pick-up objects in Box and Block Test, BBT and Moberg Pick Up Test, MPUT) and with measures obtained using a finger force-sensor device.ResultsMost timing measures showed excellent reliability. Poor to excellent reliability was found for correct trials across tasks, and reliability was poor for unwanted movements. Inter-session learning occurred in some measures. Age correlated with slower and more variable reaction times in finger recognition, less correct trials in multi-finger tapping, and slower line-tracking. Reaction times correlated with those obtained using a finger force-sensor device. No significant correlations between tablet measures and BBT or MPUT were found. Inter-task correlation among tablet-derived measures was weak.ConclusionsMost tablet-based dexterity measures showed good-to-excellent reliability (ICC ≥ 0.60) except for unwanted movements during multi-finger tapping. Age-related decline in performance and association with finger force-sensor measures support validity of tablet measures. Tablet-based components of dexterity complement conventional clinical dexterity assessments. Future work is required to establish measurement properties in patients with neurological and psychiatric disorders.

Project description:Low back pain is associated with changes in trunk muscle structure and function and motor control impairments. Voluntary force modulation (FM) of trunk muscles is a unique and under-investigated motor control characteristic. One of the reasons for this paucity of evidence is the lack of exploration and publication on the reliability and validity of trunk FM protocols. The purpose of this study was to determine the within- and between-day test-retest reliability and construct validity for trunk extensor muscle FM. Twenty-nine healthy participants were tested under three FM conditions with different modulation rates. Testing was performed on a custom-built apparatus designed for trunk isometric force testing. FM accuracy relative to a fluctuating target force (20-50%MVF) was quantified using the root mean square error of the participant's generated force relative to the target force. Reliability and precision of measurement were assessed using the Intraclass Correlation Coefficient (ICC), standard error of measurement (SEM), minimal detectable difference (MDD95), and Bland-Altman plots. In a subset of participants, we collected surface electromyography of trunk and hip muscles. We used non-negative matrix factorization (NNMF) to identify the underlying motor control strategies. Within- and between-day test-retest reliability was excellent for FM accuracy across the three conditions (ICC range: 0.865 to 0.979). SEM values ranged 0.9-1.8 Newtons(N) and MDD95 ranged from 2.4-4.9N. Conditions with faster rates of FM had higher ICCs. NNMF analysis revealed two muscle synergies that were consistent across participants and conditions. These synergies demonstrate that the muscles primarily involved in this FM task were indeed the trunk extensor muscles. This protocol can consistently measure FM accuracy within and between testing sessions. Trunk extensor FM, as measured by this protocol, is not specific to any trunk muscle group but is the result of modulation by all the trunk extensor muscles.

Project description:Visual assessments are used for evaluating the quality of food products, such as fresh-cut lettuce packaged in bags with modified atmosphere. We have compared the accuracy and the reliability of visual evaluations of decay on fresh-cut lettuce performed with experienced and inexperienced raters. In addition, we have analyzed decay data from over 4.5 thousand bags to determine the optimum timing for evaluations to detect differences among accessions. Lin's concordance coefficient (ρc) that takes into consideration both the closeness of the data and the conformance to the identity line showed high repeatability (intra-rater reliability, ρc = 0.97), reproducibility (inter-rater reliability, ρc = 0.92), and accuracy (ρc = 0.96) for experienced raters. Inexperienced raters did not perform as well and their ratings showed decreased repeatability (ρc = 0.93), but even larger reduction in reproducibility (ρc = 0.80) and accuracy (ρc = 0.90). We have detected that 5.3% of ratings were outside of the 95% limits of agreement. These under- or overestimates were predominantly found for bags with intermediate levels of decay, which corresponds to the middle of the rating scale. This occurs because intermediate amounts of decay are more difficult to discriminate than extremes. The frequencies of aberrant ratings for experienced raters ranged from 0.6% to 4.4% (mean = 2.1%), for inexperienced raters the frequencies were substantially higher, ranging from 6.1% to 15.6% (mean = 9.4%). Therefore, we recommend that new raters receive training that includes practical examples in this range of decay, use of standard area diagrams, and continuing interaction with experienced raters (consultation during actual rating). Very high agreement among experienced raters indicate that visual ratings can be successfully used for evaluations of decay, until a more objective, rapid, and affordable method is developed. We recommend evaluating samples at multiple time points until 42 days after processing (about 80% decay on average) and then combining these individual ratings into the area under the decay progress stairs (AUDePS) score. Applying this approach, experienced evaluators can accurately detect difference among lettuce accessions and identify lettuce cultivars with reduced decay.

Dataset Information

Accuracy, Validity, and Reliability of an Electronic Visual Analog Scale for Pain on a Touch Screen Tablet in Healthy Older Adults: A Clinical Trial.

Background

Objective

Methods

Results

Conclusions

Trial registration

Publications

Accuracy, Validity, and Reliability of an Electronic Visual Analog Scale for Pain on a Touch Screen Tablet in Healthy Older Adults: A Clinical Trial.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets