Dataset Information

Assessment of inter-rater and intra-rater reliability of the Luna EMG robot as a tool for assessing upper limb proprioception in patients with stroke-a prospective observational study.

ABSTRACT:

Background

The aim of the study was to assess the inter-rater and intra-rater agreement of measurements performed with the Luna EMG (electromyography) multifunctional robot, a tool for evaluation of upper limb proprioception in individuals with stroke.

Methods

The study was conducted in a group of patients with chronic stroke. A total of 126 patients participated in the study, including 78 women and 48 men, on average aged nearly 60 years (mean = 59.9). Proprioception measurements were performed using the Luna EMG diagnostic and rehabilitation robot to assess the left and right upper limbs. The examinations were conducted by two raters, twice, two weeks apart. The results were compared between the raters and the examinations.

Results

High consistency of the measurements performed for the right and the left hand was reflected by the interclass correlation coefficients (0.996-0.998 and 0.994-0.999, respectively) and by Pearson's linear correlation which was very high (r = 1.00) in all the cases for the right and the left hand in both the inter-rater and intra-rater agreement analyses.

Conclusions

Measurements performed by the Luna EMG diagnostic and rehabilitation robot demonstrate high inter-rater and intra-rater agreement in the assessment of upper limb proprioception in patients with chronic stroke. The findings show that Luna EMG is a reliable tool enabling effective evaluation of upper limb proprioception post-stroke.

SUBMITTER: Leszczak J

PROVIDER: S-EPMC11366229 | biostudies-literature | 2024

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Assessment of inter-rater and intra-rater reliability of the Luna EMG robot as a tool for assessing upper limb proprioception in patients with stroke-a prospective observational study.

Leszczak Justyna J Pniak Bogumiła B Drużbicki Mariusz M Poświata Anna A Mikulski Michał M Roksela Anna A Guzik Agnieszka A

PeerJ 20240829

<h4>Background</h4>The aim of the study was to assess the inter-rater and intra-rater agreement of measurements performed with the Luna EMG (electromyography) multifunctional robot, a tool for evaluation of upper limb proprioception in individuals with stroke.<h4>Methods</h4>The study was conducted in a group of patients with chronic stroke. A total of 126 patients participated in the study, including 78 women and 48 men, on average aged nearly 60 years (mean = 59.9). Proprioception measurements ...[more]

PMID: 39221272

Similar Datasets

Project description:BackgroundCompensatory movements frequently emerge in the process of motor recovery after a stroke. Given their potential for unfavorable long-term effects, it is crucial to assess and document compensatory movements throughout rehabilitation. However, clinically applicable assessment tools are currently limited. Deep learning methods have shown promising potential for assessing movement quality and addressing this gap. A crucial prerequisite for developing an accurate measurement tool is ensuring reliability in assessing compensatory movements, which is essential for establishing a valid ground truth.ObjectiveThe study aimed to assess inter- and intra-rater reliability of occupational and physical therapists' visual assessment of compensatory movements based on video analysis.MethodsExperienced therapists evaluated video-recorded performances of a standardized drinking task through an online labeling system. The standardized drinking task was performed by seven individuals with mild to moderate upper limb motor impairments after a stroke. The therapists rated compensatory movements in predetermined body segments and movement phases using a slider with a continuous scale ranging from 0 (no compensation) to 100 (maximum compensation). The collected data were analyzed using a generalized-linear mixed effects model with zero-inflated beta regression to estimate variance components. Intraclass correlation coefficients (ICC) were calculated to assess inter- and intra-rater reliability.ResultsTwenty-two therapists participated in this study. Inter-rater reliability was good for the phases of reaching, drinking, and returning (ICC ≥ .0.75), and moderate for both phases of transporting. Intra-rater reliability was excellent for the drinking phase (ICC > 0.9) and moderate to good for the phases of reaching, transporting, and returning of our cohort. ICCs for smoothness and interjoint coordination were poor for both inter- and intra-rater reliability. The data analysis unveiled a wide range of credible intervals for the ICCs across all domains examined in this study.ConclusionsWhile this study shows promising inter- and intra-rater reliability for the drinking phases within our sample, the wide credible intervals raise the possibility that these results may have occurred by chance. Consequently, we cannot recommend the establishment of a ground truth for the automatic assessment of compensatory movements during a drinking task based on therapists' ratings alone.

Project description:ObjectivesTo investigate the intra- and inter-rater reliability of the total radiomics quality score (RQS) and the reproducibility of individual RQS items' score in a large multireader study.MethodsNine raters with different backgrounds were randomly assigned to three groups based on their proficiency with RQS utilization: Groups 1 and 2 represented the inter-rater reliability groups with or without prior training in RQS, respectively; group 3 represented the intra-rater reliability group. Thirty-three original research papers on radiomics were evaluated by raters of groups 1 and 2. Of the 33 papers, 17 were evaluated twice with an interval of 1 month by raters of group 3. Intraclass coefficient (ICC) for continuous variables, and Fleiss' and Cohen's kappa (k) statistics for categorical variables were used.ResultsThe inter-rater reliability was poor to moderate for total RQS (ICC 0.30-055, p < 0.001) and very low to good for item's reproducibility (k - 0.12 to 0.75) within groups 1 and 2 for both inexperienced and experienced raters. The intra-rater reliability for total RQS was moderate for the less experienced rater (ICC 0.522, p = 0.009), whereas experienced raters showed excellent intra-rater reliability (ICC 0.91-0.99, p < 0.001) between the first and second read. Intra-rater reliability on RQS items' score reproducibility was higher and most of the items had moderate to good intra-rater reliability (k - 0.40 to 1).ConclusionsReproducibility of the total RQS and the score of individual RQS items is low. There is a need for a robust and reproducible assessment method to assess the quality of radiomics research.Clinical relevance statementThere is a need for reproducible scoring systems to improve quality of radiomics research and consecutively close the translational gap between research and clinical implementation.Key points• Radiomics quality score has been widely used for the evaluation of radiomics studies. • Although the intra-rater reliability was moderate to excellent, intra- and inter-rater reliability of total score and point-by-point scores were low with radiomics quality score. • A robust, easy-to-use scoring system is needed for the evaluation of radiomics research.

Dataset Information

Assessment of inter-rater and intra-rater reliability of the Luna EMG robot as a tool for assessing upper limb proprioception in patients with stroke-a prospective observational study.

Background

Methods

Results

Conclusions

Publications

Assessment of inter-rater and intra-rater reliability of the Luna EMG robot as a tool for assessing upper limb proprioception in patients with stroke-a prospective observational study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets