Dataset Information

Rater agreement on gait assessment during neurologic examination of horses.

ABSTRACT:

Background

Reproducible and accurate recognition of presence and severity of ataxia in horses with neurologic disease is important when establishing a diagnosis, assessing response to treatment, and making recommendations that might influence rider safety or a decision for euthanasia.

Objectives

To determine the reproducibility and validity of the gait assessment component in the neurologic examination of horses.

Animals

Twenty-five horses referred to the Royal Veterinary College Equine Referral Hospital for neurological assessment (n = 15), purchased (without a history of gait abnormalities) for an unrelated study (n = 5), or donated because of perceived ataxia (n = 5).

Methods

Utilizing a prospective study design; a group of board-certified medicine (n = 2) and surgery (n = 2) clinicians and residents (n = 2) assessed components of the equine neurologic examination (live and video recorded) and assigned individual and overall neurologic gait deficit grades (0-4). Inter-rater agreement and assessment-reassessment reliability were quantified using intraclass correlation coefficients (ICC).

Results

The ICCs of the selected components of the neurologic examination ranged from 0 to 0.69. "Backing up" and "recognition of mistakes over obstacle" were the only components with an ICC > 0.6. Assessment-reassessment agreement was poor to fair. The agreement on gait grading was good overall (ICC = 0.74), but poor for grades ≤ 1 (ICC = 0.08) and fair for ataxia grades ≥ 2 (ICC = 0.43). Clinicians with prior knowledge of a possible gait abnormality were more likely to assign a grade higher than the median grade.

Conclusion and clinical importance

Clinicians should be aware of poor agreement even between skilled observers of equine gait abnormalities, especially when the clinical signs are subtle.

SUBMITTER: Olsen E

PROVIDER: S-EPMC4857973 | biostudies-literature | 2014 Mar-Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Rater agreement on gait assessment during neurologic examination of horses.

Olsen E E Dunkel B B Barker W H J WH Finding E J T EJ Perkins J D JD Witte T H TH Yates L J LJ Andersen P H PH Baiker K K Piercy R J RJ

Journal of veterinary internal medicine 20140224 2

<h4>Background</h4>Reproducible and accurate recognition of presence and severity of ataxia in horses with neurologic disease is important when establishing a diagnosis, assessing response to treatment, and making recommendations that might influence rider safety or a decision for euthanasia.<h4>Objectives</h4>To determine the reproducibility and validity of the gait assessment component in the neurologic examination of horses.<h4>Animals</h4>Twenty-five horses referred to the Royal Veterinary C ...[more]

PMID: 24612411

Similar Datasets

Project description:Reasons for performing studyLungeing is an important part of lameness examinations as the circular path may accentuate low-grade lameness. Movement asymmetries related to the circular path, to compensatory movements and to pain make the lameness evaluation complex. Scientific studies have shown high inter-rater variation when assessing lameness during straight line movement.ObjectivesThe aim was to estimate inter- and intra-rater agreement of equine veterinarians evaluating lameness from videos of sound and lame horses during lungeing and to investigate the influence of veterinarians' experience and the objective degree of movement asymmetry on rater agreement.Study designCross-sectional observational study.MethodsVideo recordings and quantitative gait analysis with inertial sensors were performed in 23 riding horses of various breeds. The horses were examined at trot on a straight line and during lungeing on soft or hard surfaces in both directions. One video sequence was recorded per condition and the horses were classified as forelimb lame, hindlimb lame or sound from objective straight line symmetry measurements. Equine veterinarians (n = 86), including 43 with >5 years of orthopaedic experience, participated in a web-based survey and were asked to identify the lamest limb on 60 videos, including 10 repeats. The agreements between (inter-rater) and within (intra-rater) veterinarians were analysed with κ statistics (Fleiss, Cohen).ResultsInter-rater agreement κ was 0.31 (0.38/0.25 for experienced/less experienced) and higher for forelimb (0.33) than for hindlimb lameness (0.11) or soundness (0.08) evaluation. Median intra-rater agreement κ was 0.57.ConclusionsInter-rater agreement was poor for less experienced raters, and for all raters when evaluating hindlimb lameness. Since identification of the lame limb/limbs is a prerequisite for successful diagnosis, treatment and recovery, the high inter-rater variation when evaluating lameness on the lunge is likely to influence the accuracy and repeatability of lameness examinations and, indirectly, the efficacy of treatment.

Project description:BackgroundLameness assessment in horses is still predominantly performed using subjective methods. Visual assessment is known to have moderate to good intra-rater agreement but relatively poor inter-rater agreement. Little is known about inter- and intra-rater agreement on the evaluation of back motion, for which no objective measurement technique in a clinical setting is available thus far.ObjectivesTo describe inter- and intra-rater agreement of visual evaluation of equine back mobility.Study designRater reliability study using a fully crossed design in which all horses are rated by all observers. This data is compared with objective gait analysis.MethodsSeventy equine professionals (veterinarians and physiotherapists) and veterinary students evaluated videos of 12 healthy horses at walk and trot on a hard, straight line. Nine parameters related to back mobility were scored: general mobility, thoracic, lumbar, lumbosacral flexion and extension and left and right thoracolumbar latero-flexion. All parameters were compared with simultaneously measured quantitative motion parameters. After 1 month, six randomly chosen horses were re-evaluated by 57 observers.ResultsFor each parameter inter- and intra-rater agreements were calculated using intra-class correlation coefficients. For all parameters, inter-rater agreement was very poor (<0.2). The mean intra-rater agreement of all observers and for all parameters was poor (~0.4) but varied between 0.0 and 0.96 for individual observers. There was no correlation between the visual subjective scoring and objective gait analysis measurements.Main limitationsHorses were scored from videos and by lack of any existing (semi-) quantitative system, a custom-made system had to be used.ConclusionsThe poor inter- and intra-rater agreements of visual scoring of mobility of the equine back and the disagreement between subjective and objective gait analysis data, demonstrate the need for the development and introduction of objective, quantitative and repeatable techniques to assess equine back motion.

Project description:ObjectiveSurgical site infection (SSI) is the most common nosocomial infection, in vascular surgery patients, who experience a high rate of readmission. Facilitating transition from hospital to outpatient care with digital image-based wound monitoring has the potential to detect and to enable treatment of SSI at an early stage. In this study, we evaluated whether smartphone digital images can supplant in-person evaluation of postoperative vascular surgery wounds.MethodsWe developed a wound assessment checklist using previously validated criteria. We recruited adults who underwent a vascular surgical procedure between 2014 and 2015, involving an incision of at least 3 cm, from a high-volume academic vascular surgery service. Vascular surgery care providers evaluated wounds in person using the assessment checklist; a different group of providers evaluated wounds by a smartphone digital image. Inter-rater agreement coefficients for wound characteristics and treatment plan were calculated within and between the in-person group and the digital image group; the sensitivity and specificity of digital images relative to in-person evaluation were determined.ResultsWe assessed a total of 80 wounds. Regardless of modality, inter-rater agreement was poor when wounds were evaluated for the presence of ecchymosis and redness; moderate for cellulitis; and high for the presence of a drain, necrosis, or dehiscence. As expected, the presence of drainage was more readily observed in person. Inter-rater agreement was high for both in-person and image-based assessment with respect to course of treatment, with near-perfect agreement for treatments ranging from antibiotics to surgical débridement to hospital readmission. No difference in agreement emerged when raters evaluated poor-quality compared with high-quality images. For most parameters, specificity was higher than sensitivity for image-based compared with "gold standard" in-person assessment.ConclusionsUsing smartphone digital images is a valid method for evaluating postoperative vascular surgery wounds and is comparable to in-person evaluation with regard to most wound characteristics. The inter-rater reliability for determining treatment recommendations was universally high. Remote wound monitoring and assessment may play an integral role in future transitional care models to decrease readmission for SSI in vascular or other surgical patients. These findings will inform smartphone implementation in the clinical care setting as wound images transition from informal clinical communication to becoming part of the care standard.

Project description:BackgroundQuantitative gait analysis offers objective information to support clinical decision-making during lameness workups including advantages in terms of documentation, communication, education, and avoidance of expectation bias. Nevertheless, hardly any data exist comparing outcome of subjective scoring with the output of objective gait analysis systems.ObjectivesTo investigate between- and within-veterinarian agreement on primary lame limb and lameness grade, and to determine relationships between subjective lameness grade and quantitative data, focusing on differences between (1) veterinarians, (2) live vs video assessment, (3) baseline assessment vs assessment following diagnostic analgesia.Study designClinical observational study.MethodsKinematic data were compared to subjective lameness assessment by clinicians with ≥8 years of orthopaedic experience. Subjective assessments and kinematic data for baseline trot-ups and response to 48 diagnostic analgesia interventions in 23 cases were included. Between and within-veterinarian agreement was investigated using Cohen's Kappa (κ). Asymmetry parameters for kinematic data ('forelimb lame pattern', 'hindlimb lame pattern', 'overall symmetry', 'vector sum head', 'pelvic sum') were determined, and used as outcome variables in mixed models; explanatory variables were subjective lameness grade and its interaction with (1) veterinarian, (2) live or video evaluation and (3) baseline or diagnostic analgesia assessment.ResultsAgreement on lame limb between live and video assessment was 'good' between and within veterinarians (median κ = 0.64 and κ = 0.53). There was a positive correlation between subjective scoring and measured asymmetry. The relationship between lameness grade and objective asymmetry differed slightly between (1) veterinarians (for all combined parameters, p-values between P < .001 and 0.04), (2) between live and video assessments ('forelimb lame pattern', 'overall symmetry', both P ≤ .001), and (3) between baseline and diagnostic analgesia assessment (all combined parameters, between P < .001 and .007).Main limitationsLimited number of veterinarians (n = 4) and cases (n = 23), only straight-line soft surface data, different number of subjective assessments live vs from video.ConclusionsOverall, between- and within-veterinarian agreement on lame limb was 'good', whereas agreement on lameness grade was 'acceptable' to 'poor'. Quantitative data and subjective assessments correlated well, with minor though significant differences in the number of millimetres, equivalent to one lameness grade between veterinarians, and between assessment conditions. Differences between baseline assessment vs assessment following diagnostic analgesia suggest that addition of objective data can be beneficial to reduce expectation bias. The small differences between live and video assessments support the use of high-quality videos for documentation, communication, and education, thus, complementing objective gait analysis data.

Dataset Information

Rater agreement on gait assessment during neurologic examination of horses.

Background

Objectives

Animals

Methods

Results

Conclusion and clinical importance

Publications

Rater agreement on gait assessment during neurologic examination of horses.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets