Dataset Information

A comparison of brief versus explicit descriptors for verbal rating scales: interrupted time series design.

ABSTRACT:

Background

Verbal rating scales (VRS) are widely used in patient-reported outcome (PRO) measures. At our institution, patients complete an online instrument using VRSs with a five-point brief response scale to assess symptoms as part of routine follow-up after ambulatory cancer surgery. We received feedback from patients that the brief VRS descriptors such as "mild" or "somewhat" were vague. We added explicit descriptors to our VRSs, for instance, "Mild: I can generally ignore my pain" for pain severity or "Somewhat: I can do some things okay, but most of my daily activities are harder because of fatigue" for fatigue interference. We then compared responses before and after this change was made.

Methods

The symptoms investigated were pain, fatigue and nausea. Our hypothesis was that the explicit descriptors would reduce overall variance. We therefore compared the coefficient of variation of scores and tested the association between symptoms scores and known predictors thereof. We also compared time to completion between questionnaires with and without the additional descriptors.

Results

A total of 17,500 patients undergoing 21,497 operations were assigned questionnaires in the period before the descriptors were added; allowing for a short transition period, 1,417 patients having 1436 operations were assigned questionnaires with the additional descriptors. Symptom scores were about 10% lower with the additional descriptors but the coefficient of variation was slightly higher. Moreover, the only statistically significant difference between groups for association with a known predictor favored the item without the additional language for nausea severity (p = 0.004). Total completion time was longer when the instrument included the additional descriptors, particularly the first and second time that the questionnaire was completed.

Conclusions

Adding descriptors to a VRS of post-operative symptoms did not improve scale properties in patients undergoing ambulatory cancer surgery. We have removed the additional descriptors from our tool. We recommend further comparative psychometric research using data from PROs collected as part of routine clinical care.

SUBMITTER: Vickers AJ

PROVIDER: S-EPMC10498613 | biostudies-literature | 2023 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A comparison of brief versus explicit descriptors for verbal rating scales: interrupted time series design.

Vickers Andrew J AJ Assel Melissa M Hannon Michael M Desai Priyanka P Carlsson Sigrid V SV McCready Taylor T Cracchiolo Jennifer J Simon Brett B

Health and quality of life outcomes 20230913 1

<h4>Background</h4>Verbal rating scales (VRS) are widely used in patient-reported outcome (PRO) measures. At our institution, patients complete an online instrument using VRSs with a five-point brief response scale to assess symptoms as part of routine follow-up after ambulatory cancer surgery. We received feedback from patients that the brief VRS descriptors such as "mild" or "somewhat" were vague. We added explicit descriptors to our VRSs, for instance, "Mild: I can generally ignore my pain" f ...[more]

PMID: 37705045

Similar Datasets

Project description:BackgroundRating scales like the visual analogue scale, VAS, and the verbal rating scale, VRS, are often used for pain assessments both in clinical work and in research, despite the lack of a gold standard. Interchangeability of recorded pain intensity captured in the two scales has been discussed earlier, but not in conjunction with taking the influence of pain etiology into consideration.MethodsIn this cross-sectional study, patients with their pain classified according to its etiology (chronic/idiopathic, nociceptive and neuropathic pain) were consecutively recruited for self-assessment of their actual pain intensity using a continuous VAS, 0-100, and a discrete five-category VRS. The data were analyzed with a non-parametric statistical method, suitable for comparison of scales with different numbers of response alternatives.ResultsAn overlapping of the VAS records relative the VRS categories was seen in all pain groups. Cut-off positions for the VAS records related to the VRS categories were found lower in patients with nociceptive pain relative patients suffering from chronic/idiopathic and neuropathic pain. When comparing the VAS records transformed into an equidistant five-category scale with the VRS records, systematic disagreements between the scales was shown in all groups. Furthermore, in the test-retest a low percentage of the patients agreed to the same pain level on the VAS while the opposite hold for the VRS.ConclusionThe pain intensity assessments on VAS and VRS are in this study, not interchangeable due to overlap of pain records between the two scales, systematic disagreements when comparing the two scales and a low percentage intra-scale agreement. Furthermore, the lower VAS cut-off positions relative the VRS labels indicate different meaning of the rated pain intensity depending on pain etiology. It is also indicated that the scales have non-linear properties and that the two scales probably have different interpretation. Our findings are in favor of using the VRS in pain intensity assessments but if still the VAS is preferred, the VAS data should be analyzed as continuous using statistical methods suitable for ordinal data. Furthermore, our findings indicate a risk to over or under estimate the patient's perceived pain when interpreting condensed VAS data.

Project description:BackgroundDetailed intervention descriptions and robust evaluations that test intervention impact--and explore reasons for impact--are an essential part of progressing implementation science. Time series designs enable the impact and sustainability of intervention effects to be tested. When combined with time series designs, qualitative methods can provide insight into intervention effectiveness and help identify areas for improvement for future interventions. This paper describes the development, delivery, and evaluation of a tailored intervention designed to increase primary health care professionals' adoption of a national recommendation that women with mild to moderate postnatal depression (PND) are referred for psychological therapy as a first stage treatment.MethodsThree factors influencing referral for psychological treatment were targeted using three related intervention components: a tailored educational meeting, a tailored educational leaflet, and changes to an electronic system data template used by health professionals during consultations for PND. Evaluation comprised time series analysis of monthly audit data on percentage referral rates and monthly first prescription rates for anti-depressants. Interviews were conducted with a sample of health professionals to explore their perceptions of the intervention components and to identify possible factors influencing intervention effectiveness.ResultsThe intervention was associated with a significant, immediate, positive effect upon percentage referral rates for psychological treatments. This effect was not sustained over the ten month follow-on period. Monthly rates of anti-depressant prescriptions remained consistently high after the intervention. Qualitative interview findings suggest key messages received from the intervention concerned what appropriate antidepressant prescribing is, suggesting this to underlie the lack of impact upon prescribing rates. However, an understanding that psychological treatment can have long-term benefits was also cited. Barriers to referral identified before intervention were cited again after the intervention, suggesting the intervention had not successfully tackled the barriers targeted.ConclusionA time series design allowed the initial and sustained impact of our intervention to be tested. Combined with qualitative interviews, this provided insight into intervention effectiveness. Future research should test factors influencing intervention sustainability, and promote adoption of the targeted behavior and dis-adoption of competing behaviors where appropriate.

Dataset Information

A comparison of brief versus explicit descriptors for verbal rating scales: interrupted time series design.

Background

Methods

Results

Conclusions

Publications

A comparison of brief versus explicit descriptors for verbal rating scales: interrupted time series design.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets