Dataset Information

Content validation of a daily patient-reported outcome measure for assessing symptoms in patients with Small Intestinal Bacterial Overgrowth.

ABSTRACT:

Purpose

The aim of this study was to generate evidence supporting the development and content validity of a new PRO instrument, the Small Intestinal Bacterial Overgrowth (SIBO) Symptom Measure (SSM) daily diary. The SSM assesses symptom severity in SIBO patients, with the ultimate goal of providing a fit for purpose PRO for endpoint measurement.

Methods

Qualitative research included 35 SIBO patients in three study stages, using a hybrid concept elicitation (CE)/cognitive interview (CI) method with US patients, ≥ 18 years. Stage 1 included a literature review, clinician interviews, and initial CE interviews with SIBO patients to identify symptoms important to patients for inclusion in the SSM. Stage 2 included hybrid CE/CI to learn more about patients' SIBO experience and test the draft SSM. Finally, stage 3 used CIs to refine the instrument and test its content validity.

Results

In stage 1 (n = 8), 15 relevant concepts were identified, with items drafted based on the literature review/clinician interviews and elicitation work. Within stage 2 (n = 15), the SSM was refined to include 11 items; with wording revised for three items. Stage 3 (n = 12) confirmed the comprehensiveness of the SSM, as well as appropriateness of the item wording, recall period, and response scale. The resulting 11-item SSM assesses the severity of bloating, abdominal distention, abdominal discomfort, abdominal pain, flatulence, physical tiredness, nausea, diarrhea, constipation, appetite loss, and belching.

Conclusions

This study provides evidence supporting the content validity of the new PRO. Comprehensive patient input ensures that the SSM is a well-defined measure of SIBO, ready for psychometric validation studies.

SUBMITTER: Durgam N

PROVIDER: S-EPMC10393850 | biostudies-literature | 2023 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Content validation of a daily patient-reported outcome measure for assessing symptoms in patients with Small Intestinal Bacterial Overgrowth.

Durgam Neha N Dashputre Ankur A AA Moshkovich Olga O Rezaie Ali A Martinez Nicholas N Enayati Pedram P Stansbury James J Joseph George G

Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation 20230522 9

<h4>Purpose</h4>The aim of this study was to generate evidence supporting the development and content validity of a new PRO instrument, the Small Intestinal Bacterial Overgrowth (SIBO) Symptom Measure (SSM) daily diary. The SSM assesses symptom severity in SIBO patients, with the ultimate goal of providing a fit for purpose PRO for endpoint measurement.<h4>Methods</h4>Qualitative research included 35 SIBO patients in three study stages, using a hybrid concept elicitation (CE)/cognitive interview ...[more]

PMID: 37212941

Similar Datasets

Project description:BACKGROUND:Hyperhidrosis is estimated to affect ~ 4.8% of the US population, and most patients experience a negative psychological impact. Here, we describe development and psychometric evaluation of a patient-reported outcome (PRO) measure to assess severity of axillary hyperhidrosis in clinical trials that meets current U.S. regulatory standards to support product approvals. METHODS:Three rounds of hybrid concept-elicitation/cognitive-debriefing qualitative interviews were conducted in adults with clinician-diagnosed primary axillary hyperhidrosis, followed by similar interviews in children/adolescents. The draft measure included diary items for presence, severity, impact and bothersomeness (basis of the Axillary Sweating Daily Diary [ASDD]), exploratory weekly impact items, and a single-item Patient Global Impression of Change (PGIC). Phase 2 (adults only) and phase 3 (adults and children ≥9 years) clinical trial data were utilized to evaluate measurement properties of the resulting draft measure: floor/ceiling effects, nonresponse bias, test-retest reliability, construct validity, and responsiveness were assessed. The primary concept of interest was axillary sweating severity (ASDD Item 2); however, additional supportive concepts were explored to allow for development of a comprehensive hyperhidrosis measure. RESULTS:Twenty-nine patient interviews were conducted (N = 21 adult and N = 8 children/adolescents), resulting in the ASDD (4 items, patients ≥16y) and child-specific ASDD-C (2 items ≥9y to <16y), as well as 6 Weekly Impact items and the PGIC (patients ≥16y). No floor/ceiling effects or response biases were identified. Consistency between hypothesized and observed correlation patterns between ASDD/ASDD-C items and other efficacy measures supported construct validity. Intraclass correlation coefficients supported test-retest reliability (0.91-0.93; Item 2). Large effect sizes (- 2.2 to - 2.4) demonstrated that the ASDD/ASDD-C Item 2 could detect changes in hyperhidrosis severity, supporting the measure's responsiveness. Patients perceiving a moderate improvement in symptoms on the PGIC experienced an average 3.8-point improvement on ASDD axillary sweating severity (Item 2); thus, a 4-point responder threshold was defined as a clinically meaningful change. CONCLUSIONS:Qualitative and quantitative evidence support the reliability and validity of the ASDD/ASDD-C and its use in the clinical evaluation of axillary hyperhidrosis treatments. Further evaluation of this measure in future research studies is warranted to demonstrate consistent performance across different axillary hyperhidrosis populations and in different study contexts.

Project description:Abstract Background Patient perspectives on their disease are undoubtedly important in clinical trials and in practice. To date, no patient-reported outcome (PRO) questionnaire assessing symptoms of Clostridium difficile infection (CDI) has been developed following FDA guidance. The CDI-DaySyms™ is a new comprehensive measure of a broad range of local and systemic CDI symptoms (not only diarrhea) that patients report as meaningful. Objectives were to: finalize the CDI-DaySyms™ items (questions); assign them to domains (concepts); evaluate the questionnaire’s measurement properties; and define responder thresholds. Methods Blinded data from a sub-study of two Phase III trials (NCT01987895 and NCT01983683) in CDI patients were analyzed following FDA guidance for validating PRO questionnaires. Patients completed the CDI-DaySyms™ daily from Day 1 until end of treatment. Items were selected for inclusion in the final questionnaire based on a range of validation analyses, input from expert clinicians, and findings from prior qualitative patient research. Responder-threshold analyses used Day-3 data to align with the rapid symptom improvement generally seen in response to CDI therapy. Results Data were analyzed for 168 CDI patients (median age 60 years; 67.9% female; 81.5% mild/moderate, 11.3% severe, 7.1% unknown disease severity; 80.4% first CDI occurrence, 19.6% first recurrence). Three of the 13 items in the draft CDI-DaySyms™ were deleted; the remaining 10 were statistically assigned to three domains measuring different symptom concepts (Figure). Individual items in each domain correlated strongly with one another and their domain. Domain scores demonstrated acceptable consistency over time in stable patients, were sensitive to change, and correlated in expected directions with scores of other relevant symptom and disease-severity measures. Responder thresholds were defined as score changes of -1.00, -0.80, and -0.70 for Diarrhea, Abdominal, and Systemic/Other Symptoms domain scores, respectively. Conclusion The CDI-DaySyms™ is a valid measure of diarrhea and other CDI symptoms useful in assessing response to therapy. It has good measurement properties, and with only 10 items can be easily administered in clinical trials and in practice. Disclosures G. H. Talbot, Actelion: Board Member, Consultant and Scientific Advisor, Consulting fee; L. Kleinman, Actelion: Consultant, Research support;   E. W. Davies, Actelion: Employee, Salary; E. Hunsche, Actelion: Employee and Shareholder, Salary; L. Roberts, Actelion: Consultant, Research support; C. E. Nord, Actelion: Scientific Advisor, Consulting fee

Project description:BackgroundEndometriosis is a common gynecological disorder that causes inflammation and pelvic pain. Endometriosis-related pain is best captured with patient-reported outcome (PRO) measures, however, assessment of endometriosis-related pain in clinical trials has been difficult in the absence of a reliable and valid PRO instrument. We describe the development of the Endometriosis Pain Daily Diary (EPDD), an electronic PRO developed as a survey instrument to assess endometriosis-related pain and its impact on patients' lives.MethodsThe EPDD was initially developed on the basis of an existing Endometriosis Pain and Bleeding Diary, a targeted review of relevant literature, clinical expert interviews, and open-ended (concept elicitation) patient interviews in the United States (US) and Japan which captured patients' experience with endometriosis. Cognitive interviews of patients with endometriosis were conducted to evaluate patient comprehension of the EPDD items. A conceptual model of endometriosis was developed, and meetings with US and European regulatory authorities provided feedback for validating the EPDD in the context of clinical trials. Translatability assessments of the EPDD were conducted to confirm its appropriate interpretation and ease of completion across 17 languages.ResultsThe iterative development progressed through three versions of the instrument. The EPDDv1 included 18 items relating to dysmenorrhea/pelvic pain, dyspareunia and sexual activity, bleeding, hot flashes, daily activities, and use of rescue medication. The EPDDv2 was a larger 43-item survey tested in cognitive interviews and subsequently revised to yield the current 11-item EPDDv3, consisting of five core items relating to dysmenorrhea, non-menstrual pelvic pain, and dyspareunia, and six extension items relating to sexual activity, daily activities, and use of rescue medication.ConclusionsThe EPDD is a PRO for the evaluation of endometriosis-related pain and its associated impacts on patients' lives. The EPDD represents an important step in providing a PRO that is relevant to patients with endometriosis-related pain in the context of a clinical study setting (ie, fit-for-purpose), designed to evaluate pain associated with endometriosis, including regulatory agency support for its further exploration in clinical trials.

Project description:BackgroundSurgical success of cochlear implantation is usually measured through speech perception and quality of life questionnaires. Although these questionnaires cover a broad spectrum of domains, they do not evaluate the consciousness of wearing a cochlear implant (CI) and how this impacts the daily life of patients. To evaluate this concept we aimed to develop and validate a standardized patient reported outcome measure (PROM) for use in cochlear implant users.MethodsDevelopment and evaluation of the COchlear iMPlant AwareneSS (COMPASS) questionnaire was realized following the COSMIN guidelines in three phases: (1) item generation, (2) qualitative pilot study to ensure relevance, comprehensiveness, comprehensibility, and face validity, and (3) quantitative survey study for the assessment of reliability (test-retest) with 54 participants.ResultsNine domains of CI awareness were identified through literature research and interviews with experts and patients. These resulted in the formulation of 18 items which were tested with a pilot study, after which 3 items were deleted. The final 15-item COMPASS questionnaire proved to have good validity and satisfactory reliability. The intraclass correlation coefficient calculated for items with continuous variables ranged from 0.66 to 0.89 with seven out of eight items scoring above the acceptable level of 0.7. The Cohen's kappa calculated for items with nominal variables ranged from -0.4 to 0.78 with 11 (sub)items out of 15 scoring above fair to good agreement. Measurement error analysis for items with continuous variables showed a mean difference of -2.18 to 0.22. The calculated 95% limits of agreement for these items revealed no statistically significant difference between the two administered questionnaires. For items with nominal variables, the percentages of agreement calculated, ranged between 0 and 95%, and 83.3 and 96.6% for positive and negative agreement, respectively.ConclusionThe COMPASS questionnaire is a valid and reliable PROM for evaluating the cochlear implant awareness, and it can be easily used in routine clinical practice.

Project description:Abstract Background We have previously described the development and content validity of a new patient-reported outcome measure (PRO) to assess patients’ subjective experience of cognitive impairment in schizophrenia: The Patient-Reported Experience of Cognitive Impairment in Schizophrenia (PRECIS). Here we assess the psychometric properties of the PRECIS PRO in patients with schizophrenia and healthy age-matched controls with the aim of developing a revised version for use in clinical studies. Methods The PRECIS PRO is a 35-item scale comprising eight concept domains (memory, communication, control, planning, handling problems, attention, sharp thinking and overall experience), each with multiple individual items. PRECIS was administered to psychiatrically-healthy controls (single visit), and a subset of patients in a large, clinical trial assessing patients with schizophrenia on stable antipsychotic treatment (NCT02281773) at baseline and Weeks 6, 9 and 12. Analysis of the original 35-item PRECIS PRO included factor structure, factor analysis (FA), internal consistency, test-retest reliability and discriminant (known groups) validity testing. FA was performed on all pre-treatment scores in the patient group (n=410) and patients and controls combined (n=498). Individual items with less than adequate reliability or validity were then identified and eliminated or modified. Results Questionnaire responses were collected from 410 patients with schizophrenia and 88 healthy controls. The mean (standard deviation [SD]) total PRECIS score was significantly lower for healthy controls (1.39 [0.7]) compared with patients (2.06 [1.2]; p<0.0001), as was overall experience domain score (1.41 [0.7] vs 2.35 [1.3]; p<0.0001). For each domain of patient experience, PRECIS mean scores were also significantly lower for healthy controls compared to patients with schizophrenia. The mean differences between groups ranged from -0.94 (overall experience domain) to -0.52 (control domain; p<0.0001, all domains). Patients with schizophrenia had wider response distributions compared with controls, while the control group had marked “floor effects” across most items. Initial exploratory FA of the 35-item PRECIS PRO identified a 6-domain solution that accounted for 62% of total item variance, and Cronbach’s alpha (0.959) indicated an extremely high level of internal consistency. Following analyses of the 35-item PRECIS PRO, a total of 11 items were eliminated based on pre-specified criteria (poor loading onto identified factors, marked floor effects in patient groups or <50% test-retest reliability). Confirmatory FA of the revised 24-item PRECIS PRO identified 1 primary domain (attention) and 3 secondary additional domains (memory, executive function, communication). An additional domain included items related to patient distress or bother related to cognitive impairment. There was a high level of internal consistency both for the overall 24-item PRECIS PRO (Cronbach’s alpha= 0.942) and individual domains (Cronbach’s alphas: 0.743–0.873). Intraclass correlation coefficients were 0.78 for the overall 24-item PRECIS PRO and ranged from 0.49–0.74 for individual domains. Finally, discriminant validity testing confirmed there were significant differences between the patient group and the control group in each of the 5 domains of the revised 24-item PRECIS PRO (p<0.0001). Discussion This large validation study demonstrated that the revised 24-item PRECIS PRO is a valid and reliable PRO measure with good internal consistency, adequate test-retest reliability and strong discriminant validity. PRECIS may therefore serve to define key patient-based endpoints for use in future clinical studies. Funding Boehringer Ingelheim (1289.20)

Project description:BackgroundBreast cancer-related lymphedema (BRCL) is one of the most common causes of upper extremity (UE) lymphedema in developed nations and substantially impacts health-related quality of life. To advance our understanding of the epidemiology and treatment of BRCL, rigorously developed and validated patient-reported outcome measures (PROMs) are needed. This study aimed to demonstrate the iterative content validity of a modular UE lymphedema-specific PROM called the LYMPH-Q UE module.MethodsA multi-step iterative qualitative approach was used. Semi-structured interview data from in-depth qualitative interviews with adult women (18 years and older) with BCRL were used to develop the first set of the LYMPH-Q UE scales. The content validity of these scales was demonstrated with patient and clinician feedback. Over the course of cognitive debriefing interviews, additional concepts of lymphedema worry and impact on work were identified as missing from the LYMPH-Q UE module. Subsequently, two new qualitative studies (a focus group and in-depth concept elicitation interviews with patients) were conducted, and two new scales were developed to measure lymphedema worry and impact on work life and their content validity was demonstrated.ResultsQualitative data from in-depth and cognitive interviews with 15 (age 40-74 years) and 16 (age 38-74 years) women with BRCL, respectively, and feedback from 12 clinical experts, were used to develop and demonstrate the content validity of six LYMPH-Q UE scales measuring symptoms, function, appearance, psychological, information, and arm sleeve. Additionally, data from in-depth interviews with 12 (age 35-72 years) women with UE lymphedema and four focus groups (n = 16 women; age 35-74 years) was used to develop and assess the content validity of two new LYMPH-Q UE scales measuring lymphedema worry and impact on work life. The content validity of the previously established six scales was also demonstrated in these subsequent qualitative studies.ConclusionThe LYMPH-Q UE is a modular PROM developed using international guidelines for PROM development and can be used in clinical practice, research, and quality improvement to enhance patient-centered shared decision-making. This study's innovative and iterative approach to content validation demonstrates that the LYMPH-Q UE is a comprehensive measure that includes important concepts relevant to patients with UE lymphedema.

Dataset Information

Content validation of a daily patient-reported outcome measure for assessing symptoms in patients with Small Intestinal Bacterial Overgrowth.

Purpose

Methods

Results

Conclusions

Publications

Content validation of a daily patient-reported outcome measure for assessing symptoms in patients with Small Intestinal Bacterial Overgrowth.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets