Knowledge of Evidence-Based Services Questionnaire: Development and Validation of a Short Form.
Ontology highlight
ABSTRACT:
SUBMITTER: Lawson GM
PROVIDER: S-EPMC7260077 | biostudies-literature | 2020 Jul
REPOSITORIES: biostudies-literature
Publications
Knowledge of Evidence-Based Services Questionnaire: Development and Validation of a Short Form.
Lawson Gwendolyn M GM Moore Tyler M TM Okamura Kelsie H KH Becker-Haimes Emily M EM Beidas Rinad S RS
Administration and policy in mental health 20200701 4
The Knowledge of Evidence-Based Services Questionnaire (KEBSQ) is an objective measure of therapist knowledge of practices derived from the evidence base for the treatment of youth psychopathology. However, the length of this measure (i.e., 40 items) and respondent demands associated with each item makes it burdensome for researchers and clinicians. This study developed and validated a Short Form of the KEBSQ using Item Response Theory measurement models. The Short Form consists of 17 items and ...[more]
Similar Datasets
Project description:BackgroundSuboptimal health status (SHS) is a reversible, borderline state between optimal health and disease. Although this condition's definition is widely understood, related questionnaires must be developed to identify individuals with SHS in various populations relative to predictive, preventive, and personalized medicine (PPPM/3PM). This study presents a short-form suboptimal health status questionnaire (SHSQ-SF) that appears to possess sufficient reliability and validity to assess SHS in large-scale populations.MethodsA total of 6183 participants enrolled from Southern China constituted a training set, while 4113 participants from Northern China constituted an external validation set. The SHSQ-SF includes nine key items from the Suboptimal Health Status Questionnaire-25 (SHSQ-25), an instrument that has been applied to Africans, Asians, and Caucasians. Item analysis and reliability and validity tests were carried out to validate the SHSQ-SF. The receiver operating characteristic (ROC) curve was used to identify an optimal cutoff value for SHS diagnosis, by which the area under the curve (AUC) and 95% confidence interval (CI) were determined.ResultsCronbach's α coefficient for the training dataset was 0.902; the split-half reliability was 0.863. The Kaiser-Meyer-Olkin (KMO) value was 0.880, and Bartlett's test of sphericity was significant (χ2 = 32,929.680, p < 0.05). Both Kaiser's criteria (eigenvalues > 1) and the scree plot revealed one factor explaining 57.008% of the total variance. Standardized factor loadings for the confirmatory factor analysis (CFA) indices ranged between 0.58 and 0.74, with χ2/dƒ = 4.972, GFI = 0.996, CFI = 0.996, RFI = 0.989, and RMSEA = 0.031. The AUC was equal to 0.985 (95% CI: 0.983-0.988) for the training dataset. A cutoff value (≥ 11) was then identified for SHS diagnosis. The SHSQ-SF showed good discriminatory power for the external validation dataset (AUC = 0.975, 95% CI: 0.971-0.979) with a sensitivity of 96.2% and a specificity of 87.4%.ConclusionsWe developed a short form of the SHS questionnaire that demonstrated sound reliability and validity when assessing SHS in Chinese residents. From a PPPM/3PM perspective, the SHSQ-SF is recommended for the rapid screening of individuals with SHS in large-scale populations.Supplementary informationThe online version contains supplementary material available at 10.1007/s13167-023-00339-z.
| S-EPMC10713892 | biostudies-literature
Project description:AimsTo develop and validate a short form of the 54-item Diabetes Medication System Rating Questionnaire that maintains the domains and performance characteristics of the long-form questionnaire.MethodsData from the Diabetes Medication System Rating Questionnaire validation study were analysed to select items representing the nine scales (convenience, negative events, interference, self-monitoring of blood glucose burden, efficacy, social burden, psychological well-being, treatment satisfaction and treatment preference). The resulting 20-item Diabetes Medication System Rating Questionnaire Short-Form was administered online, with validated criterion measures of treatment satisfaction and medication adherence, with a retest within 2 weeks. Participants were US adults (N = 413) with Type 2 diabetes using oral agents alone; insulin by syringe and/or pen with or without oral agents; or glucagon-like peptide-1 agents. Most participants (82%) completed the retest.ResultsThe median inter-item agreement of scales was 0.76 and the total composite (mean of all items except treatment preference) was 0.88. The median test-retest reliability of scales was 0.86, and of the total composite was 0.95. All statistically significant correlations between Diabetes Medication System Rating Questionnaire Short-Form scales and criterion measures of treatment satisfaction and adherence were in the expected direction. The median correlation of the Diabetes Medication System Rating Questionnaire Short-Form with corresponding criterion measures of treatment satisfaction was 0.59; the mean correlation of the same Diabetes Medication System Rating Questionnaire Short-Form measures with adherence was 0.42. The Diabetes Medication System Rating Questionnaire Short-Form scales were more powerful predictors of adherence than were the criterion measures of treatment satisfaction. The Diabetes Medication System Rating Questionnaire Short-Form scales differentiated between those taking different medications and between those using different insulin delivery devices.ConclusionsThis study suggests that the Diabetes Medication System Rating Questionnaire Short-Form provides a comprehensive set of measures with acceptable reliability and validity and a reduced burden of administration.
| S-EPMC4232890 | biostudies-literature
Project description:Weak evidence exists on the relationship between nutritional knowledge and diet quality. Many researchers claim that this could be in part because of inadequate validation of the questionnaires used. The aim of this study was to develop a compact reliable questionnaire on nutrition knowledge for young and adult athletes (NUKYA). Researchers and the sport clubs medical staff developed the questionnaire by taking into consideration the latest athlete dietary guidelines. The questionnaire content was validated by a panel of 12 nutrition experts, and finally tested by 445 participants including athletes (n = 264), nutrition students (n = 49) and non-athletes with no formal nutrition knowledge (n = 132). After consulting the experts, 59 of the 64 initial items remained in the questionnaire. To collect the evaluation of experts, we used the content validity index, obtaining high indices for relevance and ambiguity (0.99) as well as for clarity and simplicity (0.98). The final questionnaire included 24 questions with 59 items. We ensured construct validity and reliability through psychometric validation based on the Classical Test Theory and the Item-Response Theory (Rasch model). We found significant statistical differences comparing the groups of nutrition knowledgeable participants with the rest of the groups (ANOVA p < 0.001). We verified the questionnaire for test-retest reliability (R = 0.895, p < 0.001) and internal consistency (Cronbach's α=0.849). We successfully fit the questionnaire data to a rating scale model (global separation reliability of 0.861) and examined discrimination and difficulty indices for items. Finally, we validated the NUKYA questionnaire as an effective tool to appraise nutrition knowledge in athletes. This questionnaire can be used for guiding in educational interventions, studying the influence of nutrition knowledge on nutrient intake and assessing/monitoring sport nutritional knowledge in large groups.
| S-EPMC7699674 | biostudies-literature
Project description:AimsThe aim of the current study was to develop and validate a short-form of the internet overuse screening questionnaire (IOS-Qs).MethodsA total of 571 adults were recruited from a representative, stratified, and multistage cluster sample. Among participants, 188 and 383 were used in the development and validation of the IOS-Qs, respectively.ResultsExperts' ratings and Rasch model analyses led to the selection of 8 items from the IOS-Qs; latent-class analysis using these 8 items revealed an estimated prevalence of 8.6% (33 out of 383) of problematic internet over-users. Problematic internet over-users were positively associated with a 1-year prevalence rate of any mental disorder (OR 3.08, p = 0.008), mood disorder (OR 7.11, p = 0.003), and depressive disorder (OR 5.22, p = 0.016). The receiver operating characteristic curves identified an optimal cutoff score of 9.5 for differentiating problematic internet over-users from unproblematic internet users with 94% sensitivity and 94% specificity.ConclusionThe results suggest that the IOS-Qs was valid, and items including social isolation were crucial to the brief distinction of at-risk internet users. Because of its brevity, the questionnaire can be effectively administered as a large-scale survey.
| S-EPMC7845426 | biostudies-literature
Project description:IntroductionPremenstrual symptoms, including premenstrual syndrome and its more severe form premenstrual dysphoric disorder, are a set of somatic and psychological symptoms that occur during the luteal phase of the menstrual cycle. Our research aimed to adapt the Hungarian version of the Premenstrual Assessment Form-Short Form (PAF-SF), a questionnaire suitable for assessing premenstrual symptoms, and to examine its reliability, validity, and applicability.MethodsThe questionnaire was validated according to Beaton's six-step guidelines. Our sample consisted of 198 menstruating women, 50 of whom completed the instrument for a second time to assess reliability. Descriptive statistics were calculated presenting mean (standard deviation), the internal consistency was measured by Cronbach's alpha value, the test-retest reliability using intraclass correlation coefficients, Spearman rank correlation was applied to test the criterion validity of the questionnaire, and discriminant validity was examined using the independent-sample t test using IBM SPSS 28.0 software. The structural validity was evaluated by confirmatory factor analysis (CFA) using IBM AMOS 29.0 software. The level of significance was set at p < 0.05.ResultsOur sample (average age 25.37 ± 4.80 years) scored 28.08 ± 9.49 points out of the maximum 60 points when filling out the PAF-SF questionnaire. The result of Cronbach's alpha calculation, which supports the reliability of the questionnaire, was 0.845. During the CFA, the three-factor structure (Affect, Water Retention, and Pain) was supported (root mean-square error approximation [RMSEA] = 0.054; Tucker-Lewis Index = 0.965; Comparative Fit Index = 0.976; χ2 = 48.642; df = 31; p = 0.023; χ2/df = 1.569).DiscussionThe PAF-SF questionnaire proved to be a reliable measuring tool for assessing premenstrual symptoms among women of reproductive age.
| S-EPMC10979687 | biostudies-literature
Project description:Alcohol craving has been described as a strong subjective desire to drink, being considered highly valuable in the clinical practice, as it is recognized as a strong predictor of alcohol relapse in alcohol-dependent individuals. However, to date, there is not a multifactorial questionnaire available for assessing short-term acute craving experience in Portugal. The aim of the present study was to validate a swift and efficient tool for the assessment of acute alcohol craving in a sample of Portuguese citizens. For that purpose, the Alcohol Craving Questionnaire-Short Form-Revised (ACQ-SF-R) was translated into European Portuguese and administered to a sample of 591 college participants with ages between 18 and 30 years. Results suggested that a three-factor model (i.e., Emotionality, Purposefulness, and Compulsivity) proved to be most suitable for the Portuguese sample. Overall, the ACQ-SF-R exhibited good psychometric properties, having a good internal consistency both for the general craving index (Cronbach's α = 0.85) and each subscale (Cronbach's α = 0.66-0.83), as well as an appropriate convergent validity with the Penn Alcohol Craving Scale (r = 0.65, p<0.001), suggesting a good construct validity. In addition, the ACQ-SF-R also showed a good concurrent validity with the Alcohol Use Disorders Identification Test (r = 0.57, p<0.001), indicating that risky alcohol use patterns are associated with increased craving scores in the ACQ-SF-R. Collectively, these findings suggest that the Portuguese version of the ACQ-SF-R can accurately measure alcohol craving at a multifactorial level, being a valid and reliable tool to use in Portuguese samples in research settings.
| S-EPMC8143387 | biostudies-literature
Project description:ObjectiveTo develop and validate an instrument for measuring knowledge and skills in evidence based medicine and to investigate whether short courses in evidence based medicine lead to a meaningful increase in knowledge and skills.DesignDevelopment and validation of an assessment instrument and before and after study.SettingVarious postgraduate short courses in evidence based medicine in Germany.ParticipantsThe instrument was validated with experts in evidence based medicine, postgraduate doctors, and medical students. The effect of courses was assessed by postgraduate doctors from medical and surgical backgrounds.InterventionIntensive 3 day courses in evidence based medicine delivered through tutor facilitated small groups.Main outcome measureIncrease in knowledge and skills.ResultsThe questionnaire distinguished reliably between groups with different expertise in evidence based medicine. Experts attained a threefold higher average score than students. Postgraduates who had not attended a course performed better than students but significantly worse than experts. Knowledge and skills in evidence based medicine increased after the course by 57% (mean score before course 6.3 (SD 2.9) v 9.9 (SD 2.8), P<0.001). No difference was found among experts or students in absence of an intervention.ConclusionsThe instrument reliably assessed knowledge and skills in evidence based medicine. An intensive 3 day course in evidence based medicine led to a significant increase in knowledge and skills.
| S-EPMC137813 | biostudies-literature
Project description:The Cognitive Style Questionnaire (CSQ) is a frequently employed measure of negative cognitive style, associated with vulnerability to anxiety and depression. However, the CSQ's length can limit its utility in research. We describe the development of a Short-Form version of the CSQ. After evaluation and modification of two pilot versions, the 8-item CSQ Short Form (CSQ-SF) was administered to a convenience sample of adults (N = 278). The CSQ-SF was found to have satisfactory internal reliability and test-retest reliability. It also exhibited construct validity by demonstrating predicted correlations with measures of depression and anxiety. Results suggest that the CSQ-SF is suitable for administration via the Internet.
| S-EPMC3289144 | biostudies-literature
Project description:AimTo develop and psychometrically test an instrument to assess nurses' evidence-based knowledge and self-efficacy regarding insertion and management of venous access devices (short peripheral catheter (SPC), long peripheral catheter/midline (LPC) and PICC) and the management of totally implantable central venous catheter (Port) in adult patients.DesignMulticenter cross-sectional observational study with questionnaire development and psychometric testing (validity and reliability).MethodsAn evidence-based instrument was developed including a 34-item knowledge section and an 81-item self-efficacy section including four device-specific parts. Nineteen experts evaluated content validity. A pilot study was conducted with 86 nurses. Difficulty and discrimination indices were calculated for knowledge items. Confirmatory factor analyses tested the dimensionality of the self-efficacy section according to the development model. Construct validity was tested through known group validity. Reliability was evaluated through Cronbach's alpha coefficient for unidimensional scales and omega coefficients for multidimensional scales.ResultsContent validity indices and results from the pilot study were excellent with all the item-content validity indices >0.78 and scale-content validity index ranging from 0.96 to 0.99. The survey was completed by 425 nurses. Difficulty and discrimination indices for knowledge items were acceptable with most items (58.8%) showing desirable difficulty and most items (58.8%) with excellent (35.3%) or good (23.5%) discrimination power, and appropriate to the content. The dimensionality of the model posited for self-efficacy was confirmed with adequate fit indices (e.g., comparative fit index range 0.984-0.996, root mean square error of approximation range 0.054-0.073). Construct validity was determined and reliability was excellent with alpha values ranging from 0.843 to 0.946 and omega coefficients ranging from 0.833 to 0.933. Therefore, a valid and reliable tool based on updated guidelines is made available to evaluate nurses' competencies for venous access insertion and management.
| S-EPMC11225607 | biostudies-literature
Project description:Background: Previous studies have demonstrated that traumatic experiences from countries of origin (so-called pre-migratory factors), as well as stressors in countries of destination (so-called post-migratory factors), are related to the extent of mental health difficulties and psychological well-being of refugees. However, numerous risks that this population is exposed to during transit have so far been neglected. Objective: The aim of this research was to construct and validate a questionnaire for assessing stressful and traumatic experiences in transit as well as its short form, which would at the same time provide information on one's stressful experiences as well as existing risks that refugees are exposed to on their journey. Method: The study was realized in three phases - item construction, item revision and instrument validation. In the validation phase, a total of 226 refugees completed the Stressful Experiences in Transit Questionnaire (SET-Q), along with Harvard Trauma Questionnaire (HTQ) Parts I and IV, Hopkins Symptom Checklist-25 (HSCL-25) and Beck Depression Inventory - II (BDI-II). Results: Refugees were exposed to an average of 13 stressful events during transit. SET-Q total score was positively correlated with HTQ Part IV Post-Traumatic Stress Disorder (PTSD) and Self-Perception of Functioning scales (SPFS) while the number of stressful experiences with the local population was positively related to BDI-II depression symptoms. Moreover, SET-Q scores were significant predictors of PTSD and SPFS even after traumatic experiences in the country of origin, assessed by HTQ Part I, were taken into account. A short form of the questionnaire (SET-SF) has also been developed. Conclusions: SET-Q is a valid instrument for measuring the scope of stressful experiences refugees have been exposed to during transit, targeted for this population specifically. Furthermore, SET-SF has the potential to assess the same extent of stressful experiences with a significantly reduced number of items.
| S-EPMC6534217 | biostudies-literature