Dataset Information

Assessing stable validity and reliability of the Japanese version of the individualized supported employment fidelity scale: A replication.

ABSTRACT:

Background

The Japanese version of the individualized Supported Employment Fidelity scale (JiSEF) was developed by modifying the 25-item Individual Placement and Support Fidelity Scale (IPS-25). While a preliminary study partly confirmed the concurrent validity with vocational outcomes, this replication study aimed to examine the stability of the concurrent validity and the inter-rater reliability of the JiSEF and to test its convergent validity with IPS-25.

Methods

Fidelity assessments were conducted in 2016 (n = 17), 2017 (n = 13), and 2018 (n = 18) to examine the employment rate and the fidelity scores at the agency level. We also evaluated the fidelity scores for the IPS-25 in 2018. We examined the associations between the fidelity scale scores and vocational outcomes for the concurrent validity and between the fidelity scales for convergent validity. The inter-rater reliability was examined in the 2016 and 2017 assessments.

Results

High intraclass correlation coefficients (0.93 in 2016 and 0.92 in 2017) were obtained for the inter-rater reliability. The JiSEF score in each year was associated with the agency employment rate (r = 0.710, P = 0.001 in 2016; r = 0.722, P = 0.005 in 2017; and r = 0.665, P = 0.003 in 2018). A supplementary longitudinal data analysis also confirmed the association between the JiSEF score and the employment outcomes. Additionally, the JiSEF was significantly correlated with the IPS-25 (r = 0.760, P < 0.001).

Conclusions

This study stably replicated good inter-rater reliability and concurrent validity of the JiSEF. Additionally, the convergent validity was confirmed. Further studies with large samples are needed to confirm these findings.

SUBMITTER: Yamaguchi S

PROVIDER: S-EPMC8340823 | biostudies-literature | 2021 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Assessing stable validity and reliability of the Japanese version of the individualized supported employment fidelity scale: A replication.

Yamaguchi Sosei S Sato Sayaka S Ojio Yasutaka Y Shiozawa Takuma T Matsunaga Asami A Taneda Ayano A Sawada Utako U Yoshida Koji K Fujii Chiyo C

Neuropsychopharmacology reports 20210318 2

<h4>Background</h4>The Japanese version of the individualized Supported Employment Fidelity scale (JiSEF) was developed by modifying the 25-item Individual Placement and Support Fidelity Scale (IPS-25). While a preliminary study partly confirmed the concurrent validity with vocational outcomes, this replication study aimed to examine the stability of the concurrent validity and the inter-rater reliability of the JiSEF and to test its convergent validity with IPS-25.<h4>Methods</h4>Fidelity asses ...[more]

PMID: 33734619

Similar Datasets

Project description:BackgroundThe clinical relevance of resilience has received considerable attention in recent years. The aim of this study is to demonstrate the reliability and validity of the Japanese version of the Resilience Scale (RS) and short version of the RS (RS-14).FindingsThe original English version of RS was translated to Japanese and the Japanese version was confirmed by back-translation. Participants were 430 nursing and university psychology students. The RS, Center for Epidemiologic Studies Depression Scale (CES-D), Rosenberg Self-Esteem Scale (RSES), Social Support Questionnaire (SSQ), Perceived Stress Scale (PSS), and Sheehan Disability Scale (SDS) were administered. Internal consistency, convergent validity and factor loadings were assessed at initial assessment. Test-retest reliability was assessed using data collected from 107 students at 3 months after baseline. Mean score on the RS was 111.19. Cronbach's alpha coefficients for the RS and RS-14 were 0.90 and 0.88, respectively. The test-retest correlation coefficients for the RS and RS-14 were 0.83 and 0.84, respectively. Both the RS and RS-14 were negatively correlated with the CES-D and SDS, and positively correlated with the RSES, SSQ and PSS (all p < 0.05), although the correlation between the RS and CES-D was somewhat lower than that in previous studies. Factor analyses indicated a one-factor solution for RS-14, but as for RS, the result was not consistent with previous studies.ConclusionsThis study demonstrates that the Japanese version of RS has psychometric properties with high degrees of internal consistency, high test-retest reliability, and relatively low concurrent validity. RS-14 was equivalent to the RS in internal consistency, test-retest reliability, and concurrent validity. Low scores on the RS, a positive correlation between the RS and perceived stress, and a relatively low correlation between the RS and depressive symptoms in this study suggest that validity of the Japanese version of the RS might be relatively low compared with the original English version.

Project description:Dyspnea is a common, distressing symptom of cardiopulmonary and neuromuscular diseases and is defined as "a subjective experience of breathing discomfort that consists of qualitatively distinct sensations that vary in intensity." However, Japanese intensive care units (ICUs) do not routinely screen for dyspnea, as no validated Japanese version of the Respiratory Distress Observation Scale (RDOS) is available. Therefore, we aimed to translate the English version of this questionnaire into Japanese and assess its validity and reliability. To translate the RDOS, we conducted a prospective observational study in a 12-bed ICU of a universal hospital that included 42 healthcare professionals, 10 expert panels, and 128 ventilated patients. The English version was translated into Japanese, and several cross-sectional web-based questionnaires were administered to the healthcare professionals. After completing the translation process, a validity and reliability evaluation was performed in the ventilated patients. Inter-rater reliability was evaluated using Cohen's weighted kappa coefficient. Criterion validity was ascertained based on the correlation between RDOS and the dyspnea visual analog scale. The area under the receiver operating characteristic curve analysis was used to evaluate the ability of the RDOS to identify patients with self-reported dyspnea. The average content validity index at the scale level was 0.95. Data from the 128 patients were collected and analyzed. Cohen's weighted kappa coefficient and the correlation coefficient between the two scales were 0.76 and 0.443 (95% confidence intervals 0.70-0.82 and 0.23-0.62), respectively. For predicting self-reported dyspnea, the area under the receiver operating characteristic curve was 0.81 (95% confidence interval 0.67-0.97). The optimal cutoff used was 1, with a sensitivity and specificity of 0.89 and 0.61, respectively. Our findings indicated that the Japanese version of the RDOS is acceptable for face validity, understandability, criterion validity, and inter-rater reliability in lightly sedated mechanically ventilated patients, indicating its clinical utility.

Project description:BACKGROUND:Active-emphatic listening is active listening that focuses on empathy. The Active-Empathic Listening Scale (AELS) is a self-report scale comprising three dimensions: sensing, processing, and responding. However, translated versions are not available for languages used in Asian countries, such as Japanese. The aim of the present study was to demonstrate and report on the reliability and validity of the Japanese version of the AELS. METHODS:After the scale was back translated, 728 Japanese university students completed the Japanese AELS. Of those participants, 566 responded to Japanese versions of the Interpersonal Reactivity Index (IRI) and Encode, Decode, Control, and Regulate Model (ENDCOREs) for validation, and the Japanese AELS was administered again to 59 participants after 3 weeks, to determine test-retest reliability. This study used confirmatory factor analysis to validate the scale's three-factor structure. To evaluate reliability, Cronbach's ?, McDonald's omega, and intra-class correlation coefficient were calculated. To examine validity, correlation and partial correlation analyses were conducted. RESULTS:Results indicated that the factor structure of the Japanese AELS was equivalent to that of the original AELS (CFI?=?.942, TLI?=?.920, RMSEA?=?.055). The scale had adequate internal reliability (sensing: ??=?.64/ ??=?.72, processing: ??=?.61/ ??=?.62, responding: ??=?.68/ ??=?.77, total: ??=?.82/ ??=?.86) and a moderate test-retest intraclass correlation coefficient (sensing: .53, 95%Cl [.31-.69], processing: .48, 95%Cl [.26-.65], responding: .52, 95%Cl [.31-.68], total: .51, 95%Cl [.29-.68]). Criterion-related validity was demonstrated by the positive correlation between the Japanese AELS and other measures (IRI and ENDCOREs). CONCLUSIONS:These results suggest that the validity of the Japanese AELS is relatively comparable to the original AELS; however, it will be necessary to determine potential cultural concerns by comparing Japanese culture and other Asian cultures in future studies. The Japanese AELS is expected to be used to measure the outcomes of active listening training in Japan.

Dataset Information

Assessing stable validity and reliability of the Japanese version of the individualized supported employment fidelity scale: A replication.

Background

Methods

Results

Conclusions

Publications

Assessing stable validity and reliability of the Japanese version of the individualized supported employment fidelity scale: A replication.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets