Interdisciplinary Health Care Evaluation Instruments: A Review of Psychometric Evidence.
Ontology highlight
ABSTRACT:
SUBMITTER: Kang HJ
PROVIDER: S-EPMC9446429 | biostudies-literature | 2022 Sep
REPOSITORIES: biostudies-literature
Publications
Interdisciplinary Health Care Evaluation Instruments: A Review of Psychometric Evidence.
Kang Hosung Joel HJ Flores-Sandoval Cecilia C Law Benson B Sibbald Shannon S
Evaluation & the health professions 20210819 3
Teamwork among health care professionals has been found to improve patient outcomes and reduce burnout. Surveys from individual team members are often used to measure the effectiveness of teamwork performance, as they provide an efficient way to capture various constructs of teamwork. This allows evaluators to better understand team functioning, areas of strength, and to identify potential areas for improvement. However, the majority of published surveys are yet to be validated. We conducted a r ...[more]
Similar Datasets
Project description:BackgroundSuboptimal health status (SHS) measurement has now been recognized as an essential construct in predictive, preventive, and personalized medicine. Currently, there are limited tools, and an ongoing debate about appropriate tools. Therefore, it is crucial to evaluate and generate conclusive evidence about the psychometric properties of available SHS tools.ObjectiveThis research aimed to identify and critically assess the psychometric properties of available SHS instruments and provide recommendations for their future use.MethodsArticles were retrieved by following the guidelines of the PRISMA checklist, and the robustness of methods and evidence about the measurement properties was assessed using the adapted COSMIN checklist. The review was registered in PROSPERO.ResultsThe systematic review identified 14 publications describing four subjective SHS measures with established psychometric properties; these included the Suboptimal Health Status Questionnaire-25 (SHSQ-25), Sub-health Measurement Scale Version 1.0 (SHMS V1.0), Multidimensional Sub-health Questionnaire of Adolescents (MSQA), and the Sub-Health Self-Rating Scale (SSS). Most studies were conducted in China and reported three reliability indices: (1) the internal consistency measured by Cronbach's α value ranged between 0.70 and 0.96; (2) the test-retest reliability; and (3) the split-half reliability coefficient values ranged between 0.64 and 0.98, and between 0.83 and 0.96, respectively. For the values of validity coefficients in the case of SHSQ-25 > 0.71, the SHMS-1.0 ranged from 0.64 to 0.87, and the SSS ranged from 0.74 to 0.96. Using these existing and well-characterized tools rather than constructing original tools is beneficial, given that the existing choice demonstrated sound psychometric properties and established norms.ConclusionsThe SHSQ-25 stood out as being more suitable for the general population and routine health surveys, because it is short and easy to complete. Therefore, there is a need to adapt this tool by translating it into other languages, including Arabic, and establishing norms based on populations from other regions of the world.
| S-EPMC9967625 | biostudies-literature
Project description:IntroductionThe prevention and relief of suffering are regarded as a goal at the end of life; therefore, suffering assessment at the end of life is essential. In this regard, we need instruments that allow us to evaluate this construct for gathering more evidence, as the assessment of suffering is increasingly used in research and the clinical setting. Many measures have been designed to assess this construct, and the selection of the most appropriate instrument is crucial. The aims of this systematic review are to (1) identify the measures assessing suffering in patients with advanced disease and their psychometric properties and (2) evaluate the methodological quality of studies on measurement properties.Methods and analysisThe protocol of this systematic review was developed using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols Guidelines. A systematic psychometric review of measures assessing suffering in patients with advanced disease and their psychometric properties will be carried out according to the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN). The search strategy will be performed following the Peer Review of Electronic Search Strategies. Searches will be conducted in Cumulative Index to Nursing and Allied Health Literature, Medline, PsycINFO, Cochrane Library, SciELO, Open Grey, Scopus, Web of Science and COSMIN database of systematic reviews, and it will be limited by time (1980-2018) and language (only literature in English and Spanish). Literature will be evaluated by two independent reviewers according to the COSMIN checklist, and measurement properties data of each study that meet the inclusion criteria will be scored independently by two researchers according to COSMIN quality ratings.Ethics and disseminationEthical approval is not necessary for systematic review protocols. The results will be disseminated by publication in a peer-reviewed journal and presented at a relevant conference.Prospero registration numberCRD42018106488.
| S-EPMC6500222 | biostudies-literature
Project description:Background: Informational overload hinders the recognition of quality information and influences a population's health-related decisions. In this context, media health literacy aims to promote citizens' critical analysis skills, contributing to informed decision-making. This study aims to identify the instruments used to measure the level of media health literacy and their psychometric properties.MethodsA systematic review of the scientific literature was performed in 2023. The articles were extracted from the electronic databases "Pubmed", "Web of Science", "Dialnet", and "Scopus". The search languages were limited to English, Spanish, and Portuguese.ResultsTwelve articles were selected for further analysis. The described measurement instruments included five original scales and seven cross-cultural adaptations of three of them. Four scales (the Sugar-Sweetened Beverages Media Literacy scale adapted to Turkish and Chinese, along with the Media Health Literacy (MeHLit) scale and its adaptation to the Chinese language) exhibited high quality in the assessment of psychometric properties.ConclusionsThese instruments allow for the measurement of an individual's level of skill when consuming specific health information, enabling an analysis to understand the risk they are exposed to. Further research is recommended to strengthen the existing evidence and apply these tools to broader and more diverse populations.
| S-EPMC11503266 | biostudies-literature
Project description:Background and objectiveAccess to health care is a universal concern. Therefore, this study was conducted to develop a questionnaire to assess the Perceived Access to Health care based on Penchansky and Thomas's definition of access and the assessment of its psychometric properties.MethodThe initial questionnaire contains 31 items developed based on a deductive approach with an extensive review of the related literature. Content validity, face validity, construct validity, internal consistency, and instrument reliability were further examined. Data analysis was conducted using SPSS software version 24, R software version 4, and lavaan package.ResultsThe initial questionnaire was examined using qualitative content validity, and the necessary modifications were applied to each item. The content validity ratio (CVR) was approved in 30 items with a value greater than 0.78, and one item with a CVR value lower than 0.78 was removed. In the case of the content validity index (CVI), 29 items were approved with a CVI value of greater than 0.79, and one item with a CVI value between 0.70 and 0.79 was revised. In qualitative face validity, all items were approved by a panel of experts and the participants. All 30 items with an impact score index higher than 1.5 were approved for the next steps. The confirmatory factor analysis results showed that the six-factor model of access to health care has an appropriate fit. Cronbach's alpha coefficient for the questionnaire was calculated 0.86. The value of Cronbach's alpha for the dimensions of availability, accessibility, affordability, accommodation, acceptability, and awareness were 0.61, 0.76, 0.66, 0.60, 0.80, and 0.76, respectively. The Intraclass Correlation Index (ICC) value for reliability (test-retest) of the whole instrument was calculated 0.94 using the two-way mixed absolute agreement method.ConclusionThe success of health programs depends on eliminating barriers to access to provided health care services. One of the most critical barriers to understanding access is a perception of limited access. This questionnaire might be used further to understand perceived health care access in different global contexts.
| S-EPMC8254360 | biostudies-literature
Project description:PurposeResearch shows that the professional healthcare working environment influences the quality of care, safety climate, productivity, and motivation, happiness, and health of staff. The purpose of this systematic literature review was to assess instruments that provide valid, reliable and succinct measures of health care professionals' work environment (WE) in hospitals.Data sourcesEmbase, Medline Ovid, Web of Science, Cochrane CENTRAL, CINAHL EBSCOhost and Google Scholar were systematically searched from inception through December 2018.Study selectionPre-defined eligibility criteria (written in English, original work-environment instrument for healthcare professionals and not a translation, describing psychometric properties as construct validity and reliability) were used to detect studies describing instruments developed to measure the working environment.Data extractionAfter screening 6397 titles and abstracts, we included 37 papers. Two reviewers independently assessed the 37 instruments on content and psychometric quality following the COSMIN guideline.Results of data synthesisOur paper analysis revealed a diversity of items measured. The items were mapped into 48 elements on aspects of the healthcare professional's WE. Quality assessment also revealed a wide range of methodological flaws in all studies.ConclusionsWe found a large variety of instruments that measure the professional healthcare environment. Analysis uncovered content diversity and diverse methodological flaws in available instruments. Two succinct, interprofessional instruments scored best on psychometrical quality and are promising for the measurement of the working environment in hospitals. However, further psychometric validation and an evaluation of their content is recommended.
| S-EPMC7654380 | biostudies-literature
Project description:AimTo identify the measures assessing the nursing image, and to analyse, evaluate and synthesize the psychometric properties of these available instruments.DesignA systematic review of the psychometric properties of instruments assessing the nursing image. The system review has been registered in the PROSPERO database with the registration number CRD42020221511.MethodsThe systematic review was conducted according to COSMIN guidelines. Search strategies were run in CINAHL, MEDLINE, APA PsycINFO, Web of Science, Scopus, COSMIN systematic review database, Cochrane Library and China National Knowledge Infrastructure (CNKI). Two reviewers independently screened the studies, extracting the psychometric properties of the included study characteristics and instruments. The methodological quality of the studies, instrument measurement performance, risk of bias and grade of evidence were evaluated and disagreements were resolved via discussion.ResultsThe search strategy yielded a total of 24 studies and 11 instruments assessing nursing image. None of the measures fulfilled all criteria in the COSMIN Risk of Bias checklist. The Nurses Self-Concept Instrument (NSCI) and the Nurses Self-Concept Questionnaire (NSCQ) were recommended for measuring the professional image of nursing, and the Nursing Brand Image Scale (NBIS) have the potential to be recommended for measuring a more comprehensive image of nursing. Every instrument evaluated in this review had different characteristics in the nursing image (e.g. the traditional image, the professional image, and the brand image). Therefore, the selection of the most appropriate instrument depends on the psychometrics, the context and the aim of the assessment.
| S-EPMC10333846 | biostudies-literature
Project description:Background and objectivesHealth-related quality of life (HRQoL) is a patient-reported measure of health status. However, research on the psychometric properties of HRQoL instruments used post-critical care is less common. We conducted a systematic review assessing the psychometric properties of HRQoL instruments used in adult survivors following critical illness.MethodsThree databases were systematically searched between 1990 and June 2022. Screening articles for eligibility, we selected either development studies for new tools or studies that evaluated psychometric properties, and whose target population represented adult survivors following critical illness. Methodological quality was assessed using the COnsensus-Based Standards for the selection of health Measurement INstruments (COSMIN) checklist. The results of each psychometric property were then assessed for criteria of good psychometric properties (sufficient, insufficient or indeterminate) and qualitatively summarised. Finally, we graded the quality of the evidence using a modified GRADE approach.ResultsWe retrieved 13 eligible studies from 2,983 records identifying 10 HRQoL instruments used post-critical illness. While high-quality evidence for the considered PROMs was limited primarily due to risk of bias, seven instruments demonstrated sufficient levels of reliability, four instruments presented sufficient hypothesis testing, and two instruments showed sufficient responsiveness. Except the Short Form-36, evidence for psychometric properties of other individual measures was limited to a few studies.ConclusionThere was limited evidence demonstrated for the psychometric properties of the included PROMs evaluating HRQoL. Further research is warranted to evaluate the psychometric properties of HRQoL measures, strengthening the evidence for administering these instruments in survivors following critical illness.
| S-EPMC10784337 | biostudies-literature
Project description:Tuberous sclerosis complex (TSC) is a rare genetic disease associated with significant disease burden and considerable impact on health-related quality of life (HRQL). Currently no disease-specific clinical outcome assessments evaluate HRQL in individuals with TSC. A multi-center phase III study EXIST-3 (NCT01713946) assessed the efficacy and safety of two trough exposure ranges (Low exposure, LE: 3-7 ng/mL and high exposure, HE: 9-15 ng/mL) of adjunctive everolimus in patients aged 2-65 years with TSC and refractory partial-onset seizures (N = 366). Three age-specific HRQL measures were included as secondary endpoints including: quality of life in childhood epilepsy (QOLCE; caregiver-report for aged 2- < 11), the Quality of Life in Epilepsy Inventory for Adolescents-48 (QOLIE-AD-48; self-report, aged ≥ 11- < 18), and the Quality of Life in Epilepsy Inventory-31-Problems (QOLIE-31-P; self-report, aged ≥ 18). Intellectual ability was evaluated using the Wechsler Non-Verbal (WNV) Scale of Ability. Post hoc analyses were performed on the core phase primary data from EXIST-3 to evaluate the psychometric properties of the HRQL measures and calculate meaningful change estimates. Results showed that a significant subset of the trial sample (4-21 year olds) scored in the intellectual disability range, as assessed by the WNV. Psychometric analyses of the three epilepsy measures (including reliability, validity, and ability to detect change) supported the appropriateness for use in TSC. Distribution-based meaningful change estimates were generated for each HRQL measure, with estimates for the QOLIE-31-P total score largely consistent with the published literature. To our knowledge, this is the first evaluation using clinical trial data to establish the psychometric properties of the QOLCE, QOLIE-AD-48, and QOLIE-31-P for use in individuals with TSC. These findings increase confidence in the measures as valid and reliable for use in clinical trials and future research in patients with TSC.
| S-EPMC6126421 | biostudies-literature
Project description:BackgroundsThe range of theoretical conceptualizations of problematic exercise in psychometric assessment instruments makes it difficult to identify the components that define this phenomenon. A better understanding of the underlying components of problematic exercise may contribute to progress toward providing scientific evidence that allows for deciding whether problematic exercise should be considered a substantive mental health disorder. The objective of the present review was to examine and compare, through a content analysis of their items, the components of problematic exercise in psychometric assessment instruments identified in a recent systematic review.MethodsA total of 33 components of problematic exercise were identified in the 17 assessment instruments included in the present review.ResultsThe results show that, despite the lack of consensus in the operational definition of their factors and the variety of ways of wording their items, the instruments reflect some common components that might indicate core criteria (i.e., salience, withdrawal, and mood modification) or candidate components (i.e., conflict, and continuance despite problems) of problematic exercise. However, other components of different nature were shown to be specific to some of the problematic exercise conceptualizations on which the assessment instruments are based.ConclusionIn the interest of reaching a consensus that allows to advance in this research field, further studies are needed to resolve which components are inherently problematic.
| S-EPMC9008204 | biostudies-literature
Project description:BackgroundSexual desire is one of the domains of sexual function with multiple dimensions, which commonly affects men and women around the world. Classically, its assessment has been applied through self-report tools; however, an issue is related to the evidence level of these questionnaires and their validity. Therefore, a systematic review addressing the available questionnaires is really relevant, since it will be able to show their psychometric properties and evidence levels.MethodA systematic review was carried out in the PubMed, EMBASE, PsycINFO, Science Direct, and Web of Science databases. The search strategy was developed according to the following research question and combination of descriptors and keywords, including original studies with no limit of publication date and in Portuguese, English, and Spanish. Two reviewers carried out the selection of articles by abstracts and full texts as well as the analysis of the studies independently. The methodological quality of the instruments was evaluated by the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist.ResultsThe search resulted in 1203 articles, of which 15 were included in the review. It identified 10 instruments originally developed in the English language. Unsatisfactory results on methodological quality were evidenced in cultural adaptation studies with no description of the steps of the processes and inadequacy of techniques and parameters of adequacy for models. The Principal Component Analysis with Varimax rotation predominated in the studies.ConclusionsThe limitation of the techniques applied in the validation process of the reviewed instruments was evident. A limitation was observed in the number of adaptations conducted and contexts to which the instruments were applied, making it impossible to reach a better understanding of the functioning of instruments. In future studies, the use of robust techniques can ensure the quality of the psychometric properties and the accuracy and stability of instruments. A detailed description of procedures and results in validation studies may facilitate the selection and use of instruments in the academic and/or clinical settings.Systematic review registrationPROSPERO CRD42018085706.
| S-EPMC6194697 | biostudies-literature