Reliability and validity of self-assessment of mouth opening: a validation study.
Ontology highlight
ABSTRACT: Background
The objective of this study was to evaluate the reproducibility and validity of patients' mouth opening measurements in a research setting.Methods
Firstly, 68 patients made repeated self-measurements of mouth opening using a cardboard scale (Therabite Range of Motion Scale - TRMS). Secondly, 80 patients enrolled in a clinical trial on morbidity after lower third molar surgery, made daily assessments during the postoperative week. Patients' measurements were then compared to gold-standard clinicians' measurements.Results
Reliability of patients' measurements was excellent with an intraclass correlation coefficient of 0.92. The patient's measurements correlated well with the gold-standard clinician's measurements, both for the first 68 patients (Pearson's rho ranging from 0.86 to 0.90, p < 0.0001) as well as for the 80 patients enrolled in the clinical trial (rho = 0.82, p < 0.0001 at day 2, rho = 0.83, p < 0.0001 at final visit).Conclusions
TRMS can be used by patients to produce reproducible and valid mouth opening measurements.
SUBMITTER: Saund DS
PROVIDER: S-EPMC3534492 | biostudies-literature | 2012 Nov
REPOSITORIES: biostudies-literature
Publications
Reliability and validity of self-assessment of mouth opening: a validation study.
Saund Daniel Satnam Singh DS Pearson David D Dietrich Thomas T
BMC oral health 20121112
<h4>Background</h4>The objective of this study was to evaluate the reproducibility and validity of patients' mouth opening measurements in a research setting.<h4>Methods</h4>Firstly, 68 patients made repeated self-measurements of mouth opening using a cardboard scale (Therabite Range of Motion Scale - TRMS). Secondly, 80 patients enrolled in a clinical trial on morbidity after lower third molar surgery, made daily assessments during the postoperative week. Patients' measurements were then compar ...[more]
Similar Datasets
Project description:BackgroundThe aging society in Japan is progressing rapidly compared with that in the United States and European countries. Aging limits activities of daily living (ADL) in older adults, declining their lives and functions at home. Therefore, improving their ADL to effectively support their functioning at home for as long as possible is vital. Consequently, supporters need to have a common understanding, be promptly aware of the decline in ADL, and quickly introduce rehabilitation. The Functional Independence Measure (FIM) and Barthel Index (BI) are the main scales used to quantitatively assess ADL. However, previous studies have reported that FIM requires specialized knowledge for evaluation, and BI does not appropriately capture changes in ADL. The Self-Assessment Burden Scale-Motor (SAB-M) was developed as a scale for family caregivers to appropriately assess changes in ADL in older adults. Previous studies using the SAB-M have confirmed its reliability and validity in hospitalized patients as assessed by their family caregivers. Therefore, this study aimed to investigate the reliability and validity of the SAB-M among community-dwelling older adults as assessed by their family caregivers.MethodsThis study included community-dwelling older adults who received home-visit rehabilitation at the first author's facility between October 2020 and December 2020 in Japan. Following previous studies, the SAB-M was used by family caregivers to assess 20 older adults twice for intra-rater reliability. Furthermore, 168 older adults were evaluated by family caregivers for internal consistency using the SAB-M. For criterion validity, the SAB-M was used for the assessment by family caregivers, and therapists used the FIM-Motor (FIM-M). This study used the weighted kappa, Cronbach's alpha, and Spearman's rank correlation coefficients for the statistical analysis of intra-rater reliability, internal consistency, and criterion validity, respectively.ResultsThe weighted kappa coefficient for the total score was 0.98 (p < 0.01) and individual item, it was 0.93 for feeding (p < 0.01), 0.91 for bathing (p < 0.01), 0.98 for dressing (p < 0.01), 0.94 for transfer (p < 0.01), 0.94 for walking/wheelchair (p < 0.01), 0.95 for stairs (p < 0.01), and 0.96 for bladder management (p < 0.01). The Cronbach's alpha was 0.93 for the seven items. The Spearman's rank correlation coefficient between the SAB-M and FIM-M scores was 0.91 (p < 0.01).ConclusionThe SAB-M has sufficient reliability and validity among community-dwelling older adults. Family caregivers can routinely assess changes in the ADL of community-dwelling older adults using the SAB-M, enabling them to promptly consider introducing rehabilitation when older adults' ADL declines. Therefore, implementing SAB-M helps older adults live and function at home for as long as possible.
| S-EPMC11260414 | biostudies-literature
Project description:ObjectivesTo evaluate the psychometric properties of the Transfer Assessment Instrument Questionnaire (TAI-Q), a self-assessment measure to evaluate transfer quality compared with clinician-reported measures.DesignParticipants self-assessed transfers from their wheelchair to a mat table using the TAI-Q. For session 1, participants self-assessed their transfer both before and after reviewing a video of themselves completing the transfer (session 1). Self-assessment was completed for another transfer after a 10-minute delay (session 2, intrarater reliability) and after a 1- to 2-day delay (session 3, test-retest reliability). Self-assessment was compared with a criterion standard of an experienced clinician scoring the same transfers with the Transfer Assessment Instrument (TAI) version 4.0 (concurrent validity).Setting2017 National Veterans Wheelchair Games.ParticipantsConvenience sample of full-time wheelchair users (N=44).InterventionsNot applicable.Main outcome measuresTAI-Q and TAI.ResultsAfter video review of their transfer, acceptable levels of reliability were demonstrated for total TAI-Q score for intrarater (intraclass correlation [ICC], 0.627) and test-retest reliability (ICC, 0.705). Moderate to acceptable concurrent validity was demonstrated with the TAI (ICC, 0.554-0.740). Participants tended to underestimate the quality of their transfer (reported more deficient items) compared with the TAI. However, this deficit decreased and reliability improved from pre-video review to post-video review and from session 1 to session 2. The minimum detectable change indicated that a change of 1.63 to 2.21 in the TAI-Q total score is needed to detect a significant difference in transfer skills.ConclusionsWhen paired with video review, the TAI-Q demonstrates moderate to acceptable levels of reliability and validity for the total score. Self-assessment was completed quickly (<5min) and could help to potentially screen for deficiencies in transfer quality and opportunities for intervention.
| S-EPMC7853356 | biostudies-literature
Project description:BackgroundThis study aimed to develop a self-assessment scale for care management of people with dementia and examine its reliability and validity.MethodsBased on Bloom's Taxonomy, previous research, and experts' opinions on dementia and care management, a scale consisting of 18 items was developed to assess care managers' attitudes, knowledge, and skills in their management of people with dementia. To examine the scale's reliability and validity, data were collected from 638 care managers. Construct validity using exploratory factor analysis, known-group validity, and internal consistency reliability of the scale were evaluated.ResultsExploratory factor analysis supported the construct validity with a four-factor model and explained 59.1% of the total variance. Following were the four factors: Factor I 'Person centred care'; Factor II 'Understanding of disease characteristics, treatment and care'; Factor III 'Understanding of people with dementia and care management according to their characteristics'; and Factor IV 'Utilization of local resources surrounding people with dementia'. Regarding the known-group validity, results showed that the group with a qualified chief care manager scored significantly higher than the group without one on Factors I (P = 0.013) and III (P = 0.026). Cronbach's alpha coefficient for the 18 items was 0.928.ConclusionsThe findings prove that the scale has acceptable reliability and validity, and can help care managers reflect on their practice. Future research is desirable to measure the validation of change in the scale.
| S-EPMC11577988 | biostudies-literature
Project description:BackgroundFew assessment instruments have examined the nutrition and physical activity environments in child care, and none are self-administered. Given the emerging focus on child care settings as a target for intervention, a valid and reliable measure of the nutrition and physical activity environment is needed.MethodsTo measure inter-rater reliability, 59 child care center directors and 109 staff completed the self-assessment concurrently, but independently. Three weeks later, a repeat self-assessment was completed by a sub-sample of 38 directors to assess test-retest reliability. To assess criterion validity, a researcher-administered environmental assessment was conducted at 69 centers and was compared to a self-assessment completed by the director. A weighted kappa test statistic and percent agreement were calculated to assess agreement for each question on the self-assessment.ResultsFor inter-rater reliability, kappa statistics ranged from 0.20 to 1.00 across all questions. Test-retest reliability of the self-assessment yielded kappa statistics that ranged from 0.07 to 1.00. The inter-quartile kappa statistic ranges for inter-rater and test-retest reliability were 0.45 to 0.63 and 0.27 to 0.45, respectively. When percent agreement was calculated, questions ranged from 52.6% to 100% for inter-rater reliability and 34.3% to 100% for test-retest reliability. Kappa statistics for validity ranged from -0.01 to 0.79, with an inter-quartile range of 0.08 to 0.34. Percent agreement for validity ranged from 12.9% to 93.7%.ConclusionThis study provides estimates of criterion validity, inter-rater reliability and test-retest reliability for an environmental nutrition and physical activity self-assessment instrument for child care. Results indicate that the self-assessment is a stable and reasonably accurate instrument for use with child care interventions. We therefore recommend the Nutrition and Physical Activity Self-Assessment for Child Care (NAP SACC) instrument to researchers and practitioners interested in conducting healthy weight intervention in child care. However, a more robust, less subjective measure would be more appropriate for researchers seeking an outcome measure to assess intervention impact.
| S-EPMC1934916 | biostudies-literature
Project description:ObjectivesTo develop the Psychiatric Nurse Self-Efficacy Scales, and to examine their reliability and validity.DesignWe developed the Improved Self-Efficacy Scale (ISES) and Decreased Self-Efficacy Scale (DSES) using existing evidence. Statistical analysis was conducted on the data to test reliability and validity.SettingThe study's setting was psychiatric facilities in three prefectures in Japan.ParticipantsData from 514 valid responses were extracted of the 786 responses by psychiatric nurses.Outcome measuresThe study measured the reliability and validity of the scales.ResultsThe ISES has two factors ('Positive changes in the patient' and 'Prospect of continuing in psychiatric nursing') and the DSES has three ('Devaluation of own role as a psychiatric nurse', 'Decrease in nursing ability due to overload' and 'Difficulty in seeing any results in psychiatric nursing'). With regard to scale reliability, the Cronbach's alpha coefficient was 0.634-0.845. With regard to scale validity, as the factorial validity of the ISES and DSES, for the ISES, χ2/df (110.625/37) ratio=2.990 (p<0.001), goodness-of-fit index (GFI)=0.962, adjusted GFI (AGFI)=0.932, comparative fit index (CFI)=0.967 and root mean square error of approximation (RMSEA)=0.062; for the DSES, χ2/df (101.982/37) ratio=2.756 (p<0.001), GFI=0.966, AGFI=0.940, CFI=0.943, RMSEA=0.059 and Akaike Information Criterion=159.982. The concurrent validity of the General Self-Efficacy Scale was r=0.149-0.446 (p<0.01) for ISES and r=-0.154 to -0.462 (p<0.01) for DSES, and the concurrent validity of the Stress Reaction Scale was r=-0.128 to 0.168 for ISES, r=0.214-0.398 for DSES (p<0.01).Statistical analyses showed the scales to be reliable and valid measures.ConclusionsThe ISES and DSES can accurately assess psychiatric nurses' self-efficacy. Using these scales, it is possible to formulate programmes for improving psychiatric nurses' feelings of self-efficacy.
| S-EPMC8744105 | biostudies-literature
Project description:BackgroundFalls are a common and serious public health issue among older adults, contributing to the loss of independence, psychological distress, and incapability to engage in meaningful occupations, etc. However, there is a lack of abundant information about the fall risk self-evaluation scale for community-dwelling older people. Therefore, this study aimed to evaluate the preliminary reliability and validity of the fall risk self-assessment scale (FRSAS) among community-dwelling older adults.MethodsA cross-sectional study was conducted. A total of 230 individuals aged 65 years and over were recruited by a convenience sampling between October and December 2020 from three communities in Haidian district, Beijing. Eligible participants were required to fill in the general condition questionnaire and the fall risk self-assessment scale. The reliability and validity were analyzed by using SPSS 20.0.ResultsTwo hundred twenty-two participants completed the assessment as required (the completion rate was 96.52%). The most items of FRSAS were understood by older adults, which was completed in 10 min. Cronbach's α and intraclass correlation coefficient ICC (2,1) of the scale were 0.757 and 0.967 respectively, suggesting good internal consistency and test-retest reliability. Exploratory factor analysis yielded 14 factors that explained 61.744% of the variance. Five items failed to be categorized into any factors because the factor loading of these items was less than 0.4. A future large-sample study needs to be conducted to explore its construct validity. The total scores and dimensional scores except for C-dimension showed significant differences between participants who had experienced a fall in the previous 6 months and those who had not (P < 0.05), indicating good discriminant validity.ConclusionsThe fall risk self-assessment scale including 41 items demonstrated relatively high feasibility as well as satisfactory results in the internal consistency, test-retest reliability, and discriminant validity.Trial registrationRegistration number: ChiCTR2000038856 ; Date of registration: 7 Oct 2020.
| S-EPMC8976342 | biostudies-literature
Project description:BackgroundTime spent in sleep, sedentary behaviour (SB), and physical activity are exhaustive and mutually exclusive parts of a 24-h day that need to be considered in a combination. The aim of this study was to identify validated self-reported tools for assessment of movement behaviours across the whole 24-h day, and to review their attributes and measurement properties.MethodsThe databases PubMed, Scopus, and SPORTDiscus were searched until September 2023. Inclusion criteria were: (i) published in English language, (ii) per-reviewed paper, (iii) assessment of self-reported time spent in sleep, SB, and physical activity, (iv) evaluation of measurement properties of all estimates across the full 24-h day, and (v) inclusion of adolescents, adults, or older adults. The methodological quality of included studies was assessed using the Consensus-based Standards for the selection of health Measurement Instruments checklist.ResultsOur search returned 2064 records. After studies selection, we included 16 articles that reported construct validity and/or test-retest reliability of 12 unique self-reported tools - eight questionnaires, three time-use recalls, and one time-use diary. Most tools enable assessment of time spent in sleep, and domain-specific SB and physical activity, and account that sum of behaviours should be 24 h. Validity (and reliability) correlation coefficients for sleep ranged between 0.22 and 0.69 (0.41 and 0.92), for SB between 0.06 and 0.57 (0.33 and 0.91), for light-intensity physical activity between 0.18 and 0.46 (0.55 and 0.94), and for moderate- to vigorous-intensity physical activity between 0.38 and 0.56 (0.59 and 0.94). The quality of included studies being mostly fair-to-good.ConclusionsThis review found that only a limited number of validated self-reported tools for assessment of 24-h movement behaviours are currently available. Validity and reliability of most tools are generally adequate to be used in epidemiological studies and population surveillance, while little is known about adequacy for individual level assessments and responsiveness to behavioural change. To further support research, policy, and practice, there is a need to develop new tools that resonate with the emerging 24-h movement paradigm and to evaluate measurement properties by using compositional data analysis.Systematic review registrationPROSPERO CRD42022330868.
| S-EPMC11295502 | biostudies-literature
Project description:IntroductionThe Duchenne Video Assessment (DVA) assesses quality of movement as an indication of Duchenne muscular dystrophy (DMD) disease severity. Caregivers video record patients performing home-based movement tasks using a mobile application, and physical therapists (PTs) rate the videos using scorecards with prespecified compensatory movement criteria. Reliability and construct validity of the DVA were tested using video and Pediatric Outcomes Data Collection Instrument (PODCI) data from patients with DMD and healthy controls from a separate study.MethodsFifteen PTs were trained and certified as DVA raters. All raters scored videos of five subjects performing each movement task; nine raters rescored the same videos four weeks later. Three raters scored videos from an average of 25 subjects for each movement task. Aggregate scores were used to test construct validity. An expert DMD clinician assigned each video to a severity group for known-groups analyses. Differences between rater scores across severity groups were tested and correlations between DVA and PODCI scores were calculated.ResultsInter-rater reliability (intraclass correlation coefficient [ICC]) between all 15 raters ranged from 0.70 to 0.97 for all movement tasks. Mean intra-rater reliability ICC for nine raters ranged from 0.82 to 0.98 for all movement tasks. There were statistically significant differences between known severity groups for all movement tasks. The DVA correlated strongly with related PODCI constructs of physical function and weakly with unrelated constructs.DiscussionThe DVA was found to be a reliable and valid tool for measuring quality of movement as an indication of disease severity.
| S-EPMC8361683 | biostudies-literature
Project description:Background: Proper transfer technique is associated with improved biomechanics and decreased pain and pathology. However, many users do not use proper technique, and appropriate assessment and training are needed to address these deficits. The transfer assessment instrument (TAI) 4.0 was designed to meet those needs and improve on past versions by removing the need for clinician training, shortening administration time, and simplifying question content. Objectives: Evaluate the psychometric properties of the TAI 4.0. Methods: A convenience sample of full-time wheelchair users was scored on multiple transfers by four raters to assess interrater, intrarater, and test-retest reliability and concurrent validity of the TAI 4.0. Each user also was scored using a visual analog scale (VAS). Results: For 44 participants, the mean TAI 4.0 and VAS across all transfers were 7.58 ± 1.12 and 7.44 ± 1.78, respectively, and scores were significantly correlated (r = 0.52-0.7). VAS scores were more strongly influenced by the flight/landing and body setup phases of the transfer. There were no significant associations between TAI 4.0 score and demographics. Intraclass correlation coefficients (ICC) ranged from 0.80 to 0.85 for interrater reliability, 0.60 to 0.76 for intrarater reliability, and 0.55 to 0.76 for test-retest reliability. The minimum detectable change (MDC) for the total score ranged from 1.02 to 1.30. Conclusion: The TAI 4.0 provides reliable and valid quantitative assessment of an individual's transfer without the need for comprehensive training, as is the case with the TAI 3.0. The tool can be completed in 3 minutes (average) in a clinical setting with only a ruler and goniometer.
| S-EPMC6037322 | biostudies-literature
Project description:BackgroundThe current methods of evaluating cognitive functioning typically rely on a single time point to assess and characterize an individual's performance. However, cognitive functioning fluctuates within individuals over time in relation to environmental, psychological, and physiological contexts. This limits the generalizability and diagnostic utility of single time point assessments, particularly among individuals who may exhibit large variations in cognition depending on physiological or psychological context (eg, those with type 1 diabetes [T1D], who may have fluctuating glucose concentrations throughout the day).ObjectiveWe aimed to report the reliability and validity of cognitive ecological momentary assessment (EMA) as a method for understanding between-person differences and capturing within-person variation in cognition over time in a community sample and sample of adults with T1D.MethodsCognitive performance was measured 3 times a day for 15 days in the sample of adults with T1D (n=198, recruited through endocrinology clinics) and for 10 days in the community sample (n=128, recruited from TestMyBrain, a web-based citizen science platform) using ultrabrief cognitive tests developed for cognitive EMA. Our cognitive EMA platform allowed for remote, automated assessment in participants' natural environments, enabling the measurement of within-person cognitive variation without the burden of repeated laboratory or clinic visits. This allowed us to evaluate reliability and validity in samples that differed in their expected degree of cognitive variability as well as the method of recruitment.ResultsThe results demonstrate excellent between-person reliability (ranging from 0.95 to 0.99) and construct validity of cognitive EMA in both the sample of adults with T1D and community sample. Within-person reliability in both samples (ranging from 0.20 to 0.80) was comparable with that observed in previous studies in healthy older adults. As expected, the full-length baseline and EMA versions of TestMyBrain tests correlated highly with one another and loaded together on the expected cognitive domains when using exploratory factor analysis. Interruptions had higher negative impacts on accuracy-based outcomes (β=-.34 to -.26; all P values <.001) than on reaction time-based outcomes (β=-.07 to -.02; P<.001 to P=.40).ConclusionsWe demonstrated that ultrabrief mobile assessments are both reliable and valid across 2 very different clinic versus community samples, despite the conditions in which cognitive EMAs are administered, which are often associated with more noise and variability. The psychometric characteristics described here should be leveraged appropriately depending on the goals of the cognitive assessment (eg, diagnostic vs everyday functioning) and the population being studied.
| S-EPMC10276323 | biostudies-literature