Dataset Information

Development of a Public-Domain Measure of Two-Dimensional Rotation Ability and Preliminary Evidence for Discriminant Validity among Occupations.

ABSTRACT: Despite their known influence in science, technology, engineering, and mathematics (STEM) fields, spatial abilities remain an underassessed aspect of cognition, particularly in educational settings. One explanation could be a lack of affordable, valid instruments for measuring various aspects of spatial ability. We evaluate the validity of a set of public-domain, algorithmically generated two-dimensional rotation items using a sample from the Synthetic Aperture Personality Assessment (SAPA) Project (N = 1,020,195). We examine the psychometric properties of the items and their relationship with various other cognitive abilities and personality traits. In addition, we identify the highest performing college majors and occupations on the 2D rotation items and on a set of 3D rotation items. Findings suggest strong unidimensionality for the 2D rotation items and the presence of lower-order factors which reflect differences across items in mental rotation demands. The highest scoring majors and occupations were similar-but not identical-across the 2D and 3D rotation measures and point to potentially meaningful differences across areas of expertise.

SUBMITTER: Mather KA

PROVIDER: S-EPMC10607440 | biostudies-literature | 2023 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development of a Public-Domain Measure of Two-Dimensional Rotation Ability and Preliminary Evidence for Discriminant Validity among Occupations.

Mather Kendall A KA Condon David M DM

Journal of Intelligence 20231003 10

Despite their known influence in science, technology, engineering, and mathematics (STEM) fields, spatial abilities remain an underassessed aspect of cognition, particularly in educational settings. One explanation could be a lack of affordable, valid instruments for measuring various aspects of spatial ability. We evaluate the validity of a set of public-domain, algorithmically generated two-dimensional rotation items using a sample from the Synthetic Aperture Personality Assessment (SAPA) Proj ...[more]

PMID: 37888423

Similar Datasets

Project description:BACKGROUND:The majority of stroke survivors experiences significant hand impairments, as weakness and spasticity, with a severe impact on the activity of daily living. To objectively evaluate hand deficits, quantitative measures are needed. The aim of this study is to assess the reliability, the validity and the discriminant ability of the instrumental measures provided by a robotic device for hand rehabilitation, in a sample of patients with subacute stroke. MATERIAL AND METHODS:In this study, 120 patients with stroke and 40 controls were enrolled. Clinical evaluation included finger flexion and extension strength (using the Medical Research Council, MRC), finger spasticity (using the Modified Ashworth Scale, MAS) and motor control and dexterity during ADL performance (by means of the Frenchay Arm Test, FAT). Robotic evaluations included finger flexion and extension strength, muscle tone at rest, and instrumented MAS and Modified Tardieu Scale. Subjects were evaluated twice, one day apart, to assess the test-retest reliability of the robotic measures, using the Intraclass Correlation Coefficient (ICC). To estimate the response stability, the standard errors of measurement and the minimum detectable change (MDC) were also calculated. Validity was assessed by analyzing the correlations between the robotic metrics and the clinical scales, using the Spearman's Correlation Coefficient (r). Finally, we investigated the ability of the robotic measures to distinguish between patients with stroke and healthy subjects, by means of Mann-Whitney U tests. RESULTS:All the investigated measures were able to discriminate patients with stroke from healthy subjects (p < 0.001). Test-retest reliability was found to be excellent for finger strength (in both flexion and extension) and muscle tone, with ICCs higher than 0.9. MDCs were equal to 10.6 N for finger flexion, 3.4 N for finger extension, and 14.3 N for muscle tone. Conversely, test-retest reliability of the spasticity measures was poor. Finally, finger strength (in both flexion and extension) was correlated with the clinical scales (r of about 0.7 with MRC, and about 0.5 with FAT). DISCUSSION:Finger strength (in both flexion and extension) and muscle tone, as provided by a robotic device for hand rehabilitation, are reliable and sensitive measures. Moreover, finger strength is strongly correlated with clinical scales. Changes higher than the obtained MDC in these robotic measures could be considered as clinically relevant and used to assess the effect of a rehabilitation treatment in patients with subacute stroke.

Project description:BackgroundElectronic nicotine delivery systems ("e-cigarettes") are the nicotine product most commonly used by adolescents. Research, treatment, and policy could benefit from measures of adolescent e-cigarette beliefs about outcomes of use (ie, expectancies). In the current study, we developed and tested an adolescent electronic nicotine vaping expectancy measure.MethodsA focus group with adolescents evaluated potential e-cigarette expectancy items. A panel of national experts assisted in revision of these items. Finally, items were administered to a sample of adolescents 14-17 years old (N = 267, Mean age 15.6, SD = 1.1, 50.9% Female, 50.2% Non-Hispanic White, 22.5% Non-Hispanic Black, 14.2% Hispanic) in a large Southeastern metropolitan area in the United States.ResultsExploratory Factor Analysis revealed a four factor solution: Negative Consequences (Cronbach's α = .92); Positive Reinforcement (α = .83); Negative Affect Reduction (α = .95); and Weight Control (α = .89). Subscales were significantly correlated with vaping susceptibility and lifetime vaping. Subscales successfully differentiated susceptible adolescents from confirmed non-susceptible adolescents, with susceptible adolescents reporting more positive expectancies, eg, Positive Reinforcement, M = 5.0, SD = 2.0 vs M = 3.0, SD = 2.1, P < .001, η2 = 0.19, and less negative expectancies, M = 5.5, SD = 2.3 vs M = 6.5, SD = 2.6, P = .001, η2 = 0.04. Similar results were found comparing adolescents who have never vaped nicotine with those who have vaped nicotine. Hierarchical linear regression demonstrated subscales were significant predictors of lifetime vaping after controlling for demographics, vaping ad exposure, and peer/family vaping.ConclusionsA preliminary version of an adolescent expectancy measure appears reliable and valid based on expert input and pilot testing with adolescents. Promising results were found in the domains of concurrent validity, discriminant validity, and incremental validity. Future research and evaluation efforts will be able to use this tool to further prevention and treatment goals.

Project description:BackgroundIn the last few years, there has been an increasing interest in the use of robotic devices to objectively quantify motor performance of patients after brain damage. Although these robot-derived measures can potentially add meaningful information about the patient's dexterity, as well as be used as outcome measurements after the rehabilitation treatment, they need to be validated before being used in clinical practice. The present work aims to evaluate the reliability, the validity and the discriminant ability of the metrics provided by a novel robotic device for upper limb rehabilitation.MethodsForty-eight patients with sub-acute stroke and 40 age-matched healthy subjects were involved in this study. Clinical evaluation included: Fugl-Meyer Assessment for the upper limb, Action Research Arm Test, and Barthel Index. Robotic evaluation of the upper limb performance consisted of 14 measures of motor ability quantifying the dexterity in performing planar reaching movements. Patients were evaluated twice, one day apart, to assess the reliability of the robotic metrics, using the Intraclass Correlation Coefficient. Validity was assessed by analyzing the correlation of the robotic metrics with the clinical scales, by means of the Spearman's Correlation Coefficient. Finally, the ability of the robotic metrics to distinguish between patients with stroke and healthy subjects was investigated with t-tests and the Effect Size.ResultsReliability was found to be excellent for 12 measures and from moderate to good for the remaining 2. Most of the robotic indices were strongly correlated with the clinical scales, while a few showed a moderate correlation and only one was not correlated with the Barthel Index and weakly correlated with the remain two. Finally, all but one the provided metrics were able to discriminate between the two groups, with large effect sizes for most of them.ConclusionWe found that all the robotic indices except one provided by a novel robotic device for upper limb rehabilitation are reliable, sensitive and strongly correlated both with motor and disability clinical scales. Therefore, this device is suitable as evaluation tool for the upper limb motor performance of patients with sub-acute stroke in clinical practice.Trial registrationNCT02879279 .

Project description:INTRODUCTION:This study developed a new Professional Decision-Making in Medicine Measure that assesses the use of effective decision-making strategies: seek help, manage emotions, recognize consequences and rules, and test assumptions and motives. The aim was to develop a content valid measure and obtain initial evidence for construct validity so that the measure could be used in future research or educational assessment. METHODS:Clinical scenario-based items were developed based on a review of the literature and interviews with physicians. For each item, respondents are tasked with selecting two responses (out of six plausible options) that they would choose in that situation. Three of the six options reflect a decision-making strategy; these responses are scored as correct. Data were collected from a sample of 318 fourth-year medical students in the United States. They completed a 16-item version of the measure (Form A) and measures of social desirability, moral disengagement, and professionalism attitudes. Professionalism ratings from clerkships were also obtained. A sub-group (n = 63) completed a second 16-item measure (Form B) to pilot test the instrument, as two test forms are useful for pre-posttest designs. RESULTS:Scores on the new measure indicated that, on average, participants answered 75% of items correctly. Evidence for construct validity included the lack of correlation between scores on the measure and socially desirable responding, negative correlation with moral disengagement, and modest to low correlations with professionalism attitudes. A positive correlation was observed with a clerkship rating focused on professionalism in peer interactions. CONCLUSIONS:These findings demonstrate modest proficiency in the use of decision-making strategies among fourth-year medical students. Additional research using the Professional Decision-Making Measure should explore scores among physicians in various career stages, and the causes and correlates of scores. Educators could utilize the measure to assess courses that teach decision-making strategies.

Project description:BackgroundSedentary Behaviour (SB) gets an increasing attention from ergonomics and public health due to its associated detrimental health effects. A large number of studies record SB with ActiGraph counts-per-minute cut-points, but we still lack valid information about what the cut-points tell us about office work. This study therefore analysed the concurrent and discriminant validity of commonly used cut-points to measure SB, activity level, and posture.MethodsThirty office workers completed four office tasks at three workplaces (conventional chair, activity-promoting chair, and standing desk) while wearing two ActiGraphs (waist and wrist). Indirect calorimetry and prescribed posture served as reference criteria. Generalized Estimation Equations analysed workplace and task effects on the activity level and counts-per-minute, and kappa statistics and ROC curves analysed the cut-point validity.ResultsThe activity-promoting chair (p < 0.001, ES ≥ 0.66) but not the standing desk (p = 1.0) increased the activity level, and both these workplaces increased the waist (p ≤ 0.003, ES ≥ 0.63) but not the wrist counts-per-minute (p = 0.74) compared to the conventional chair. The concurrent and discriminant validity was higher for activity level (kappa: 0.52-0.56 and 0.38-0.45, respectively) than for SB and posture (kappa ≤0.35 and ≤ 0.19, respectively). Furthermore, the discriminant validity for activity level was higher for task effects (kappa: 0.42-0.48) than for workplace effects (0.13-0.24).ConclusionsActiGraph counts-per-minute for waist and wrist placement were - independently of the chosen cut-point - a measure for activity level and not for SB or posture, and the cut-points performed better to detect task effects than workplace effects. Waist cut-points were most valid to measure the activity level in conventional seated office work, but they showed severe limitations for sit-stand desks. None of the placements was valid to detect the increased activity on the activity-promoting chair. Caution should therefore be paid when analysing the effect of workplace interventions on activity level with ActiGraph waist and wrist cut-points.

Dataset Information

Development of a Public-Domain Measure of Two-Dimensional Rotation Ability and Preliminary Evidence for Discriminant Validity among Occupations.

Publications

Development of a Public-Domain Measure of Two-Dimensional Rotation Ability and Preliminary Evidence for Discriminant Validity among Occupations.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets