Dataset Information

Do Prospective Intent and Established Metrics Correlate with Journal Impact Factor in Musculoskeletal Physical Therapy Trials?: A Secondary Analysis of A Methodological Review.

ABSTRACT:

Objectives

To determine if there are any statistically significant associations between: 1) randomized clinical trials (RCTs) investigating physical therapy musculoskeletal interventions, 2) journal impact factor (JIF), 3) frequency of RCT citation, 4) whether prospective intent was identifiable, and 5) the Physiotherapy Evidence Database (PEDro) scores.

Methods

MEDLINE indexed RCTs addressing musculoskeletal interventions published between January 2016 and July 2020 in physical therapy journals were included. Two blinded reviewers identified the RCTs and extracted the variables of interest.

Results

With a familywise alpha adjustment, there was no statistically significant correlation between JIF and number of citations (rho = 0.187; p = 0.0280). Statistically significant weak positive correlations were identified between the JIF and prospectively registered RCTs (rho = 0.240; p = 0.0046), JIF and PEDro scores (rho = 0.250; p = 0.0031), and PEDro scores and prospectively registered RCTs (rho = 0.335; p < 0.0001).

Conclusion

The findings of this study suggest that JIF and PEDro scores may not be accurate measures of RCT quality. Failing to ensure that published RCTs followed their prospective intent and using bibliometrics that fail to accurately measure what they propose appears to create untrustworthy preprocessed resources for practicing physical therapists during the evidence-based practice process.

Level of evidence

1a.

SUBMITTER: Riley SP

PROVIDER: S-EPMC9487961 | biostudies-literature | 2022 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Do Prospective Intent and Established Metrics Correlate with Journal Impact Factor in Musculoskeletal Physical Therapy Trials?: A Secondary Analysis of A Methodological Review.

Riley Sean P SP Swanson Brian T BT Shaffer Stephen M SM Sawyer Steven F SF Cleland Joshua A JA

The Journal of manual & manipulative therapy 20220221 5

<h4>Objectives</h4>To determine if there are any statistically significant associations between: 1) randomized clinical trials (RCTs) investigating physical therapy musculoskeletal interventions, 2) journal impact factor (JIF), 3) frequency of RCT citation, 4) whether prospective intent was identifiable, and 5) the Physiotherapy Evidence Database (PEDro) scores.<h4>Methods</h4>MEDLINE indexed RCTs addressing musculoskeletal interventions published between January 2016 and July 2020 in physical t ...[more]

PMID: 35188881

Similar Datasets

Project description:BackgroundIn a stepped wedge design, schools are randomised to a sequence of measurements, with each sequence transitioning to intervention status at a different time. There are several advantages to such designs, including increased statistical power, logistical benefits and the ability to explore change over time. However, stepped wedge designs have not previously been used to evaluate school-based physical activity interventions in children. This paper aimed to explore the feasibility of this design, by identifying school constraints, balancing these with statistical considerations and exploring the power of this chosen design under different scenarios.MethodsWe conducted three interlinked studies, with the results from one informing the next. Study 1 was a qualitative study to identify school constraints that inform the choice of stepped wedge configuration. Study 2 used simulation to choose a configuration that balanced these school constraints and statistical properties. Study 3 explored the statistical power for the chosen design for different school and pupil sample sizes, using an open cohort design (a mixture of new and repeated pupils).ResultsSchool staff considered the proposed data collection feasible, and supported a maximum of 3-4 measurements per year and an implementation period of one school term. Study 2 therefore considered incomplete stepped wedge designs with five steps. Statistically, the best designs had a mix of control and intervention measurements in terms 2-4 and a spread of measurements across the whole study duration. Power depended on a combination of the overall recruitment rate and the retention rate. For 20 schools with an eligible class size of 30 pupils, we would be able to detect a 6 min difference in average weekday moderate-to-vigorous physical activity with 80% power, provided there were > 50% of pupils measured per school at each time. A similarly powered cluster randomised controlled trial would require 42 schools.ConclusionStepped wedge trials are a viable design for evaluating school-based physical activity interventions. Incomplete designs, where not all schools are measured at each point, offer the flexibility to work around practical constraints.

Project description:BackgroundPhysical activity (PA) is reduced in persons with multiple sclerosis (MS), though it is known to aid in symptom and fatigue management. Methods for measuring PA are diverse and the impact of this heterogeneity on study outcomes is unclear. We aimed to clarify this impact by comparing common methods for deriving PA metrics in MS populations.MethodsFirst, a rapid review of existing literature identified methods for calculating PA in studies which used the Actigraph GT3X in populations with MS. We then compared methods in a prospective study on 42 persons with MS [EDSS 4.5 (3.5-6)] during a voluntary course of inpatient neurorehabilitation. Mixed-effects linear regression identified methodological factors which influenced PA measurements. Non-parametric hypothesis tests, correlations, and agreement statistics assessed overall and pairwise differences between methods.ResultsIn the rapid review, searches identified 421 unique records. Sixty-nine records representing 51 eligible studies exhibited substantial heterogeneity in methodology and reporting practices. In a subsequent comparative study, multiple methods for deriving six PA metrics (step count, activity counts, total time in PA, sedentary time, time in light PA, time in moderate to vigorous PA), were identified and directly compared. All metrics were sensitive to methodological factors such as the selected preprocessing filter, data source (vertical vs. vector magnitude counts), and cutpoint. Additionally, sedentary time was sensitive to wear time definitions. Pairwise correlation and agreement between methods varied from weak (minimum correlation: 0.15, minimum agreement: 0.03) to perfect (maximum correlation: 1.00, maximum agreement: 1.00). Methodological factors biased both point estimates of PA and correlations between PA and clinical assessments.ConclusionsMethodological heterogeneity of existing literature is high, and this heterogeneity may confound studies which use the Actigraph GT3X. Step counts were highly sensitive to the filter used to process raw accelerometer data. Sedentary time was particularly sensitive to methodology, and we recommend using total time in PA instead. Several, though not all, methods for deriving light PA and moderate to vigorous PA yielded nearly identical results. PA metrics based on vertical axis counts tended to outperform those based on vector magnitude counts. Additional research is needed to establish the relative validity of existing methods.

Dataset Information

Do Prospective Intent and Established Metrics Correlate with Journal Impact Factor in Musculoskeletal Physical Therapy Trials?: A Secondary Analysis of A Methodological Review.

Objectives

Methods

Results

Conclusion

Level of evidence

Publications

Do Prospective Intent and Established Metrics Correlate with Journal Impact Factor in Musculoskeletal Physical Therapy Trials?: A Secondary Analysis of A Methodological Review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets