Dataset Information

Assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics.

ABSTRACT: Reproducible research serves as a pillar of the scientific method and is a foundation for scientific advancement. However, estimates for irreproducibility of preclinical science range from 75% to 90%. The importance of reproducible science has not been assessed in the context of mechanics-based modeling of human joints such as the knee, despite this being an area that has seen dramatic growth. Framed in the context of five experienced teams currently documenting knee modeling procedures, the aim of this study was to evaluate reporting and the perceived potential for reproducibility across studies the teams viewed as important contributions to the literature. A cohort of studies was selected by polling, which resulted in an assessment of nine studies as opposed to a broader analysis across the literature. Using a published checklist for reporting of modeling features, the cohort was evaluated for both "reporting" and their potential to be "reproduced," which was delineated into six major modeling categories and three subcategories. Logistic regression analysis revealed that for individual modeling categories, the proportion of "reported" occurrences ranged from 0.31, 95% confidence interval (CI) [0.23, 0.41] to 0.77, 95% CI: [0.68, 0.86]. The proportion of whether a category was perceived as "reproducible" ranged from 0.22, 95% CI: [0.15, 0.31] to 0.44, 95% CI: [0.35, 0.55]. The relatively low ratios highlight an opportunity to improve reporting and reproducibility of knee modeling studies. Ongoing efforts, including our findings, contribute to a dialogue that facilitates adoption of practices that provide both credibility and translation possibilities.

SUBMITTER: Halloran JP

PROVIDER: S-EPMC9630164 | biostudies-literature | 2023 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics.

Halloran Jason P JP Abdollahi Nohouji Neda N Hafez Mhd A MA Besier Thor F TF Chokhandre Snehal K SK Elmasry Shady S Hume Donald R DR Imhauser Carl W CW Rooks Nynke B NB Schneider Marco T Y MTY Schwartz Ariel A Shelburne Kevin B KB Zaylor William W Erdemir Ahmet A

Journal of orthopaedic research : official publication of the Orthopaedic Research Society 20220522 2

Reproducible research serves as a pillar of the scientific method and is a foundation for scientific advancement. However, estimates for irreproducibility of preclinical science range from 75% to 90%. The importance of reproducible science has not been assessed in the context of mechanics-based modeling of human joints such as the knee, despite this being an area that has seen dramatic growth. Framed in the context of five experienced teams currently documenting knee modeling procedures, the aim ...[more]

PMID: 35502762

Similar Datasets

Project description:Spatial transcriptomics is a rapidly advancing field, yet it lacks standardized metrics for evaluating imaging-based in situ hybridization technologies. In this study, we emphasize the importance of rigorous experimental design and standardized operating procedures (SOPs) in defining performance metrics across multiple modalities—from single-cell to spatial transcriptomics to spatial proteomics. Our Spatial Touchstone (ST) dataset, generated from six tissue types across three global sites (n=76 assays), provides a comprehensive evaluation of reproducibility, sensitivity, dynamic ranges, signal-to-noise ratio, false discovery rates, cell type annotation, and congruence with single-cell profiling. Using single-nucleus RNA sequencing (snRNA-seq) on the same formalin-fixed paraffin-embedded tissues, we created a reference for transcriptional profiles to assess cellular organization and biomarker localization. In the absence of an independent 'gold standard’ in the field, this study provides an objective assessment of technical performance through standardized protocols, Spatial Touchstone Protocols (STSOP). Our open-source software, SpatialQC, allows users to evaluate samples across all technical metrics and directly impute cell annotations from single-cell datasets. This study features the largest imaging-based spatial transcriptomics data repository available, with a total of 203 spatial profiles. It incorporates both public (n=127) and ST datasets (n=76) through the Spatial Touchstone Portal (STP), available at www.spatialtouchstone.org. This resource offers users easy access to analyze and compare their own data against an extensive collection of imaging-based datasets. We show that the ST datasets demonstrate high reproducibility (r=0.93 to 1.0) and set a new benchmark for the field. Finally, we establish metrics to evaluate and integrate imaging based multi omics data from single cell into spatial transcriptomics to spatial proteomics. The ST project provides a comprehensive, reproducible assessment across platforms and sites, establishing essential standards for imaging-based spatial multi omics (transcriptomics and proteomics) and paving the way for future research and technological advancements.

Project description:BackgroundAn athlete who returns to sport after an anterior cruciate ligament (ACL) injury has a substantially high risk of sustaining a new secondary ACL injury. Because ACL injuries most frequently occur during cutting maneuvers, such movements should be at the center of research attention.PurposeTo investigate whether knee biomechanical parameters during side-step cutting maneuvers differ between female elite athletes with and without a history of ACL injury and to evaluate whether such parameters are associated with future secondary ACL injury.Study designCohort study; Level of evidence, 2.MethodsA total of 756 female elite handball and soccer players, of whom 76 had a history of ACL injury, performed a sport-specific cutting task while 3-dimensional kinematics and kinetics were measured. ACL injuries were registered prospectively over an 8-year follow-up period. Seven knee-specific biomechanical variables were the basis for all analyses. Two-way analyses of variance were applied to assess group differences, whereas logistic regression models served to evaluate associations between the knee-specific variables and future secondary ACL injury.ResultsWhen players with a previous ACL injury performed the cutting maneuver with their ipsilateral leg, they exhibited lower knee abduction angles (mean difference [MD], 1.4°-1.5°; 95% CI, 0.2°-2.9°), lower peak knee flexion moments (MD, 0.33 N·m/kg-1; 95% CI, 0.18-0.48 N·m/kg-1), lower peak knee abduction moments (MD, 0.27 N·m/kg-1; 95% CI, 0.12-0.41 N·m/kg-1), and lower peak knee internal rotation moments (MD, 0.06 N·m/kg-1; 95% CI, 0.01-0.12 N·m/kg-1) compared with injury-free players. When players performed the cut with their contralateral leg, no differences were evident (P < .05). None of the 7 knee-specific biomechanical variables was associated with future secondary ACL injury in players with an ACL injury history (P < .05).ConclusionApproximately 4 years after ACL injury, female elite team-ball athletes still unloaded their ipsilateral knee during cutting maneuvers, yet contralateral knee loading was similar to that of injury-free players. Knee biomechanical characteristics were not associated with future secondary ACL injury.

Dataset Information

Assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics.

Publications

Assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets