Dataset Information

Insufficient reporting of experimental variables as a cause for nonreproducibility in animal physiology? A case study.

ABSTRACT: Nonreproducibility in scientific investigations has been explained by inadequately reporting methodology, honest error, and even misconduct. We hypothesized that, within the field of animal physiology, the most parsimonious explanation for nonreproducibility is inadequate reporting of key methodological details. We further hypothesized that implementation of relatively recently released reporting guidelines has positively impacted journal article quality, as measured by completeness of the methodology descriptions. We analyzed 84 research articles published in five primarily organismal animal physiology journals in 2008-2010 (generally before current guidelines) and 2018-2020. Compliance for reporting 34 variables referring to biology, experiments, and data collection was assessed. Reporting compliance was just ∼61% in 2008-2010, rising only slightly to 67.5% for 2018-2020. Only 21% of the reported variables showed significant differences across the period from 2008-2020. We conclude that, despite attempts by societies and journals to promote greater reporting compliance, such efforts have so far been relatively unsuccessful in the field of animal physiology.

SUBMITTER: Gopel T

PROVIDER: S-EPMC9467468 | biostudies-literature | 2022 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Insufficient reporting of experimental variables as a cause for nonreproducibility in animal physiology? A case study.

Göpel Torben T Burggren Warren W WW

American journal of physiology. Regulatory, integrative and comparative physiology 20220711 3

Nonreproducibility in scientific investigations has been explained by inadequately reporting methodology, honest error, and even misconduct. We hypothesized that, within the field of animal physiology, the most parsimonious explanation for nonreproducibility is inadequate reporting of key methodological details. We further hypothesized that implementation of relatively recently released reporting guidelines has positively impacted journal article quality, as measured by completeness of the metho ...[more]

PMID: 35816721

Similar Datasets

Project description:Lack of translation and irreproducibility challenge preclinical animal research. Insufficient reporting methodologies to safeguard study quality is part of the reason. This nationwide study investigates the reporting prevalence of these methodologies and scrutinizes the reported information's level of detail. Publications were from two time periods to convey any reporting progress and had at least one author affiliated to a Danish University. We retrieved all relevant animal experimental studies using a predefined research protocol and a systematic search. A random sampling of 250 studies from 2009 and 2018 led to 500 publications in total. Reporting of measures known to impact study results estimates were assessed. Part I discloses a simplified two-level scoring "yes/no" to identify the presence of reporting. Part II demonstrates an additional three-level scoring to analyze the reported information's level of detail. Overall reporting prevalence is low, although minor improvements are noted. Reporting of randomization increased from 24.0% in 2009 to 40.8% in 2018, blinded experiment conduct from 2.4% to 4.4%, blinded outcome assessment from 23.6% to 38.0%, and sample size calculation from 3.2% to 14.0%. Poor reporting of details is striking with reporting of the random allocation method to groups being only 1.2% in 2009 and 6.0% in 2018. Reporting of sample size calculation method was 2.4% in 2009 and 7.6% in 2018. Only conflict-of-interest statements reporting increased from 37.6% in 2009 to 90.4%. Measures safeguarding study quality are poorly reported in publications affiliated with Danish research institutions. Only a modest improvement was noted during the period 2009-2018, and the lack of details urgently prompts institutional strategies to accelerate this. We suggest thorough teaching in designing, conducting and reporting animal studies. Education in systematic review methodology should be implemented in this training and will increase motivation and behavior working towards quality improvements in science.

Project description:ObjectiveTo investigate the awareness and use of the Systematic Review Center for Laboratory Animal Experimentation's (SYRCLE) risk-of-bias tool, the Animal Research: Reporting of In Vivo Experiments (ARRIVE) reporting guidelines, and Gold Standard Publication Checklist (GSPC) in China in basic medical researchers of animal experimental studies.MethodsA national questionnaire-based survey targeting basic medical researchers was carried in China to investigate the basic information and awareness of SYRCLE's risk of bias tool, ARRIVE guidelines, GSPC, and animal experimental bias risk control factors. The EpiData3.1 software was used for data entry, and Microsoft Excel 2013 was used for statistical analysis in this study. The number of cases (n) and percentage (%) of classified information were statistically described, and the comparison between groups (i.e., current students vs. research staff) was performed using chi-square test.ResultsA total of 298 questionnaires were distributed, and 272 responses were received, which included 266 valid questionnaires (from 118 current students and 148 research staff). Among the 266 survey participants, only 15.8% was aware of the SYRCLE's risk of bias tool, with significant difference between the two groups (P = 0.003), and the awareness rates of ARRIVE guidelines and GSPC were only 9.4% and 9.0%, respectively; 58.6% survey participants believed that the reports of animal experimental studies in Chinese literature were inadequate, with significant difference between the two groups (P = 0.004). In addition, only approximately 1/3 of the survey participants had read systematic reviews and meta-analysis reports of animal experimental studies; only 16/266 (6.0%) had carried out/participated in and 11/266 (4.1%) had published systematic reviews/meta-analysis of animal experimental studies.ConclusionsThe awareness and use rates of SYRCLE's risk-of-bias tool, the ARRIVE guidelines, and the GSPC were low among Chinese basic medical researchers. Therefore, specific measures are necessary to promote and popularize these standards and specifications and to introduce these standards into guidelines of Chinese domestic journals as soon as possible to raise awareness and increase use rates of researchers and journal editors, thereby improving the quality of animal experimental methods and reports.

Dataset Information

Insufficient reporting of experimental variables as a cause for nonreproducibility in animal physiology? A case study.

Publications

Insufficient reporting of experimental variables as a cause for nonreproducibility in animal physiology? A case study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets