Evidence that nonsignificant results are sometimes preferred: Reverse P-hacking or selective reporting?

ABSTRACT: There is increased concern about poor scientific practices arising from an excessive focus on P-values. Two particularly worrisome practices are selective reporting of significant results and 'P-hacking'. The latter is the manipulation of data collection, usage, or analyses to obtain statistically significant outcomes. Here, we introduce the novel, to our knowledge, concepts of selective reporting of nonsignificant results and 'reverse P-hacking' whereby researchers ensure that tests produce a nonsignificant result. We test whether these practices occur in experiments in which researchers randomly assign subjects to treatment and control groups to minimise differences in confounding variables that might affect the focal outcome. By chance alone, 5% of tests for a group difference in confou

SUBMITTER: Chuard PJC 

PROVIDER: S-EPMC6364929 | biostudies-literature | 2019 Jan

REPOSITORIES: biostudies-literature