Reanalyzing Head et al. (2015): investigating the robustness of widespread p-hacking.

ABSTRACT: Head et al. (2015) provided a large collection of p-values that, from their perspective, indicates widespread statistical significance seeking (i.e., p-hacking). This paper inspects this result for robustness. Theoretically, the p-value distribution should be a smooth, decreasing function, but the distribution of reported p-values shows systematically more reported p-values for .01, .02, .03, .04, and .05 than p-values reported to three decimal places, due to apparent tendencies to round p-values to two decimal places. Head et al. (2015) correctly argue that an aggregate p-value distribution could show a bump below .05 when left-skew p-hacking occurs frequently. Moreover, the elimination of p = .045 and p = .05, a

SUBMITTER: Hartgerink CH 

PROVIDER: S-EPMC5337083 | biostudies-literature | 2017

REPOSITORIES: biostudies-literature