A randomized controlled trial on anonymizing reviewers to each other in peer review discussions.

ABSTRACT: Many peer-review processes involve reviewers submitting their independent reviews, followed by a discussion between the reviewers of each paper. A common question among policymakers is whether the reviewers of a paper should be anonymous to each other during the discussion. We shed light on this question by conducting a randomized controlled trial at the Conference on Uncertainty in Artificial Intelligence (UAI) 2022 conference where reviewer discussions were conducted over a typed forum. We randomly split the reviewers and papers into two conditions-one with anonymous discussions and the other with non-anonymous discussions. We also conduct an anonymous survey of all reviewers to understand their experience and opinions. We compare the two conditions in terms of the amount of discussion,

SUBMITTER: Rastogi C 

PROVIDER: S-EPMC11676492 | biostudies-literature | 2024

REPOSITORIES: biostudies-literature