Metrics and methods in the evaluation of prestige bias in peer review: A case study in computer systems conferences.

ABSTRACT: The integrity of peer review is essential for modern science. Numerous studies have therefore focused on identifying, quantifying, and mitigating biases in peer review. One of these better-known biases is prestige bias, where the recognition of a famous author or affiliation leads reviewers to subconsciously treat their submissions preferentially. A common mitigation approach for prestige bias is double-blind reviewing, where the identify of authors is hidden from reviewers. However, studies on the effectivness of this mitigation are mixed and are rarely directly comparable to each other, leading to difficulty in generalization of their results. In this paper, we explore the design space for such studies in an attempt to reach common ground. Using an observational approach with a large dat

SUBMITTER: Frachtenberg E 

PROVIDER: S-EPMC8880855 | biostudies-literature | 2022

REPOSITORIES: biostudies-literature