Are Experts Well-Calibrated? An Equivalence-Based Hypothesis Test.

ABSTRACT: Estimates based on expert judgements of quantities of interest are commonly used to supplement or replace measurements when the latter are too expensive or impossible to obtain. Such estimates are commonly accompanied by information about the uncertainty of the estimate, such as a credible interval. To be considered well-calibrated, an expert's credible intervals should cover the true (but unknown) values a certain percentage of time, equal to the percentage specified by the expert. To assess expert calibration, so-called calibration questions may be asked in an expert elicitation exercise; these are questions with known answers used to assess and compare experts' performance. An approach that is commonly applied to assess experts' performance by using these questions is to d

SUBMITTER: Dharmarathne G 

PROVIDER: S-EPMC9222732 | biostudies-literature | 2022 May

REPOSITORIES: biostudies-literature