Information-Theoretic Measures of Metacognition: Bounds and Relation to Group Performance.

ABSTRACT: Metacognition comprises the ability to differentiate the accuracy of predictions about the world. This is often called Type 2 performance (with Type 1 performance being the overall accuracy). Typical measures of metacognition are based on signal detection theory and require the strong assumption of truncated normal noise underlying confidence ratings. To minimize distributional assumptions, measures based on classical information theory have been proposed. We further this approach by providing bounds on its key quantity, the transmitted information. We show that classifiers making predictions with a certain accuracy can transmit information only within a limited range, depending on the underlying noise distribution: The lowest transmitted information indicates the worst Type 2 performance

SUBMITTER: Meyen S 

PROVIDER: S-EPMC12618015 | biostudies-literature | 2025

REPOSITORIES: biostudies-literature