Judgment aggregation, discursive dilemma and reflective equilibrium: Neural language models as self-improving doxastic agents.
Ontology highlight
ABSTRACT: Neural language models (NLMs) are susceptible to producing inconsistent output. This paper proposes a new diagnosis as well as a novel remedy for NLMs' incoherence. We train NLMs on synthetic text corpora that are created by simulating text production in a society. For diagnostic purposes, we explicitly model the individual belief systems of artificial agents (authors) who produce corpus texts. NLMs, trained on those texts, can be shown to aggregate the judgments of individual authors during pre-training according to sentence-wise vote ratios (roughly, reporting frequencies), which inevitably leads to so-called discursive dilemmas: aggregate judgments are inconsistent even though all individual belief states are consistent. As a remedy for such inconsistencies, we develop a self-training p
SUBMITTER: Betz G
PROVIDER: S-EPMC9623417 | biostudies-literature | 2022
REPOSITORIES: biostudies-literature
ACCESS DATA