A benchmark dataset for evaluating gender sensitivity in Korean political discourse with large language models.

ABSTRACT: Large language models are increasingly applied to political discourse, but their ability to detect culturally grounded gender sensitivity remains underexplored. We introduce KOGENT, a benchmark dataset of 1,222 transcripts from the Korean National Assembly, annotated for gender sensitivity across 6,024 utterances. Each utterance is labeled as high or low in gender sensitivity, based on contextual indicators of bias, discrimination, or inclusion, and tagged for the target group. KOGENT spans Korean legislative sessions from 1948 to 2024. Annotation reliability was ensured through dual coding and adjudication, yielding high intercoder agreement. When tasked with labeling utterances by gender sensitivity, GPT-4.1 achieved F1-scores of 87.5% (zero-shot) and 91.2% (18-shot), while GPT-4o reache

SUBMITTER: Park S 

PROVIDER: S-EPMC12808084 | biostudies-literature | 2025 Dec

REPOSITORIES: biostudies-literature