Calibrating Structured Output Predictors for Natural Language Processing.

ABSTRACT: We address the problem of calibrating prediction confidence for output entities of interest in natural language processing (NLP) applications. It is important that NLP applications such as named entity recognition and question answering produce calibrated confidence scores for their predictions, especially if the applications are to be deployed in a safety-critical domain such as healthcare. However, the output space of such structured prediction models is often too large to adapt binary or multi-class calibration methods directly. In this study, we propose a general calibration scheme for output entities of interest in neural network based structured prediction models. Our proposed method can be used with any binary class calibration scheme and a neural network model. Additionally, we sho

SUBMITTER: Jagannatha A 

PROVIDER: S-EPMC7890517 | biostudies-literature | 2020 Jul

REPOSITORIES: biostudies-literature