Prospective Evaluation of Adverse Event Recognition Systems in Twitter: Results from the Web-RADR Project.

ABSTRACT:

Introduction

A large number of studies on systems to detect and sometimes normalize adverse events (AEs) in social media have been published, but evidence of their practical utility is scarce. This raises the question of the transferability of such systems to new settings.

Objectives

The aims of this study were to develop an AE recognition system, prospectively evaluate its performance on an external benchmark dataset and identify potential factors influencing the transferability of AE recognition systems.

Methods

A pipeline based on dictionary lookups and logistic regression classifiers was developed using a proprietary dataset of 196,533 Tweets manually annotated for AE relations and prospectively evaluated the system on the publicly available WEB-RADR reference dat

SUBMITTER: Gattepaille LM 

PROVIDER: S-EPMC7395913 | biostudies-literature | 2020 Aug

REPOSITORIES: biostudies-literature