Argument mining as rapid screening tool of COVID-19 literature quality: Preliminary evidence.

ABSTRACT:

Background

The COVID-19 pandemic prompted the scientific community to share timely evidence, also in the form of pre-printed papers, not peer reviewed yet.

Purpose

To develop an artificial intelligence system for the analysis of the scientific literature by leveraging on recent developments in the field of Argument Mining.

Methodology

Scientific quality criteria were borrowed from two selected Cochrane systematic reviews. Four independent reviewers gave a blind evaluation on a 1-5 scale to 40 papers for each review. These scores were matched with the automatic analysis performed by an AM system named MARGOT, which detected claims and supporting evidence for the cited papers. Outcomes were evaluated with inter-rater indices (Cohen's Kappa, Krippendorff's Alpha, s^*

SUBMITTER: Brambilla G 

PROVIDER: S-EPMC9339778 | biostudies-literature | 2022

REPOSITORIES: biostudies-literature