Performance evaluation of human cough annotators: optimal metrics and sex differences.

ABSTRACT:

Introduction

Despite its high prevalence and significance, there is still no widely available method to quantify cough. In order to demonstrate agreement with the current gold standard of human annotation, emerging automated techniques require a robust, reproducible approach to annotation. We describe the extent to which a human annotator of cough sounds (a) agrees with herself (intralabeller or intrarater agreement) and (b) agrees with other independent labellers (interlabeller or inter-rater agreement); we go on to describe significant sex differences in cough sound length and epochs size.

Materials and methods

24 participants wore an audiorecording smartwatch to capture 6-24 hours of continuous audio. A randomly selected sample of the whole audio was labelled twice by an

SUBMITTER: Sanchez-Olivieri I 

PROVIDER: S-EPMC10649781 | biostudies-literature | 2023 Nov

REPOSITORIES: biostudies-literature