Crowdsourcing as a screening tool to detect clinical features of glaucomatous optic neuropathy from digital photography.

ABSTRACT:

Aim

Crowdsourcing is the process of simplifying and outsourcing numerous tasks to many untrained individuals. Our aim was to assess the performance and repeatability of crowdsourcing in the classification of normal and glaucomatous discs from optic disc images.

Methods

Optic disc images (N = 127) with pre-determined disease status were selected by consensus agreement from grading experts from a large cohort study. After reading brief illustrative instructions, we requested that knowledge workers (KWs) from a crowdsourcing platform (Amazon MTurk) classified each image as normal or abnormal. Each image was classified 20 times by different KWs. Two study designs were examined to assess the effect of varying KW experience and both study designs were conducted twice for consisten

SUBMITTER: Mitry D 

PROVIDER: S-EPMC4334897 | biostudies-literature | 2015

REPOSITORIES: biostudies-literature