The Cyborg Method: A Method to Identify Fraudulent Responses from Crowdsourced Data.

ABSTRACT: Crowdsourcing is an essential data collection method for psychological research. Concerns about the validity and quality of crowdsourced data persist, however. A recent documented increase in the number of invalid responses within crowdsourced data has highlighted the need for quality control measures. Although a number of approaches are recommended, few have been empirically evaluated. The present study evaluated a Cyborg Method that used automated evaluation of participant meta-data and a review of short answer responses. Two samples were recruited - in the first, the Cyborg Method was applied after data collection to gauge the extent to which invalid responses were collected when a priori quality controls were absent. In the second, the Cyborg Method was applied during data colle

SUBMITTER: Price M 

PROVIDER: S-EPMC11113431 | biostudies-literature | 2024 Aug

REPOSITORIES: biostudies-literature