Ease of adoption of clinical natural language processing software: An evaluation of five systems.

ABSTRACT:

Objective

In recognition of potential barriers that may inhibit the widespread adoption of biomedical software, the 2014 i2b2 Challenge introduced a special track, Track 3 - Software Usability Assessment, in order to develop a better understanding of the adoption issues that might be associated with the state-of-the-art clinical NLP systems. This paper reports the ease of adoption assessment methods we developed for this track, and the results of evaluating five clinical NLP system submissions.

Materials and methods

A team of human evaluators performed a series of scripted adoptability test tasks with each of the participating systems. The evaluation team consisted of four "expert evaluators" with training in computer science, and eight "end user evaluators" with mixed backg

SUBMITTER: Zheng K 

PROVIDER: S-EPMC4974203 | biostudies-literature | 2015 Dec

REPOSITORIES: biostudies-literature