Dataset Information

Efficiency and workload reduction of semi-automated citation screening software for creating clinical practice guidelines: a prospective observational study.

ABSTRACT:

Background

We evaluated the applicability of automated citation screening in developing clinical practice guidelines.

Methods

We prospectively compared the efficiency of citation screening between the conventional (Rayyan) and semi-automated (ASReview software) methods. We searched the literature for five clinical questions (CQs) in the development of the Japanese Clinical Practice Guidelines for the Management of Sepsis and Septic Shock. Objective measurements of the time required to complete citation screening were recorded. Following the first screening round, in the primary analysis, the sensitivity, specificity, positive predictive value, and overall screening time were calculated for both procedures using the semi-automated tool as index and the results of the conventional method as standard reference. In the secondary analysis, the same parameters were compared between the two procedures using the final list of included studies after the second screening session as standard reference.

Results

Among the five CQs after the first screening session, the highest and lowest sensitivity, specificity, and positive predictive values were 0.241 and 0.795; 0.991 and 1.000; and 0.482 and 0.929, respectively. In the secondary analysis, the highest sensitivity and specificity in the semi-automated citation screening were 1.000 and 0.997, respectively. The overall screening time per 100 studies was significantly shorter with semi-automated than with conventional citation screening.

Conclusions

The potential advantages of the semi-automated method (shorter screening time and higher discriminatory rate for the final list of studies) warrant further validation.

Trial registration

This study was submitted to the University Hospital Medical Information Network Clinical Trial Registry (UMIN-CTR [UMIN000049366]).

SUBMITTER: Oami T

PROVIDER: S-EPMC11230876 | biostudies-literature | 2023 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Efficiency and Workload Reduction of Semi-automated Citation Screening Software for Creating Clinical Practice Guidelines: A Prospective Observational Study.

Oami Takehiko T Okada Yohei Y Sakuraya Masaaki M Fukuda Tatsuma T Shime Nobuaki N Nakada Taka-Aki TA

Journal of epidemiology 20240531 8

<h4>Background</h4>We evaluated the applicability of automated citation screening in developing clinical practice guidelines.<h4>Methods</h4>We prospectively compared the efficiency of citation screening between the conventional (Rayyan) and semi-automated (ASReview software) methods. We searched the literature for five clinical questions (CQs) in the development of the Japanese Clinical Practice Guidelines for the Management of Sepsis and Septic Shock. Objective measurements of the time require ...[more]

PMID: 38105001

Similar Datasets

Project description:BackgroundThe forms of automation available to the oncology pharmacy range from compounding robotic solutions through to combination workflow software, which can scale-up to cover the entire workflow from prescribing to administration. A solution that offers entire workflow management for oncology is desirable because (in terms of cytotoxic delivery of a regimen to a patient) the chain that starts with prescription and the assay of the patient's laboratory results and ends with administration has multiple potential safety gaps and choke points.ObjectiveThe aim of this study was to show how incremental change to a core compounding workflow software solution has helped an organization meet goals of improved patient safety; increasing the number of oncology treatments; improving documentation; and improving communication between oncologists, pharmacists, and nurses. We also aimed to illustrate how using this technology flow beyond the pharmacy has extended medication safety to the patient's bedside through the deployment of a connected solution for confirming and documenting right patient-right medication transactions.MethodsA compounding workflow software solution was introduced for both preparation and documentation, with pharmacist verification of the order, gravimetric checks, and step-by-step on-screen instructions displayed in the work area for the technician. The software supported the technician during compounding by proposing the required drug vial size, diluents, and consumables. Out-of-tolerance concentrations were auto-alerted via an integrated gravimetric scale. A patient-medication label was created. Integration was undertaken between a prescribing module and the compounding module to reduce the risk of transcription errors. The deployment of wireless-connected handheld barcode scanners was then made to allow nurses to use the patient-medication label on each compounded product and to scan patient identification bands to ensure right patient-right prescription.ResultsDespite an increase in compounding, with a growth of 12% per annum and no increase in pharmacy headcount, we doubled our output to 14,000 medications per annum through the application of the compounding solution. The use of a handheld barcode scanning device for nurses reduced the time for medication administration from ≈6 minutes per item to 41 seconds, with a mean average saving of 5 minutes and 19 seconds per item. When calculated against our throughput of 14,000 items per annum (current production rate via pharmacy), this gives a saving of 3 hours and 24 minutes of nursing time per day, equivalent to 0.425 full-time nurses per annum.ConclusionsThe addition of prescribing, compounding, and administration software solutions to our oncology medication chain has increased detection and decreased the risk of error at each stage of the process. The double-checks that the system has built in by virtue of its own systems and through the flow of control of drugs and dosages from physician to pharmacist to nurse allow it to integrate fully with our human systems of risk management.