Dataset Information

CONFIDENT-trial protocol: a pragmatic template for clinical implementation of artificial intelligence assistance in pathology.

ABSTRACT:

Introduction

Artificial intelligence (AI) has been on the rise in the field of pathology. Despite promising results in retrospective studies, and several CE-IVD certified algorithms on the market, prospective clinical implementation studies of AI have yet to be performed, to the best of our knowledge. In this trial, we will explore the benefits of an AI-assisted pathology workflow, while maintaining diagnostic safety standards.

Methods and analysis

This is a Standard Protocol Items: Recommendations for Interventional Trials-Artificial Intelligence compliant single-centre, controlled clinical trial, in a fully digital academic pathology laboratory. We will prospectively include prostate cancer patients who undergo prostate needle biopsies (CONFIDENT-P) and breast cancer patients who undergo a sentinel node procedure (CONFIDENT-B) in the University Medical Centre Utrecht. For both the CONFIDENT-B and CONFIDENT-P trials, the specific pathology specimens will be pseudo-randomised to be assessed by a pathologist with or without AI assistance in a pragmatic (bi-)weekly sequential design. In the intervention group, pathologists will assess whole slide images (WSI) of the standard hematoxylin and eosin (H&E)-stained sections assisted by the output of the algorithm. In the control group, pathologists will assess H&E WSI according to the current clinical workflow. If no tumour cells are identified or when the pathologist is in doubt, immunohistochemistry (IHC) staining will be performed. At least 80 patients in the CONFIDENT-P and 180 patients in the CONFIDENT-B trial will need to be enrolled to detect superiority, allocated as 1:1. Primary endpoint for both trials is the number of saved resources of IHC staining procedures for detecting tumour cells, since this will clarify tangible cost savings that will support the business case for AI.

Ethics and dissemination

The ethics committee (MREC NedMec) waived the need of official ethical approval, since participants are not subjected to procedures nor are they required to follow rules. Results of both trials (CONFIDENT-B and CONFIDENT-P) will be published in scientific peer-reviewed journals.

SUBMITTER: Flach RN

PROVIDER: S-EPMC10254612 | biostudies-literature | 2023 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

CONFIDENT-trial protocol: a pragmatic template for clinical implementation of artificial intelligence assistance in pathology.

Flach Rachel N RN Stathonikos Nikolas N Nguyen Tri Q TQ Ter Hoeve Natalie D ND van Diest Paul J PJ van Dooijeweert Carmen C

BMJ open 20230607 6

<h4>Introduction</h4>Artificial intelligence (AI) has been on the rise in the field of pathology. Despite promising results in retrospective studies, and several CE-IVD certified algorithms on the market, prospective clinical implementation studies of AI have yet to be performed, to the best of our knowledge. In this trial, we will explore the benefits of an AI-assisted pathology workflow, while maintaining diagnostic safety standards.<h4>Methods and analysis</h4>This is a Standard Protocol Item ...[more]

PMID: 37286323

Similar Datasets

Project description:BackgroundFrail older people use emergency services extensively, and digital systems that monitor health remotely could be useful in reducing these visits by earlier detection of worsening health conditions.ObjectiveWe aimed to implement a system that produces alerts when the machine learning algorithm identifies a short-term risk for an emergency department (ED) visit and examine health interventions delivered after these alerts and users' experience. This study highlights the feasibility of the general system and its performance in reducing ED visits. It also evaluates the accuracy of alerts' prediction.MethodsAn uncontrolled multicenter trial was conducted in community-dwelling older adults receiving assistance from home aides (HAs). We implemented an eHealth system that produces an alert for a high risk of ED visits. After each home visit, the HAs completed a questionnaire on participants' functional status, using a smartphone app, and the information was processed in real time by a previously developed machine learning algorithm that identifies patients at risk of an ED visit within 14 days. In case of risk, the eHealth system alerted a coordinating nurse who could then inform the family carer and the patient's nurses or general practitioner. The primary outcomes were the rate of ED visits and the number of deaths after alert-triggered health interventions (ATHIs) and users' experience with the eHealth system; the secondary outcome was the accuracy of the eHealth system in predicting ED visits.ResultsWe included 206 patients (mean age 85, SD 8 years; 161/206, 78% women) who received aid from 109 HAs, and the mean follow-up period was 10 months. The HAs monitored 2656 visits, which resulted in 405 alerts. Two ED visits were recorded following 131 alerts with an ATHI (2/131, 1.5%), whereas 36 ED visits were recorded following 274 alerts that did not result in an ATHI (36/274, 13.4%), corresponding to an odds ratio of 0.10 (95% IC 0.02-0.43; P<.001). Five patients died during the study. All had alerts, 4 did not have an ATHI and were hospitalized, and 1 had an ATHI (P=.04). In terms of overall usability, the digital system was easy to use for 90% (98/109) of HAs, and response time was acceptable for 89% (98/109) of them.ConclusionsThe eHealth system has been successfully implemented, was appreciated by users, and produced relevant alerts. ATHIs were associated with a lower rate of ED visits, suggesting that the eHealth system might be effective in lowering the number of ED visits in this population.Trial registrationclinicaltrials.gov NCT05221697; https://clinicaltrials.gov/ct2/show/NCT05221697.

Project description:Nigeria has the highest reported incidence of peripartum cardiomyopathy worldwide. This open-label, pragmatic clinical trial randomized pregnant and postpartum women to usual care or artificial intelligence (AI)-guided screening to assess its impact on the diagnosis left ventricular systolic dysfunction (LVSD) in the perinatal period. The study intervention included digital stethoscope recordings with point of-care AI predictions and a 12-lead electrocardiogram with asynchronous AI predictions for LVSD. The primary end point was identification of LVSD during the study period. In the intervention arm, the primary end point was defined as the number of identified participants with LVSD as determined by a positive AI screen, confirmed by echocardiography. In the control arm, this was the number of participants with clinical recognition and documentation of LVSD on echocardiography in keeping with current standard of care. Participants in the intervention arm had a confirmatory echocardiogram at baseline for AI model validation. A total of 1,232 (616 in each arm) participants were randomized and 1,195 participants (587 intervention arm and 608 control arm) completed the baseline visit at 6 hospitals in Nigeria between August 2022 and September 2023 with follow-up through May 2024. Using the AI-enabled digital stethoscope, the primary study end point was met with detection of 24 out of 587 (4.1%) versus 12 out of 608 (2.0%) patients with LVSD (intervention versus control odds ratio 2.12, 95% CI 1.05-4.27; P = 0.032). With the 12-lead AI-electrocardiogram model, the primary end point was detected in 20 out of 587 (3.4%) versus 12 out of 608 (2.0%) patients (odds ratio 1.75, 95% CI 0.85-3.62; P = 0.125). A similar direction of effect was observed in prespecified subgroup analysis. There were no serious adverse events related to study participation. In pregnant and postpartum women, AI-guided screening using a digital stethoscope improved the diagnosis of pregnancy-related cardiomyopathy. ClinicalTrials.gov registration: NCT05438576.

Project description:IntroductionLung cancer (LC) is the most common cause of cancer-related deaths worldwide. Its early detection can be achieved with a CT scan. Two large randomised trials proved the efficacy of low-dose CT (LDCT)-based lung cancer screening (LCS) in high-risk populations. The decrease in specific mortality is 20%-25%.Nonetheless, implementing LCS on a large scale faces obstacles due to the low number of thoracic radiologists and CT scans available for the eligible population and the high frequency of false-positive screening results and the long period of indeterminacy of nodules that can reach up to 24 months, which is a source of prolonged anxiety and multiple costly examinations with possible side effects.Deep learning, an artificial intelligence solution has shown promising results in retrospective trials detecting lung nodules and characterising them. However, until now no prospective studies have demonstrated their importance in a real-life setting.Methods and analysisThis open-label randomised controlled study focuses on LCS for patients aged 50-80 years, who smoked more than 20 pack-years, whether active or quit smoking less than 15 years ago. Its objective is to determine whether assisting a multidisciplinary team (MDT) with a 3D convolutional network-based analysis of screening chest CT scans accelerates the definitive classification of nodules into malignant or benign. 2722 patients will be included with the aim to demonstrate a 3-month reduction in the delay between lung nodule detection and its definitive classification into benign or malignant.Ethics and disseminationThe sponsor of this study is the University Hospital of Nice. The study was approved for France by the ethical committee CPP (Comités de Protection des Personnes) Sud-Ouest et outre-mer III (No. 2022-A01543-40) and the Agence Nationale du Medicament et des produits de Santé (Ministry of Health) in December 2023. The findings of the trial will be disseminated through peer-reviewed journals and national and international conference presentations.Trial registration numberNCT05704920.

Project description:Background: Artificial Intelligence (AI) in healthcare has demonstrated high efficiency in academic research, while only few, and predominantly small, real-world AI applications exist in the preventive, diagnostic and therapeutic contexts. Our identification and analysis of success factors for the implementation of AI aims to close the gap between recent years' significant academic AI advancements and the comparably low level of practical application in healthcare. Methods: A literature and real life cases analysis was conducted in Scopus and OpacPlus as well as the Google advanced search database. The according search queries have been defined based on success factor categories for AI implementation derived from a prior World Health Organization survey about barriers of adoption of Big Data within 125 countries. The eligible publications and real life cases were identified through a catalog of in- and exclusion criteria focused on concrete AI application cases. These were then analyzed to deduct and discuss success factors that facilitate or inhibit a broad-scale implementation of AI in healthcare. Results: The analysis revealed three categories of success factors, namely (1) policy setting, (2) technological implementation, and (3) medical and economic impact measurement. For each of them a set of recommendations has been deducted: First, a risk adjusted policy frame is required that distinguishes between precautionary and permissionless principles, and differentiates among accountability, liability, and culpability. Second, a "privacy by design" centered technology infrastructure shall be applied that enables practical and legally compliant data access. Third, the medical and economic impact need to be quantified, e.g., through the measurement of quality-adjusted life years while applying the CHEERS and PRISMA reporting criteria. Conclusions: Private and public institutions can already today leverage AI implementation based on the identified results and thus drive the translation from scientific development to real world application. Additional success factors could include trust-building measures, data categorization guidelines, and risk level assessments and as the success factors are interlinked, future research should elaborate on their optimal interaction to utilize the full potential of AI in real world application.

Dataset Information

CONFIDENT-trial protocol: a pragmatic template for clinical implementation of artificial intelligence assistance in pathology.

Introduction

Methods and analysis

Ethics and dissemination

Publications

CONFIDENT-trial protocol: a pragmatic template for clinical implementation of artificial intelligence assistance in pathology.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets