Dataset Information

Deep Learning-Based Pain Classifier Based on the Facial Expression in Critically Ill Patients.

ABSTRACT:

Objective

Pain assessment based on facial expressions is an essential issue in critically ill patients, but an automated assessment tool is still lacking. We conducted this prospective study to establish the deep learning-based pain classifier based on facial expressions.

Methods

We enrolled critically ill patients during 2020-2021 at a tertiary hospital in central Taiwan and recorded video clips with labeled pain scores based on facial expressions, such as relaxed (0), tense (1), and grimacing (2). We established both image- and video-based pain classifiers through using convolutional neural network (CNN) models, such as Resnet34, VGG16, and InceptionV1 and bidirectional long short-term memory networks (BiLSTM). The performance of classifiers in the test dataset was determined by accuracy, sensitivity, and F1-score.

Results

A total of 63 participants with 746 video clips were eligible for analysis. The accuracy of using Resnet34 in the polychromous image-based classifier for pain scores 0, 1, 2 was merely 0.5589, and the accuracy of dichotomous pain classifiers between 0 vs. 1/2 and 0 vs. 2 were 0.7668 and 0.8593, respectively. Similar accuracy of image-based pain classifier was found using VGG16 and InceptionV1. The accuracy of the video-based pain classifier to classify 0 vs. 1/2 and 0 vs. 2 was approximately 0.81 and 0.88, respectively. We further tested the performance of established classifiers without reference, mimicking clinical scenarios with a new patient, and found the performance remained high.

Conclusions

The present study demonstrates the practical application of deep learning-based automated pain assessment in critically ill patients, and more studies are warranted to validate our findings.

SUBMITTER: Wu CL

PROVIDER: S-EPMC8968070 | biostudies-literature | 2022

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Deep Learning-Based Pain Classifier Based on the Facial Expression in Critically Ill Patients.

Wu Chieh-Liang CL Liu Shu-Fang SF Yu Tian-Li TL Shih Sou-Jen SJ Chang Chih-Hung CH Yang Mao Shih-Fang SF Li Yueh-Se YS Chen Hui-Jiun HJ Chen Chia-Chen CC Chao Wen-Cheng WC

Frontiers in medicine 20220317

<h4>Objective</h4>Pain assessment based on facial expressions is an essential issue in critically ill patients, but an automated assessment tool is still lacking. We conducted this prospective study to establish the deep learning-based pain classifier based on facial expressions.<h4>Methods</h4>We enrolled critically ill patients during 2020-2021 at a tertiary hospital in central Taiwan and recorded video clips with labeled pain scores based on facial expressions, such as relaxed (0), tense (1), ...[more]

PMID: 35372435

Similar Datasets

Project description:Visual interpretation of electroencephalography (EEG) is time consuming, may lack objectivity, and is restricted to features detectable by a human. Computer-based approaches, especially deep learning, could potentially overcome these limitations. However, most deep learning studies focus on a specific question or a single pathology. Here we explore the potential of deep learning for EEG-based diagnostic and prognostic assessment of patients with acute consciousness impairment (ACI) of various etiologies. EEGs from 358 adults from a randomized controlled trial (CERTA, NCT03129438) were retrospectively analyzed. A convolutional neural network was used to predict the clinical outcome (based either on survival or on best cerebral performance category) and to determine the etiology (four diagnostic categories). The largest probability output served as marker for the confidence of the network in its prediction ("certainty factor"); we also systematically compared the predictions with raw EEG data, and used a visualization algorithm (Grad-CAM) to highlight discriminative patterns. When all patients were considered, the area under the receiver operating characteristic curve (AUC) was 0.721 for predicting survival and 0.703 for predicting the outcome based on best CPC; for patients with certainty factor ≥ 60 % the AUCs increased to 0.776 and 0.755 respectively; and for certainty factor ≥ 75 % to 0.852 and 0.879. The accuracy for predicting the etiology was 54.5 %; the accuracy increased to 67.7 %, 70.3 % and 84.1 % for patients with certainty factor of 50 %, 60 % and 75 % respectively. Visual analysis showed that the network learnt EEG patterns typically recognized by human experts, and suggested new criteria. This work demonstrates for the first time the potential of deep learning-based EEG analysis in critically ill patients with various etiologies of ACI. Certainty factor and post-hoc correlation of input data with prediction help to better characterize the method and pave the route for future implementations in clinical routine.

Project description:Study objectiveTriage quickly identifies critically ill patients, facilitating timely interventions. Many emergency departments (EDs) use emergency severity index (ESI) or abnormal vital sign triggers to guide triage. However, both use fixed thresholds, and false activations are costly. Prior approaches using machinelearning have relied on information that is often unavailable during the triage process. We examined whether deep-learning approaches could identify critically ill patients only using data immediately available at triage.MethodsWe conducted a retrospective, cross-sectional study at an urban tertiary care center, from January 1, 2012-January 1, 2020. De-identified triage information included structured (age, sex, initial vital signs) and textual (chief complaint) data, with critical illness (mortality or ICU admission within 24 hours) as the outcome. Four progressively complex deep-learning models were trained and applied to triage information from all patients. We compared the accuracy of the models against ESI as the standard diagnostic test, using area under the receiver-operator curve (AUC).ResultsA total of 445,925 patients were included, with 60,901 (13.7%) critically ill. Vital sign thresholds identified critically ill patients with AUC 0.521 (95% confidence interval [CI] = 0.519-0.522), and ESI <3 demonstrated AUC 0.672 (95% CI = 0.671-0.674), logistic regression classified patients with AUC 0.803 (95% CI = 0.802-0.804), 2-layer neural network with structured data with AUC 0.811 (95% CI = 0.807-0.815), gradient tree boosting with AUC 0.820 (95% CI = 0.818-0.821), and the neural network model with textual data with AUC 0.851 (95% CI = 0.849-0.852). All successive increases in AUC were statistically significant.ConclusionDeep-learning techniques represent a promising method of augmenting triage, even with limited information. Further research is needed to determine if improved predictions yield clinical and operational benefits.

Dataset Information

Deep Learning-Based Pain Classifier Based on the Facial Expression in Critically Ill Patients.

Objective

Methods

Results

Conclusions

Publications

Deep Learning-Based Pain Classifier Based on the Facial Expression in Critically Ill Patients.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets