Dataset Information

Development and validation of a deep learning model for multicategory pneumonia classification on chest computed tomography: a multicenter and multireader study.

ABSTRACT:

Background

Accurate diagnosis of pneumonia is vital for effective disease management and mortality reduction, but it can be easily confused with other conditions on chest computed tomography (CT) due to an overlap in imaging features. We aimed to develop and validate a deep learning (DL) model based on chest CT for accurate classification of viral pneumonia (VP), bacterial pneumonia (BP), fungal pneumonia (FP), pulmonary tuberculosis (PTB), and no pneumonia (NP) conditions.

Methods

In total, 1,776 cases from five hospitals in different regions were retrospectively collected from September 2019 to June 2023. All cases were enrolled according to inclusion and exclusion criteria, and ultimately 1,611 cases were used to develop the DL model with 5-fold cross-validation, with 165 cases being used as the external test set. Five radiologists blindly reviewed the images from the internal and external test sets first without and then with DL model assistance. Precision, recall, F1-score, weighted F1-average, and area under the curve (AUC) were used to evaluate the model performance.

Results

The F1-scores of the DL model on the internal and external test sets were, respectively, 0.947 [95% confidence interval (CI): 0.936-0.958] and 0.933 (95% CI: 0.916-0.950) for VP, 0.511 (95% CI: 0.487-0.536) and 0.591 (95% CI: 0.557-0.624) for BP, 0.842 (95% CI: 0.824-0.860) and 0.848 (95% CI: 0.824-0.873) for FP, 0.843 (95% CI: 0.826-0.861) and 0.795 (95% CI: 0.767-0.822) for PTB, and 0.975 (95% CI: 0.968-0.983) and 0.976 (95% CI: 0.965-0.986) for NP, with a weighted F1-average of 0.883 (95% CI: 0.867-0.898) and 0.846 (95% CI: 0.822-0.871), respectively. The model performed well and showed comparable performance in both the internal and external test sets. The F1-score of the DL model was higher than that of radiologists, and with DL model assistance, radiologists achieved a higher F1-score. On the external test set, the F1-score of the DL model (F1-score 0.848; 95% CI: 0.824-0.873) was higher than that of the radiologists (F1-score 0.541; 95% CI: 0.507-0.575) as was its precision for the other three pneumonia conditions (all P values <0.001). With DL model assistance, the F1-score for FP (F1-score 0.541; 95% CI: 0.507-0.575) was higher than that achieved without assistance (F1-score 0.778; 95% CI: 0.750-0.807) as was its precision for the other three pneumonia conditions (all P values <0.001).

Conclusions

The DL approach can effectively classify pneumonia and can help improve radiologists' performance, supporting the full integration of DL results into the routine workflow of clinicians.

SUBMITTER: Shi C

PROVIDER: S-EPMC10722067 | biostudies-literature | 2023 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development and validation of a deep learning model for multicategory pneumonia classification on chest computed tomography: a multicenter and multireader study.

Shi Chunzi C Shao Ying Y Shan Fei F Shen Jie J Huang Xueni X Chen Chuan C Lu Yang Y Zhan Yi Y Shi Nannan N Wu Jili J Wang Keying K Gao Yaozong Y Shi Yuxin Y Song Fengxiang F

Quantitative imaging in medicine and surgery 20231021 12

<h4>Background</h4>Accurate diagnosis of pneumonia is vital for effective disease management and mortality reduction, but it can be easily confused with other conditions on chest computed tomography (CT) due to an overlap in imaging features. We aimed to develop and validate a deep learning (DL) model based on chest CT for accurate classification of viral pneumonia (VP), bacterial pneumonia (BP), fungal pneumonia (FP), pulmonary tuberculosis (PTB), and no pneumonia (NP) conditions.<h4>Methods</h ...[more]

PMID: 38106268

Similar Datasets

Project description:BackgroundComputed tomography (CT) imaging and artificial intelligence (AI)-based analyses have aided in the diagnosis and prediction of the severity of COVID-19. However, the potential of AI-based CT quantification of pneumonia in assessing patients with COVID-19 has not yet been fully explored. This study aimed to investigate the potential of AI-based CT quantification of COVID-19 pneumonia to predict the critical outcomes and clinical characteristics of patients with residual lung lesions.MethodsThis retrospective cohort study included 1,200 hospitalized patients with COVID-19 from four hospitals. The incidence of critical outcomes (requiring the support of high-flow oxygen or invasive mechanical ventilation or death) and complications during hospitalization (bacterial infection, renal failure, heart failure, thromboembolism, and liver dysfunction) was compared between the groups of pneumonia with high/low-percentage lung lesions, based on AI-based CT quantification. Additionally, 198 patients underwent CT scans 3 months after admission to analyze prognostic factors for residual lung lesions.ResultsThe pneumonia group with a high percentage of lung lesions (N = 400) had a higher incidence of critical outcomes and complications during hospitalization than the low percentage group (N = 800). Multivariable analysis demonstrated that AI-based CT quantification of pneumonia was independently associated with critical outcomes (adjusted odds ratio [aOR] 10.5, 95% confidence interval [CI] 5.59-19.7), as well as with oxygen requirement (aOR 6.35, 95% CI 4.60-8.76), IMV requirement (aOR 7.73, 95% CI 2.52-23.7), and mortality rate (aOR 6.46, 95% CI 1.87-22.3). Among patients with follow-up CT scans (N = 198), the multivariable analysis revealed that the pneumonia group with a high percentage of lung lesions on admission (aOR 4.74, 95% CI 2.36-9.52), older age (aOR 2.53, 95% CI 1.16-5.51), female sex (aOR 2.41, 95% CI 1.13-5.11), and medical history of hypertension (aOR 2.22, 95% CI 1.09-4.50) independently predicted persistent residual lung lesions.ConclusionsAI-based CT quantification of pneumonia provides valuable information beyond qualitative evaluation by physicians, enabling the prediction of critical outcomes and residual lung lesions in patients with COVID-19.

Project description:ObjectiveThe aim of our study was to assess the effect of a short-term treatment with low-moderate corticosteroid (CS) doses by both a quantitative and qualitative assessment of chest HRCT of COVID-19 pneumonia.MethodsCORTICOVID is a single-center, cross-sectional, retrospective study involving severe/critical COVID-19 patients with mild/moderate ARDS. Lung total severity score was obtained according to Chung and colleagues. Moreover, the relative percentages of lung total severity score by ground glass opacities, consolidations, crazy paving, and linear bands were computed. Chest HRCT scores, P/F ratio, and laboratory parameters were evaluated before (pre-CS) and 7-10 days after (post-CS) methylprednisolone of 0.5-0.8 mg/kg/day.FindingsA total of 34 severe/critical COVID-19 patients were included in the study, of which 17 received Standard of Care (SoC) and 17 CS therapy in add-on. CS treatment disclosed a significant decrease in HRCT total severity score [median = 6 (IQR: 5-7.5) versus 10 (IQR: 9-13) in SoC, p < 0.001], as well in single consolidations [median = 0.33 (IQR: 0-0.92) versus 6.73 (IQR: 2.49-8.03) in SoC, p < 0.001] and crazy paving scores [mean = 0.19 (SD = 0.53) versus 1.79 (SD = 2.71) in SoC, p = 0.010], along with a significant increase in linear bands [mean = 2.56 (SD = 1.65) versus 0.97 (SD = 1.30) in SoC, p = 0.006]. GGO score instead did not significantly differ at the end of treatment between the two groups. Most post-CS GGO, however, derived from previous consolidations and crazy paving [median = 1.5 (0.35-3.81) versus 2 (1.25-3.8) pre-CS; p = 0.579], while pre-CS GGO significantly decreased after methylprednisolone therapy [median = 0.66 (0.05-1.33) versus 1.5 (0.35-3.81) pre-CS; p = 0.004]. CS therapy further determined a significant improvement in P/F levels [median P/F = 310 (IQR: 235.5-370) versus 136 (IQR: 98.5-211.75) in SoC; p < 0.001], and a significant increase in white blood cells, lymphocytes, and neutrophils absolute values.ConclusionThe improvement of all chest HRCT findings further supports the role of CS adjunctive therapy in severe/critical COVID-19 pneumonia.

Project description:BackgroundOsteoporosis, a disease stemming from bone metabolism irregularities, affects approximately 200 million people worldwide. Timely detection of osteoporosis is pivotal in grappling with this public health challenge. Deep learning (DL), emerging as a promising methodology in the field of medical imaging, holds considerable potential for the assessment of bone mineral density (BMD). This study aimed to propose an automated DL framework for BMD assessment that integrates localization, segmentation, and ternary classification using various dominant convolutional neural networks (CNNs).MethodsIn this retrospective study, a cohort of 2,274 patients underwent chest computed tomography (CT) was enrolled from January 2022 to June 2023 for the development of the integrated DL system. The study unfolded in 2 phases. Initially, 1,025 patients were selected based on specific criteria to develop an automated segmentation model, utilizing 2 VB-Net networks. Subsequently, a distinct cohort of 902 patients was employed for the development and testing of classification models for BMD assessment. Then, 3 distinct DL network architectures, specifically DenseNet, ResNet-18, and ResNet-50, were applied to formulate the 3-classification BMD assessment model. The performance of both phases was evaluated using an independent test set consisting of 347 individuals. Segmentation performance was evaluated using the Dice similarity coefficient; classification performance was appraised using the receiver operating characteristic (ROC) curve. Furthermore, metrics such as the area under the curve (AUC), accuracy, and precision were meticulously calculated.ResultsIn the first stage, the automatic segmentation model demonstrated excellent segmentation performance, with mean Dice surpassing 0.93 in the independent test set. In the second stage, both the DenseNet and ResNet-18 demonstrated excellent diagnostic performance in detecting bone status. For osteoporosis, and osteopenia, the AUCs were as follows: DenseNet achieved 0.94 [95% confidence interval (CI): 0.91-0.97], and 0.91 (95% CI: 0.87-0.94), respectively; ResNet-18 attained 0.96 (95% CI: 0.92-0.98), and 0.91 (95% CI: 0.87-0.94), respectively. However, the ResNet-50 model exhibited suboptimal diagnostic performance for osteopenia, with an AUC value of only 0.76 (95% CI: 0.69-0.80). Alterations in tube voltage had a more pronounced impact on the performance of the DenseNet. In the independent test set with tube voltage at 100 kVp images, the accuracy and precision of DenseNet decreased on average by approximately 14.29% and 18.82%, respectively, whereas the accuracy and precision of ResNet-18 decreased by about 8.33% and 7.14%, respectively.ConclusionsThe state-of-the-art DL framework model offers an effective and efficient approach for opportunistic osteoporosis screening using chest CT, without incurring additional costs or radiation exposure.

Dataset Information

Development and validation of a deep learning model for multicategory pneumonia classification on chest computed tomography: a multicenter and multireader study.

Background

Methods

Results

Conclusions

Publications

Development and validation of a deep learning model for multicategory pneumonia classification on chest computed tomography: a multicenter and multireader study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets