Dataset Information

Improved diagnosis of thyroid cancer aided with deep learning applied to sonographic text reports: a retrospective, multi-cohort, diagnostic study.

ABSTRACT: Large volume radiological text data have been accumulated since the incorporation of electronic health record (EHR) systems in clinical practice. We aimed to determine whether deep natural language processing algorithms could aid radiologists in improving thyroid cancer diagnosis. Sonographic EHR data were obtained from the EHR database. Pathological reports were used as the gold standard for diagnosing thyroid cancer. We developed thyroid cancer diagnosis based on natural language processing (THCaDxNLP) to interpret unstructured sonographic text reports for thyroid cancer diagnosis. We used the area under the receiver operating characteristic curve (AUROC) as the primary metric to measure the performance of the THCaDxNLP. We compared the performance of thyroid ultrasound radiologists aided with THCaDxNLP vs. those without THCaDxNLP using 5 independent test sets. We obtained a total number of 788,129 sonographic radiological reports. The number of thyroid sonographic data points was 132,277, 18,400 of which were thyroid cancer patients. Among the 5 test sets, the numbers of patients per set were 439, 186, 82, 343, and 171. THCaDxNLP achieved high performance in identifying thyroid cancer patients (the AUROC ranged from 0.857-0.932). Thyroid ultrasound radiologists aided with THCaDxNLP achieved significantly higher performances than those without THCaDxNLP in terms of accuracy (93.8% vs. 87.2%; one-sided t-test, adjusted P = 0.003), precision (92.5% vs. 86.0%; P = 0.018), and F1 metric (94.2% vs. 86.4%; P = 0.007). THCaDxNLP achieved a high AUROC for the identification of thyroid cancer, and improved the accuracy, sensitivity, and precision of thyroid ultrasound radiologists. This warrants further investigation of THCaDxNLP in prospective clinical trials.

SUBMITTER: Zhang Q

PROVIDER: S-EPMC9196053 | biostudies-literature | 2021 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Improved diagnosis of thyroid cancer aided with deep learning applied to sonographic text reports: a retrospective, multi-cohort, diagnostic study.

Zhang Qiang Q Zhang Sheng S Li Jianxin J Pan Yi Y Zhao Jing J Feng Yixing Y Zhao Yanhui Y Wang Xiaoqing X Zheng Zhiming Z Yang Xiangming X Liu Lixia L Qin Chunxin C Zhao Ke K Liu Xiaonan X Li Caixia C Zhang Liuyang L Yang Chunrui C Zhuo Na N Zhang Hong H Liu Jie J Gao Jinglei J Di Xiaoling X Meng Fanbo F Ji Wei W Yang Meng M Xin Xiaojie X Wei Xi X Jin Rui R Zhang Lun L Wang Xudong X Song Fengju F Zheng Xiangqian X Gao Ming M Chen Kexin K Li Xiangchun X

Cancer biology & medicine 20210901 5

<h4>Objective</h4>Large volume radiological text data have been accumulated since the incorporation of electronic health record (EHR) systems in clinical practice. We aimed to determine whether deep natural language processing algorithms could aid radiologists in improving thyroid cancer diagnosis.<h4>Methods</h4>Sonographic EHR data were obtained from the EHR database. Pathological reports were used as the gold standard for diagnosing thyroid cancer. We developed thyroid cancer diagnosis based ...[more]

PMID: 34491007

Similar Datasets

Project description:BackgroundThe incidence of thyroid cancer is rising steadily because of overdiagnosis and overtreatment conferred by widespread use of sensitive imaging techniques for screening. This overall incidence growth is especially driven by increased diagnosis of indolent and well-differentiated papillary subtype and early-stage thyroid cancer, whereas the incidence of advanced-stage thyroid cancer has increased marginally. Thyroid ultrasound is frequently used to diagnose thyroid cancer. The aim of this study was to use deep convolutional neural network (DCNN) models to improve the diagnostic accuracy of thyroid cancer by analysing sonographic imaging data from clinical ultrasounds.MethodsWe did a retrospective, multicohort, diagnostic study using ultrasound images sets from three hospitals in China. We developed and trained the DCNN model on the training set, 131 731 ultrasound images from 17 627 patients with thyroid cancer and 180 668 images from 25 325 controls from the thyroid imaging database at Tianjin Cancer Hospital. Clinical diagnosis of the training set was made by 16 radiologists from Tianjin Cancer Hospital. Images from anatomical sites that were judged as not having cancer were excluded from the training set and only individuals with suspected thyroid cancer underwent pathological examination to confirm diagnosis. The model's diagnostic performance was validated in an internal validation set from Tianjin Cancer Hospital (8606 images from 1118 patients) and two external datasets in China (the Integrated Traditional Chinese and Western Medicine Hospital, Jilin, 741 images from 154 patients; and the Weihai Municipal Hospital, Shandong, 11 039 images from 1420 patients). All individuals with suspected thyroid cancer after clinical examination in the validation sets had pathological examination. We also compared the specificity and sensitivity of the DCNN model with the performance of six skilled thyroid ultrasound radiologists on the three validation sets.FindingsBetween Jan 1, 2012, and March 28, 2018, ultrasound images for the four study cohorts were obtained. The model achieved high performance in identifying thyroid cancer patients in the validation sets tested, with area under the curve values of 0·947 (95% CI 0·935-0·959) for the Tianjin internal validation set, 0·912 (95% CI 0·865-0·958) for the Jilin external validation set, and 0·908 (95% CI 0·891-0·925) for the Weihai external validation set. The DCNN model also showed improved performance in identifying thyroid cancer patients versus skilled radiologists. For the Tianjin internal validation set, sensitivity was 93·4% (95% CI 89·6-96·1) versus 96·9% (93·9-98·6; p=0·003) and specificity was 86·1% (81·1-90·2) versus 59·4% (53·0-65·6; p<0·0001). For the Jilin external validation set, sensitivity was 84·3% (95% CI 73·6-91·9) versus 92·9% (84·1-97·6; p=0·048) and specificity was 86·9% (95% CI 77·8-93·3) versus 57·1% (45·9-67·9; p<0·0001). For the Weihai external validation set, sensitivity was 84·7% (95% CI 77·0-90·7) versus 89·0% (81·9-94·0; p=0·25) and specificity was 87·8% (95% CI 81·6-92·5) versus 68·6% (60·7-75·8; p<0·0001).InterpretationThe DCNN model showed similar sensitivity and improved specificity in identifying patients with thyroid cancer compared with a group of skilled radiologists. The improved technical performance of the DCNN model warrants further investigation as part of randomised clinical trials.FundingThe Program for Changjiang Scholars and Innovative Research Team in University in China, and National Natural Science Foundation of China.

Project description:Objectives The aim of this study was to improve the diagnostic performance of nuclear medicine physicians using a deep convolutional neural network (DCNN) model and validate the results with two multicenter datasets for thyroid disease by analyzing clinical single-photon emission computed tomography (SPECT) image data. Methods In this multicenter retrospective study, 3194 SPECT thyroid images were collected for model training (n=2067), internal validation (n=514) and external validation (n=613). First, four pretrained DCNN models (AlexNet, ShuffleNetV2, MobileNetV3 and ResNet-34) for were tested multiple medical image classification of thyroid disease types (i.e., Graves’ disease, subacute thyroiditis, thyroid tumor and normal thyroid). The best performing model was then subjected to fivefold cross-validation to further assess its performance, and the diagnostic performance of this model was compared with that of junior and senior nuclear medicine physicians. Finally, class-specific attentional regions were visualized with attention heatmaps using gradient-weighted class activation mapping. Results Each of the four pretrained neural networks attained an overall accuracy of more than 0.85 for the classification of SPECT thyroid images. The improved ResNet-34 model performed best, with an accuracy of 0.944. For the internal validation set, the ResNet-34 model showed higher accuracy (p < 0.001) when compared to that of the senior nuclear medicine physician, with an improvement of nearly 10%. Our model achieved an overall accuracy of 0.931 for the external dataset, a significantly higher accuracy than that of the senior physician (0.931 vs. 0.868, p < 0.001). Conclusion The DCNN-based model performed well in terms of diagnosing thyroid scintillation images. The DCNN model showed higher sensitivity and greater specificity in identifying Graves’ disease, subacute thyroiditis, and thyroid tumors compared to those of nuclear medicine physicians, illustrating the feasibility of deep learning models to improve the diagnostic efficiency for assisting clinicians.

Project description:PurposeThyroid nodules are highly prevalent in the general population, posing a clinical challenge in accurately distinguishing between benign and malignant cases. This study aimed to investigate the diagnostic performance of different strategies, utilizing a combination of a computer-aided diagnosis system (AmCAD) and shear wave elastography (SWE) imaging, to effectively differentiate benign and malignant thyroid nodules in ultrasonography.MethodsA total of 126 thyroid nodules with pathological confirmation were prospectively included in this study. The AmCAD was utilized to analyze the ultrasound imaging characteristics of the nodules, while the SWE was employed to measure their stiffness in both transverse and longitudinal thyroid scans. Twelve diagnostic patterns were formed by combining AmCAD diagnosis and SWE values, including isolation, series, parallel, and integration. The diagnostic performance was assessed using the receiver operating characteristic curve and area under the curve (AUC). Sensitivity, specificity, accuracy, missed malignancy rate, and unnecessary biopsy rate were also determined.ResultsVarious diagnostic schemes have shown specific advantages in terms of diagnostic performance. Overall, integrating AmCAD with SWE imaging in the transverse scan yielded the most favorable diagnostic performance, achieving an AUC of 72.2% (95% confidence interval (CI): 63.0-81.5%), outperforming other diagnostic schemes. Furthermore, in the subgroup analysis of nodules measuring <2 cm or 2-4 cm, the integrated scheme consistently exhibited promising diagnostic performance, with AUCs of 74.2% (95% CI: 61.9-86.4%) and 77.4% (95% CI: 59.4-95.3%) respectively, surpassing other diagnostic schemes. The integrated scheme also effectively addressed thyroid nodule management by reducing the missed malignancy rate to 9.5% and unnecessary biopsy rate to 22.2%.ConclusionThe integration of AmCAD and SWE imaging in the transverse thyroid scan significantly enhances the diagnostic performance for distinguishing benign and malignant thyroid nodules. This strategy offers clinicians the advantage of obtaining more accurate clinical diagnoses and making well-informed decisions regarding patient management.

Project description:BackgroundColposcopy is widely used to detect cervical cancer, but developing countries lack the experienced colposcopists necessary for accurate diagnosis. Artificial intelligence (AI) is being widely used in computer-aided diagnosis (CAD) systems. In this study, we developed and validated a CAD model based on deep learning to classify cervical lesions on colposcopy images.MethodsPatient data, including clinical information, colposcopy images, and pathological results, were collected from Qilu Hospital. The study included 15,276 images from 7,530 patients. We performed two tasks in this study: normal cervix (NC) vs. low grade squamous intraepithelial lesion or worse (LSIL+) and high-grade squamous intraepithelial lesion (HSIL)- vs. HSIL+. The residual neural network (ResNet) probability was calculated for each patient to reflect the probability of lesions through a ResNet model. Next, a combination model was constructed by incorporating the ResNet probability and clinical features. We divided the dataset into a training set, validation set, and testing set at a ratio of 7:1:2. Finally, we randomly selected 300 patients from the testing set and compared the results with the diagnosis of a senior colposcopist and a junior colposcopist.ResultsThe model that combines ResNet and clinical features performs better than ResNet alone. In the classification of NC and LSIL+, the area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) were 0.953, 0.886, 0.932, 0.846, 0.838, and 0.936, respectively. In the classification of HSIL- and HSIL+, the AUC, accuracy, sensitivity, specificity, PPV, and NPV were 0.900, 0.807, 0.823, 0.800, 0.618, and 0.920, respectively. In the two classification tasks, the diagnostic performance of the model was determined to be comparable to that of the senior colposcopist and exhibited a stronger diagnostic performance than the junior colposcopist.ConclusionsThe CAD system for cervical lesion diagnosis based on deep learning performs well in the classification of cervical lesions and can provide an objective diagnostic basis for colposcopists.

Dataset Information

Improved diagnosis of thyroid cancer aided with deep learning applied to sonographic text reports: a retrospective, multi-cohort, diagnostic study.

Publications

Improved diagnosis of thyroid cancer aided with deep learning applied to sonographic text reports: a retrospective, multi-cohort, diagnostic study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets