Dataset Information

Improved Protein Model Quality Assessment By Integrating Sequential And Pairwise Features Using Deep Learning.

ABSTRACT: Accurately estimating protein model quality in the absence of experimental structure is not only important for model evaluation and selection, but also useful for model refinement. Progress has been steadily made by introducing new features and algorithms (especially deep neural networks), but the accuracy of quality assessment (QA) is still not very satisfactory, especially local QA on hard protein targets. We propose a new single-model-based QA method ResNetQA for both local and global quality assessment. Our method predicts model quality by integrating sequential and pairwise features using a deep neural network composed of both 1 D and 2 D convolutional residual neural networks (ResNet). The 2 D ResNet module extracts useful information from pairwise features such as model-derived distance maps, co-evolution information, and predicted distance potential from sequences. The 1 D ResNet is used to predict local (global) model quality from sequential features and pooled pairwise information generated by 2 D ResNet. Tested on the CASP12 and CASP13 datasets, our experimental results show that our method greatly outperforms existing state-of-the-art methods. Our ablation studies indicate that the 2 D ResNet module and pairwise features play an important role in improving model quality assessment. https://github.com/AndersJing/ResNetQA. Supplementary data are available at Bioinformatics online.

SUBMITTER: Jing X

PROVIDER: S-EPMC8016469 | biostudies-literature | 2020 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Improved protein model quality assessment by integrating sequential and pairwise features using deep learning.

Jing Xiaoyang X Xu Jinbo J

Bioinformatics (Oxford, England) 20210401 22-23

<h4>Motivation</h4>Accurately estimating protein model quality in the absence of experimental structure is not only important for model evaluation and selection but also useful for model refinement. Progress has been steadily made by introducing new features and algorithms (especially deep neural networks), but the accuracy of quality assessment (QA) is still not very satisfactory, especially local QA on hard protein targets.<h4>Results</h4>We propose a new single-model-based QA method ResNetQA ...[more]

PMID: 33325480

Similar Datasets

Project description:BackgroundA variety of external factors might seriously degrade PET image quality and lead to inconsistent results. The aim of this study is to explore a potential PET image quality assessment (QA) method with deep learning (DL).MethodsA total of 89 PET images were acquired from Peking Union Medical College Hospital (PUMCH) in China in this study. Ground-truth quality for images was assessed by two senior radiologists and classified into five grades (grade 1, grade 2, grade 3, grade 4, and grade 5). Grade 5 is the best image quality. After preprocessing, the Dense Convolutional Network (DenseNet) was trained to automatically recognize optimal- and poor-quality PET images. Accuracy (ACC), sensitivity, specificity, receiver operating characteristic curve (ROC), and area under the ROC Curve (AUC) were used to evaluate the diagnostic properties of all models. All indicators of models were assessed using fivefold cross-validation. An image quality QA tool was developed based on our deep learning model. A PET QA report can be automatically obtained after inputting PET images.ResultsFour tasks were generated. Task2 showed worst performance in AUC,ACC, specificity and sensitivity among 4 tasks, and task1 showed unstable performance between training and testing and task3 showed low specificity in both training and testing. Task 4 showed the best diagnostic properties and discriminative performance between poor image quality (grade 1, grade 2) and good quality (grade 3, grade 4, grade 5) images. The automated quality assessment of task 4 showed ACC = 0.77, specificity = 0.71, and sensitivity = 0.83, in the train set; ACC = 0.85, specificity = 0.79, and sensitivity = 0.91, in the test set, respectively. The ROC measuring performance of task 4 had an AUC of 0.86 in the train set and 0.91 in the test set. The image QA tool could output basic information of images, scan and reconstruction parameters, typical instances of PET images, and deep learning score.ConclusionsThis study highlights the feasibility of the assessment of image quality in PET images using a deep learning model, which may assist with accelerating clinical research by reliably assessing image quality.

Project description:High resolution peripheral quantitative computed tomography (HRpQCT) offers detailed bone geometry and microarchitecture assessment, including cortical porosity, but assessing chronic kidney disease (CKD) bone images remains challenging. This proof-of-concept study merges deep learning and machine learning to 1) improve automatic segmentation, particularly in cases with severe cortical porosity and trabeculated endosteal surfaces, and 2) maximize image information using machine learning feature extraction to classify CKD-related skeletal abnormalities, surpassing conventional DXA and CT measures. We included 30 individuals (20 non-CKD, 10 stage 3 to 5D CKD) who underwent HRpQCT of the distal and diaphyseal radius and tibia and contributed data to develop and validate four different AI models for each anatomical site. Manually annotated cortical bone was used to train each segmentation deep-learning model. Textural features were extracted via Gray-Level Co-occurrence Matrix (GLCM) and classified as CKD or non-CKD using XGBoost with each segmentation model. For comparison, manufacturer-supplied segmentation was used to extract cortical geometry, microarchitecture, and finite element analysis (FEA) outcomes. Model performance was confirmed using the test dataset and a separate independent validation cohort which included HRpQCT imaging from 42 additional individuals (18 non-CKD, 24 CKD stage 5D). For segmentation, the diaphyseal location showed strong performance on test datasets, with Mean IoUs of 0.96 and 0.95, and accuracies of 0.97 for both radius and tibia sites in CKD. Model 4 developed from the diaphyseal tibia region excelled in classifying test and independent validation datasets, achieving F1 scores of 0.99 and 0.96, AUCs of 0.99 and 0.94, sensitivities of 0.99, and specificities of 0.99 and 0.92. No single parameter, including BMD and cortical porosity, among conventional CT outcomes consistently differentiated CKD from non-CKD across all anatomical sites. Integrating HRpQCT with deep and machine learning, this innovative approach enables precise automatic segmentation of severely deteriorated endocortical surfaces and enhances sensitivity to CKD-related cortical bone changes compared to standard DXA and HRpQCT outcomes.

Project description:BackgroundModern molecular pathology workflows in neuro-oncology heavily rely on the integration of morphologic and immunohistochemical patterns for analysis, classification, and prognostication. However, despite the recent emergence of digital pathology platforms and artificial intelligence-driven computational image analysis tools, automating the integration of histomorphologic information found across these multiple studies is challenged by large files sizes of whole slide images (WSIs) and shifts/rotations in tissue sections introduced during slide preparation.MethodsTo address this, we develop a workflow that couples different computer vision tools including scale-invariant feature transform (SIFT) and deep learning to efficiently align and integrate histopathological information found across multiple independent studies. We highlight the utility and automation potential of this workflow in the molecular subclassification and discovery of previously unappreciated spatial patterns in diffuse gliomas.ResultsFirst, we show how a SIFT-driven computer vision workflow was effective at automated WSI alignment in a cohort of 107 randomly selected surgical neuropathology cases (97/107 (91%) showing appropriate matches, AUC = 0.96). This alignment allows our AI-driven diagnostic workflow to not only differentiate different brain tumor types, but also integrate and carry out molecular subclassification of diffuse gliomas using relevant immunohistochemical biomarkers (IDH1-R132H, ATRX). To highlight the discovery potential of this workflow, we also examined spatial distributions of tumors showing heterogenous expression of the proliferation marker MIB1 and Olig2. This analysis helped uncover an interesting and unappreciated association of Olig2 positive and proliferative areas in some gliomas (r = 0.62).ConclusionThis efficient neuropathologist-inspired workflow provides a generalizable approach to help automate a variety of advanced immunohistochemically compatible diagnostic and discovery exercises in surgical neuropathology and neuro-oncology.

Dataset Information

Improved Protein Model Quality Assessment By Integrating Sequential And Pairwise Features Using Deep Learning.

Publications

Improved protein model quality assessment by integrating sequential and pairwise features using deep learning.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets