Dataset Information

Web Infrastructure for Data Management, Storage and Computation.

ABSTRACT: The Data Storage for Computation and Integration (DSCI) proposes management innovations for web-based secure data storage, algorithms deployment, and task execution. Its architecture allows inclusion of plugins for upload, browsing, sharing, and task execution in remote computing grids. Here, we demonstrate the DSCI implementation and the deployment of Image processing tools (TMJSeg), machine learning algorithms (MandSeg, DentalModelSeg), and advanced statistical packages (Multivariate Functional Shape Data Analysis, MFSDA), with data transfer and task execution handled by the clusterpost plug-in. Due to its comprehensive web-based design, local software installation is no longer required. The DSCI aims to enable and maintain a distributed computing and collaboration environment across multi-site clinical centers for the data processing of multisource features such as clinical, biological markers, volumetric images, and 3D surface models, with particular emphasis on analytics for temporomandibular joint osteoarthritis (TMJ OA).

SUBMITTER: Brosset S

PROVIDER: S-EPMC8015809 | biostudies-literature | 2021 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Web Infrastructure for Data Management, Storage and Computation.

Brosset Serge S Dumont Maxime M Cevidanes Lucia L Soroushmehr Reza R Bianchi Jonas J Gurgel Marcela M Deleat-Besson Romain R Le Celia C Ruellas Antonio A Yatabe Marilia M Junior Cauby Chaves CC Gomes Liliane L Goncalves Joao J Najarian Kayvan K Gryak Jonathan J Styner Martin M Paniagua Beatriz B Prieto Juan Carlos JC

Proceedings of SPIE--the International Society for Optical Engineering 20210214

The Data Storage for Computation and Integration (DSCI) proposes management innovations for web-based secure data storage, algorithms deployment, and task execution. Its architecture allows inclusion of plugins for upload, browsing, sharing, and task execution in remote computing grids. Here, we demonstrate the DSCI implementation and the deployment of Image processing tools (TMJSeg), machine learning algorithms (MandSeg, DentalModelSeg), and advanced statistical packages (Multivariate Functiona ...[more]

PMID: 33814672

Similar Datasets

Project description:IntroductionAccuracy of feature annotation and metabolite identification in biological samples is a key element in metabolomics research. However, the annotation process is often hampered by the lack of spectral reference data in experimental conditions, as well as logistical difficulties in the spectral data management and exchange of annotations between laboratories.ObjectivesTo design an open-source infrastructure allowing hosting both nuclear magnetic resonance (NMR) and mass spectra (MS), with an ergonomic Web interface and Web services to support metabolite annotation and laboratory data management.MethodsWe developed the PeakForest infrastructure, an open-source Java tool with automatic programming interfaces that can be deployed locally to organize spectral data for metabolome annotation in laboratories. Standardized operating procedures and formats were included to ensure data quality and interoperability, in line with international recommendations and FAIR principles.ResultsPeakForest is able to capture and store experimental spectral MS and NMR metadata as well as collect and display signal annotations. This modular system provides a structured database with inbuilt tools to curate information, browse and reuse spectral information in data treatment. PeakForest offers data formalization and centralization at the laboratory level, facilitating shared spectral data across laboratories and integration into public databases.ConclusionPeakForest is a comprehensive resource which addresses a technical bottleneck, namely large-scale spectral data annotation and metabolite identification for metabolomics laboratories with multiple instruments. PeakForest databases can be used in conjunction with bespoke data analysis pipelines in the Galaxy environment, offering the opportunity to meet the evolving needs of metabolomics research. Developed and tested by the French metabolomics community, PeakForest is freely-available at https://github.com/peakforest .

Project description:BackgroundDNA sequencing is used ubiquitously: from deciphering genomes to determining the primary sequence of small RNAs (smRNAs). The cloning of smRNAs is currently the most conventional method to determine the actual sequence of these important regulators of gene expression. Typical smRNA cloning projects involve the sequencing of hundreds to thousands of smRNA clones that are delimited at their 5' and 3' ends by fixed sequence regions. These primers result from the biochemical protocol used to isolate and convert the smRNA into clonable PCR products. Recently we completed a smRNA cloning project involving tobacco plants, where analysis was required for approximately 700 smRNA sequences. Finding no easily accessible research tool to enter and analyze smRNA sequences we developed Ebbie to assist us with our study.ResultsEbbie is a semi-automated smRNA cloning data processing algorithm, which initially searches for any substring within a DNA sequencing text file, which is flanked by two constant strings. The substring, also termed smRNA or insert, is stored in a MySQL and BlastN database. These inserts are then compared using BlastN to locally installed databases allowing the rapid comparison of the insert to both the growing smRNA database and to other static sequence databases. Our laboratory used Ebbie to analyze scores of DNA sequencing data originating from an smRNA cloning project. Through its built-in instant analysis of all inserts using BlastN, we were able to quickly identify 33 groups of smRNAs from approximately 700 database entries. This clustering allowed the easy identification of novel and highly expressed clusters of smRNAs. Ebbie is available under GNU GPL and currently implemented on http://bioinformatics.org/ebbie/.ConclusionEbbie was designed for medium sized smRNA cloning projects with about 1,000 database entries. Ebbie can be used for any type of sequence analysis where two constant primer regions flank a sequence of interest. The reliable storage of inserts, and their annotation in a MySQL database, BlastN comparison of new inserts to dynamic and static databases make it a powerful new tool in any laboratory using DNA sequencing. Ebbie also prevents manual mistakes during the excision process and speeds up annotation and data-entry. Once the server is installed locally, its access can be restricted to protect sensitive new DNA sequencing data. Ebbie was primarily designed for smRNA cloning projects, but can be applied to a variety of RNA and DNA cloning projects.

Dataset Information

Web Infrastructure for Data Management, Storage and Computation.

Publications

Web Infrastructure for Data Management, Storage and Computation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets