Dataset Information

PyJAMAS: open-source, multimodal segmentation and analysis of microscopy images.

ABSTRACT:

Summary

Our increasing ability to resolve fine details using light microscopy is matched by an increasing need to quantify images in order to detect and measure phenotypes. Despite their central role in cell biology, many image analysis tools require a financial investment, are released as proprietary software, or are implemented in languages not friendly for beginners, and thus are used as black boxes. To overcome these limitations, we have developed PyJAMAS, an open-source tool for image processing and analysis written in Python. PyJAMAS provides a variety of segmentation tools, including watershed and machine learning-based methods; takes advantage of Jupyter notebooks for the display and reproducibility of data analyses; and can be used through a cross-platform graphical user interface or as part of Python scripts via a comprehensive application programming interface.

Availability and implementation

PyJAMAS is open-source and available at https://bitbucket.org/rfg_lab/pyjamas.

Supplementary information

Supplementary data are available at Bioinformatics online.

SUBMITTER: Fernandez-Gonzalez R

PROVIDER: S-EPMC8722751 | biostudies-literature | 2022 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

PyJAMAS: open-source, multimodal segmentation and analysis of microscopy images.

Fernandez-Gonzalez Rodrigo R Balaghi Negar N Wang Kelly K Hawkins Ray R Rothenberg Katheryn K McFaul Christopher C Schimmer Clara C Ly Michelle M do Carmo Ana Maria AM Scepanovic Gordana G Erdemci-Tandogan Gonca G Castle Veronica V

Bioinformatics (Oxford, England) 20220101 2

<h4>Summary</h4>Our increasing ability to resolve fine details using light microscopy is matched by an increasing need to quantify images in order to detect and measure phenotypes. Despite their central role in cell biology, many image analysis tools require a financial investment, are released as proprietary software, or are implemented in languages not friendly for beginners, and thus are used as black boxes. To overcome these limitations, we have developed PyJAMAS, an open-source tool for ima ...[more]

PMID: 34390579

Similar Datasets

Project description:MotivationRecent brain mapping efforts are producing large-scale whole-brain images using different imaging modalities. Accurate alignment and delineation of anatomical structures in these images are essential for numerous studies. These requirements are typically modeled as two distinct tasks: registration and segmentation. However, prevailing methods, fail to fully explore and utilize the inherent correlation and complementarity between the two tasks. Furthermore, variations in brain anatomy, brightness, and texture pose another formidable challenge in designing multi-modal similarity metrics. A high-throughput approach capable of overcoming the bottleneck of multi-modal similarity metric design, while effective leveraging the highly correlated and complementary nature of two tasks is highly desirable.ResultsWe introduce a deep learning framework for joint registration and segmentation of multi-modal brain images. Under this framework, registration and segmentation tasks are deeply coupled and collaborated at two hierarchical layers. In the inner layer, we establish a strong feature-level coupling between the two tasks by learning a unified common latent feature representation. In the outer layer, we introduce a mutually supervised dual-branch network to decouple latent features and facilitate task-level collaboration between registration and segmentation. Since the latent features we designed are also modality-independent, the bottleneck of designing multi-modal similarity metric is essentially addressed. Another merit offered by this framework is the interpretability of latent features, which allows intuitive manipulation of feature learning, thereby further enhancing network training efficiency and the performance of both tasks. Extensive experiments conducted on both multi-modal and mono-modal datasets of mouse and human brains demonstrate the superiority of our method.Availability and implementationThe code is available at https://github.com/tingtingup/DCRS.

Project description:BackgroundRecent advances in artificial intelligence and digital image processing have inspired the use of deep neural networks for segmentation tasks in multimodal medical imaging. Unlike natural images, multimodal medical images contain much richer information regarding different modal properties and therefore present more challenges for semantic segmentation. However, there is no report on systematic research that integrates multi-scaled and structured analysis of single-modal and multimodal medical images.MethodsWe propose a deep neural network, named as Modality Preserving U-Net (MPU-Net), for modality-preserving analysis and segmentation of medical targets from multimodal medical images. The proposed MPU-Net consists of a modality preservation encoder (MPE) module that preserves the feature independency among the modalities and a modality fusion decoder (MFD) module that performs a multiscale feature fusion analysis for each modality in order to provide a rich feature representation for the final task. The effectiveness of such a single-modal preservation and multimodal fusion feature extraction approach is verified by multimodal segmentation experiments and an ablation study using brain tumor and prostate datasets from Medical Segmentation Decathlon (MSD).ResultsThe segmentation experiments demonstrated the superiority of MPU-Net over other methods in the segmentation tasks for multimodal medical images. In the brain tumor segmentation tasks, the Dice scores (DSCs) for the whole tumor (WT), the tumor core (TC) and the enhancing tumor (ET) regions were 89.42%, 86.92%, and 84.59%, respectively. In the meanwhile, the 95% Hausdorff distance (HD95) results were 3.530, 4.899 and 2.555, respectively. In the prostate segmentation tasks, the DSCs for the peripheral zone (PZ) and the transitional zone (TZ) of the prostate were 71.20% and 90.38%, respectively. In the meanwhile, the 95% HD95 results were 6.367 and 4.766, respectively. The ablation study showed that the combination of single-modal preservation and multimodal fusion methods improved the performance of multimodal medical image feature analysis.ConclusionsIn the segmentation tasks using brain tumor and prostate datasets, the MPU-Net method has achieved the improved performance in comparison with the conventional methods, indicating its potential application for other segmentation tasks in multimodal medical images.

Dataset Information

PyJAMAS: open-source, multimodal segmentation and analysis of microscopy images.

Summary

Availability and implementation

Supplementary information

Publications

PyJAMAS: open-source, multimodal segmentation and analysis of microscopy images.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets