Segmentation metric misinterpretations in bioimage analysis.
Ontology highlight
ABSTRACT:
SUBMITTER: Hirling D
PROVIDER: S-EPMC10864175 | biostudies-literature | 2024 Feb
REPOSITORIES: biostudies-literature
Publications
Segmentation metric misinterpretations in bioimage analysis.
Hirling Dominik D Tasnadi Ervin E Caicedo Juan J Caroprese Maria V MV Sjögren Rickard R Aubreville Marc M Koos Krisztian K Horvath Peter P
Nature methods 20230727 2
Quantitative evaluation of image segmentation algorithms is crucial in the field of bioimage analysis. The most common assessment scores, however, are often misinterpreted and multiple definitions coexist with the same name. Here we present the ambiguities of evaluation metrics for segmentation algorithms and show how these misinterpretations can alter leaderboards of influential competitions. We also propose guidelines for how the currently existing problems could be tackled. ...[more]
Similar Datasets
Project description:Bioimage analysis (BIA) has historically helped study how and why cells move; biological experiments evolved in intimate feedback with the most classical image processing techniques because they contribute objectivity and reproducibility to an eminently qualitative science. Cell segmentation, tracking, and morphology descriptors are all discussed here. Using ameboid motility as a case study, these methods help us illustrate how proper quantification can augment biological data, for example, by choosing mathematical representations that amplify initially subtle differences, by statistically uncovering general laws or by integrating physical insight. More recently, the non-invasive nature of quantitative imaging is fertilizing two blooming fields: mechanobiology, where many biophysical measurements remain inaccessible, and microenvironments, where the quest for physiological relevance has exploded data size. From relief to remedy, this trend indicates that BIA is to become a main vector of biological discovery as human visual analysis struggles against ever more complex data.
| S-EPMC7815951 | biostudies-literature
Project description:As sample preparation and imaging techniques have expanded and improved to include a variety of options for larger sized and numbers of samples, the bottleneck in volumetric imaging is now data analysis. Annotation and segmentation are both common, yet difficult, data analysis tasks which are required to bring meaning to the volumetric data. The SuRVoS application has been updated and redesigned to provide access to both manual and machine learning-based segmentation and annotation techniques, including support for crowd sourced data. Combining adjacent, similar voxels (supervoxels) provides a mechanism for speeding up segmentation both in the painting of annotation and by training a segmentation model on a small amount of annotation. The support for layers allows multiple datasets to be viewed and annotated together which, for example, enables the use of correlative data (e.g. crowd-sourced annotations or secondary imaging techniques) to guide segmentation. The ability to work with larger data on high-performance servers with GPUs has been added through a client-server architecture and the Pytorch-based image processing and segmentation server is flexible and extensible, and allows the implementation of deep learning-based segmentation modules. The client side has been built around Napari allowing integration of SuRVoS into an ecosystem for open-source image analysis while the server side has been built with cloud computing and extensibility through plugins in mind. Together these improvements to SuRVoS provide a platform for accelerating the annotation and segmentation of volumetric and correlative imaging data across modalities and scales.
| S-EPMC9011330 | biostudies-literature
Project description:Motivation:We introduce a formulation for the general task of finding diverse shortest paths between two end-points. Our approach is not linked to a specific biological problem and can be applied to a large variety of images thanks to its generic implementation as a user-friendly ImageJ/Fiji plugin. It relies on the introduction of additional layers in a Viterbi path graph, which requires slight modifications to the standard Viterbi algorithm rules. This layered graph construction allows for the specification of various constraints imposing diversity between solutions. Results:The software allows obtaining a collection of diverse shortest paths under some user-defined constraints through a convenient and user-friendly interface. It can be used alone or be integrated into larger image analysis pipelines. Availability and implementation:http://bigwww.epfl.ch/algorithms/diversepathsj. Contact:michael.unser@epfl.ch or fred.hamprecht@iwr.uni-heidelberg.de. Supplementary information:Supplementary data are available at Bioinformatics online.
| S-EPMC5860364 | biostudies-literature
Project description:ImageJ and CellProfiler have long been leading open-source platforms in the field of bioimage analysis. ImageJ's traditional strength is in single-image processing and investigation, while CellProfiler is designed for building large-scale, modular analysis pipelines. Although many image analysis problems can be well solved with one or the other, using these two platforms together in a single workflow can be powerful. Here, we share two pipelines demonstrating mechanisms for productively and conveniently integrating ImageJ and CellProfiler for (1) studying cell morphology and migration via tracking, and (2) advanced stitching techniques for handling large, tiled image sets to improve segmentation. No single platform can provide all the key and most efficient functionality needed for all studies. While both programs can be and are often used separately, these pipelines demonstrate the benefits of using them together for image analysis workflows. ImageJ and CellProfiler are both committed to interoperability between their platforms, with ongoing development to improve how both are leveraged from the other. © 2021 Wiley Periodicals LLC. Basic Protocol 1: Studying cell morphology and cell migration in time-lapse datasets using TrackMate (Fiji) and CellProfiler Basic Protocol 2: Creating whole plate montages to easily assess adaptability of segmentation parameters.
| S-EPMC8450896 | biostudies-literature
Project description:There has been steady improvement in methods for capturing bioimages. However analysing these images still remains a challenge. The Python programming language provides a powerful and flexible environment for scientific computation. It has a wide range of supporting libraries for image processing but lacks native support for common bioimage formats, and requires specific code to be written to ensure that suitable audit trails are generated and analyses are reproducible. Here we describe the development of a Python tool that: (1) allows users to quickly view and explore microscopy data; (2) generate reproducible analyses, encoding a complete history of image transformations from raw data to final result; and (3) scale up analyses from initial exploration to high throughput processing pipelines, with a minimal amount of extra effort. The tool, jicbioimage, is open source and freely available online at http://jicbioimage.readthedocs.io.
| S-EPMC5119319 | biostudies-literature
Project description:Few studies within the pathogenic field have used advanced imaging and analytical tools to quantitatively measure pathogenicity in vivo. In this work, we present a novel approach for the investigation of host-pathogen processes based on medium-throughput 3D fluorescence imaging. The guinea pig model for Shigella flexneri invasion of the colonic mucosa was used to monitor the infectious process over time with GFP-expressing S. flexneri. A precise quantitative imaging protocol was devised to follow individual S. flexneri in a large tissue volume. An extensive dataset of confocal images was obtained and processed to extract specific quantitative information regarding the progression of S. flexneri infection in an unbiased and exhaustive manner. Specific parameters included the analysis of S. flexneri positions relative to the epithelial surface, S. flexneri density within the tissue, and volume of tissue destruction. In particular, at early time points, there was a clear association of S. flexneri with crypts, key morphological features of the colonic mucosa. Numerical simulations based on random bacterial entry confirmed the bias of experimentally measured S. flexneri for early crypt targeting. The application of a correlative light and electron microscopy technique adapted for thick tissue samples further confirmed the location of S. flexneri within colonocytes at the mouth of crypts. This quantitative imaging approach is a novel means to examine host-pathogen systems in a tailored and robust manner, inclusive of the infectious agent.
| S-EPMC4485126 | biostudies-other
Project description:Misinterpretations during language comprehension are common. The ability to recover from processing difficulties is therefore crucial for successful day-to-day communication. Previous research on the recovery from misinterpretations has focused on sentences containing syntactic ambiguities. The present study instead investigated the outcome of comprehension processes and online reading behavior when misinterpretations occurred due to lexical-semantic ambiguity. Ninety-six adult participants read "garden-path" sentences in which an ambiguous word was disambiguated toward an unexpected meaning (e.g., "The ball was crowded"), while their eye movements were monitored. A meaning coherence judgment task required them to decide whether or not each sentence made sense. Results suggested that readers did not always engage in reinterpretation processes but instead followed a "good enough" processing strategy. Successful detection of a violation of sentence coherence and associated reinterpretation processes also required additional processing time compared to sentences that did not induce a misinterpretation. Although these reinterpretation-related processing costs were relatively stable across individuals, there was some evidence to suggest that readers with greater lexical expertise benefited from greater sensitivity to the disambiguating information, and were able to flexibly adapt their online reading behavior to recover from misinterpretations more efficiently. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
| S-EPMC9535118 | biostudies-literature
Project description:Deep learning of artificial neural networks has become the de facto standard approach to solving data analysis problems in virtually all fields of science and engineering. Also in biology and medicine, deep learning technologies are fundamentally transforming how we acquire, process, analyze, and interpret data, with potentially far-reaching consequences for healthcare. In this mini-review, we take a bird's-eye view at the past, present, and future developments of deep learning, starting from science at large, to biomedical imaging, and bioimage analysis in particular.
| S-EPMC7494605 | biostudies-literature
Project description:Automated quantitative image analysis is essential for all fields of life science research. Although several software programs and algorithms have been developed for bioimage processing, an advanced knowledge of image processing techniques and high-performance computing resources are required to use them. Hence, we developed a cloud-based image analysis platform called IMACEL, which comprises morphological analysis and machine learning-based image classification. The unique click-based user interface of IMACEL's morphological analysis platform enables researchers with limited resources to evaluate particles rapidly and quantitatively without prior knowledge of image processing. Because all the image processing and machine learning algorithms are performed on high-performance virtual machines, users can access the same analytical environment from anywhere. A validation study of the morphological analysis and image classification of IMACEL was performed. The results indicate that this platform is an accessible and potentially powerful tool for the quantitative evaluation of bioimages that will lower the barriers to life science research.
| S-EPMC6386377 | biostudies-literature
Project description:Workflows are the keystone of bioimage analysis, and the NEUBIAS (Network of European BioImage AnalystS) community is trying to gather the actors of this field and organize the information around them. One of its most recent outputs is the opening of the F1000Research NEUBIAS gateway, whose main objective is to offer a channel of publication for bioimage analysis workflows and associated resources. In this paper we want to express some personal opinions and recommendations related to finding, handling and developing bioimage analysis workflows. The emergence of "big data" in bioimaging and resource-intensive analysis algorithms make local data storage and computing solutions a limiting factor. At the same time, the need for data sharing with collaborators and a general shift towards remote work, have created new challenges and avenues for the execution and sharing of bioimage analysis workflows. These challenges are to reproducibly run workflows in remote environments, in particular when their components come from different software packages, but also to document them and link their parameters and results by following the FAIR principles (Findable, Accessible, Interoperable, Reusable) to foster open and reproducible science. In this opinion paper, we focus on giving some directions to the reader to tackle these challenges and navigate through this complex ecosystem, in order to find and use workflows, and to compare workflows addressing the same problem. We also discuss tools to run workflows in the cloud and on High Performance Computing resources, and suggest ways to make these workflows FAIR.
| S-EPMC8182692 | biostudies-literature