PhUn-Net: ready-to-use neural network for unwrapping quantitative phase images of biological cells.
Ontology highlight
ABSTRACT:
SUBMITTER: Dardikman-Yoffe G
PROVIDER: S-EPMC7041455 | biostudies-literature | 2020 Feb
REPOSITORIES: biostudies-literature
Publications
PhUn-Net: ready-to-use neural network for unwrapping quantitative phase images of biological cells.
Dardikman-Yoffe Gili G Roitshtain Darina D Mirsky Simcha K SK Turko Nir A NA Habaza Mor M Shaked Natan T NT
Biomedical optics express 20200124 2
We present a deep-learning approach for solving the problem of 2<i>π</i> phase ambiguities in two-dimensional quantitative phase maps of biological cells, using a multi-layer encoder-decoder residual convolutional neural network. We test the trained network, PhUn-Net, on various types of biological cells, captured with various interferometric setups, as well as on simulated phantoms. These tests demonstrate the robustness and generality of the network, even for cells of different morphologies or ...[more]
Similar Datasets
Project description:PurposeWe report a new postprocessing procedure that uses Fourier-domain data analyses to improve the accuracy and reliability of phase unwrapping for MRI data of low SNR.MethodsThe developed method first identifies the Fourier-domain energy peak locations corresponding to different image-domain areas from which a robust measurement of image-domain phase gradients can be obtained even for MRI data of low SNR. The phase-gradient information measured from critical brain regions using the above-mentioned Fourier-domain analysis is then combined with the conventional temporal-domain or spatial-domain phase-unwrapping procedure to remove phase wraps. The developed method was tested with MRI data obtained from 30 healthy adult volunteers, and its performance was quantitatively evaluated.ResultsThe developed Fourier-domain analysis could robustly quantify image-domain phase gradients even for MRI data with low SNR (e.g., SNR ≃ 2). Experimental results show that the Fourier-domain analyses could further reduce phase wrap artifact in data produced by the conventional temporal-domain or spatial-domain phase-unwrapping procedures.ConclusionOur results demonstrate that the developed phase-unwrapping method can reduce residual phase wraps resulting from conventional procedures in critical brain regions (e.g., near the air-tissue interfaces) and should prove valuable for studies that require accurate measurements of MRI phase values, such as QSM, B0 field mapping, and temperature mapping.
| S-EPMC6491212 | biostudies-literature
Project description:The magnetic susceptibility of tissue within and around an image voxel affects the magnetic field and thus the local frequency in that voxel. Recently, it has been shown that spatial maps of frequency can be used to quantify local susceptibility if the contributions of surrounding tissue can be deconvolved. Currently, such quantitative susceptibility mapping (QSM) methods employ gradient recalled echo (GRE) imaging to measure spatial differences in the signal phase evolution as a function of echo time, from which frequencies can be deduced. Analysis of these phase images, however, is complicated by phase wraps, despite the availability and usage of various phase unwrapping algorithms. In addition, lengthy high-resolution GRE scanning often heats the magnet bore, causing the magnetic field to drift over several Hertz, which is on the order of the frequency differences between tissues. Here, we explore the feasibility of applying the WAter Saturation Shift Referencing (WASSR) method for 3D whole brain susceptibility imaging. WASSR uses direct saturation of water protons as a function of frequency irradiation offset to generate frequency maps without phase wraps, which can be combined with any image or spectroscopy acquisition. By utilizing a series of fast short-echo-time direct saturation images with multiple radiofrequency offsets, a frequency correction for field drift can be applied based on the individual image phases. Regions of interest were delineated with an automated atlas-based method, and the average magnetic susceptibilities calculated from frequency maps obtained from WASSR correlated well with those from the phase-based multi-echo GRE approach at 3T.
| S-EPMC3947267 | biostudies-literature
Project description:ObjectivesTo develop a U-Net-based deep learning model for automated segmentation of craniopharyngioma.MethodsA total number of 264 patients diagnosed with craniopharyngiomas were included in this research. Pre-treatment MRIs were collected, annotated, and used as ground truth to learn and evaluate the deep learning model. Thirty-eight patients from another institution were used for independently external testing. The proposed segmentation model was constructed based on a U-Net architecture. Dice similarity coefficients (DSCs), Hausdorff distance of 95% percentile (95HD), Jaccard value, true positive rate (TPR), and false positive rate (FPR) of each case were calculated. One-way ANOVA analysis was used to investigate if the model performance was associated with the radiological characteristics of tumors.ResultsThe proposed model showed a good performance in segmentation with average DSCs of 0.840, Jaccard of 0.734, TPR of 0.820, FPR of 0.000, and 95HD of 3.669 mm. It performed feasibly in the independent external test set, with average DSCs of 0.816, Jaccard of 0.704, TPR of 0.765, FPR of 0.000, and 95HD of 4.201 mm. Also, one-way ANOVA suggested the performance was not statistically associated with radiological characteristics, including predominantly composition (p = 0.370), lobulated shape (p = 0.353), compressed or enclosed ICA (p = 0.809), and cavernous sinus invasion (p = 0.283).ConclusionsThe proposed deep learning model shows promising results for the automated segmentation of craniopharyngioma.Key points• The segmentation model based on U-Net showed good performance in segmentation of craniopharyngioma. • The proposed model showed good performance regardless of the radiological characteristics of craniopharyngioma. • The model achieved feasibility in the independent external dataset obtained from another center.
| S-EPMC10017618 | biostudies-literature
Project description:Quantitative susceptibility mapping (QSM) is a recently developed MRI technique that provides a quantitative measure of tissue magnetic susceptibility. To compute tissue magnetic susceptibilities based on gradient echoes, QSM requires reliable unwrapping of the measured phase images and removal of contributions caused by background susceptibilities. Typically, the two steps are performed separately. Here, we present a method that simultaneously performs phase unwrapping and HARmonic (background) PhasE REmovaL using the LAplacian operator (HARPERELLA). Both numerical simulations and in vivo human brain images show that HARPERELLA effectively removes both phase wraps and background phase, whilst preserving all low spatial frequency components originating from brain tissues. When compared with other QSM phase preprocessing techniques, such as path-based phase unwrapping followed by background phase removal, HARPERELLA preserves the tissue phase signal in gray matter, white matter and cerebrospinal fluid with excellent robustness, providing a convenient and accurate solution for QSM. The proposed algorithm is provided, together with QSM and susceptibility tensor imaging (STI) tools, in a shared software package named 'STI Suite'.
| S-EPMC3947438 | biostudies-other
Project description:The multi-frequency temporal phase unwrapping (MF-TPU) method, as a classical phase unwrapping algorithm for fringe projection techniques, has the ability to eliminate the phase ambiguities even while measuring spatially isolated scenes or the objects with discontinuous surfaces. For the simplest and most efficient case in MF-TPU, two groups of phase-shifting fringe patterns with different frequencies are used: the high-frequency one is applied for 3D reconstruction of the tested object and the unit-frequency one is used to assist phase unwrapping for the wrapped phase with high frequency. The final measurement precision or sensitivity is determined by the number of fringes used within the high-frequency pattern, under the precondition that its absolute phase can be successfully recovered without any fringe order errors. However, due to the non-negligible noises and other error sources in actual measurement, the frequency of the high-frequency fringes is generally restricted to about 16, resulting in limited measurement accuracy. On the other hand, using additional intermediate sets of fringe patterns can unwrap the phase with higher frequency, but at the expense of a prolonged pattern sequence. With recent developments and advancements of machine learning for computer vision and computational imaging, it can be demonstrated in this work that deep learning techniques can automatically realize TPU through supervised learning, as called deep learning-based temporal phase unwrapping (DL-TPU), which can substantially improve the unwrapping reliability compared with MF-TPU even under different types of error sources, e.g., intensity noise, low fringe modulation, projector nonlinearity, and motion artifacts. Furthermore, as far as we know, our method was demonstrated experimentally that the high-frequency phase with 64 periods can be directly and reliably unwrapped from one unit-frequency phase using DL-TPU. These results highlight that challenging issues in optical metrology can be potentially overcome through machine learning, opening new avenues to design powerful and extremely accurate high-speed 3D imaging systems ubiquitous in nowadays science, industry, and multimedia.
| S-EPMC6934795 | biostudies-literature
Project description:Cassava roots are complex structures comprising several distinct types of root. The number and size of the storage roots are two potential phenotypic traits reflecting crop yield and quality. Counting and measuring the size of cassava storage roots are usually done manually, or semi-automatically by first segmenting cassava root images. However, occlusion of both storage and fibrous roots makes the process both time-consuming and error-prone. While Convolutional Neural Nets have shown performance above the state-of-the-art in many image processing and analysis tasks, there are currently a limited number of Convolutional Neural Net-based methods for counting plant features. This is due to the limited availability of data, annotated by expert plant biologists, which represents all possible measurement outcomes. Existing works in this area either learn a direct image-to-count regressor model by regressing to a count value, or perform a count after segmenting the image. We, however, address the problem using a direct image-to-count prediction model. This is made possible by generating synthetic images, using a conditional Generative Adversarial Network (GAN), to provide training data for missing classes. We automatically form cassava storage root masks for any missing classes using existing ground-truth masks, and input them as a condition to our GAN model to generate synthetic root images. We combine the resulting synthetic images with real images to learn a direct image-to-count prediction model capable of counting the number of storage roots in real cassava images taken from a low cost aeroponic growth system. These models are used to develop a system that counts cassava storage roots in real images. Our system first predicts age group ('young' and 'old' roots; pertinent to our image capture regime) in a given image, and then, based on this prediction, selects an appropriate model to predict the number of storage roots. We achieve 91% accuracy on predicting ages of storage roots, and 86% and 71% overall percentage agreement on counting 'old' and 'young' storage roots respectively. Thus we are able to demonstrate that synthetically generated cassava root images can be used to supplement missing root classes, turning the counting problem into a direct image-to-count prediction task.
| S-EPMC6888701 | biostudies-literature
Project description:In eukaryotic cells, DNA is packaged into chromatin where nucleosomes are the basic packaging unit. Important cellular processes including gene expression, DNA replication, and DNA repair require nucleosomal DNA to be unwrapped so that functional proteins can access their target sites, which otherwise are sterically occluded. A key question in this process is what the unwrapped conformations individual nucleosomes adopt within chromatin are. Here, we develop a concurrent nucleosome unwrapping model to address this question. We hypothesize that for a given end-to-end distance of the nucleosomal DNA, the nucleosomal DNA stochastically unwraps from the histone core from both ends independently and that this combination of unwrapping from both sides results in a significant increase in the average distance between the DNA extending from both sides of the nucleosomes. We test our model on recently published experiments using a DNA origami nanocaliper that quantifies nucleosome unwrapping and achieve good agreement between experiment and model prediction. We then investigate the DNA origami caliper distribution when attached to a hexasome (a nucleosome lacking an H2A/H2B dimer). A significant shift in the caliper angle distribution caused by the asymmetric structural features of the hexasome seen experimentally is consistent with the model. Our modeling approach may be more broadly useful to the interpretation of other studies of nucleosome dynamics, chromatin dynamics, and regulatory processes involving nucleosome unwrapping, as well as more generally to optimization of future DNA origami designs to probe mechanical properties of biomolecules.
| S-EPMC6895690 | biostudies-literature
Project description:Measuring speed is a critical factor to reduce motion artifacts for dynamic scene capture. Phase-shifting methods have the advantage of providing high-accuracy and dense 3D point clouds, but the phase unwrapping process affects the measurement speed. This paper presents an absolute phase unwrapping method capable of using only three speckle-embedded phase-shifted patterns for high-speed three-dimensional (3D) shape measurement on a single-camera, single-projector structured light system. The proposed method obtains the wrapped phase of the object from the speckle-embedded three-step phase-shifted patterns. Next, it utilizes the Semi-Global Matching (SGM) algorithm to establish the coarse correspondence between the image of the object with the embedded speckle pattern and the pre-obtained image of a flat surface with the same embedded speckle pattern. Then, a computational framework uses the coarse correspondence information to determine the fringe order pixel by pixel. The experimental results demonstrated that the proposed method can achieve high-speed and high-quality 3D measurements of complex scenes.
| S-EPMC9824817 | biostudies-literature
Project description:BackgroundAccurate phase unwrapping is a critical prerequisite for successful applications in phase-related MRI, including quantitative susceptibility mapping (QSM) and susceptibility weighted imaging. However, many existing 3D phase unwrapping algorithms face challenges in the presence of severe noise, rapidly changing phase, and open-end cutline.MethodsIn this study, we introduce a novel 3D phase unwrapping approach utilizing region partitioning and a local polynomial model. Initially, the method leverages phase partitioning to create initial regions. Noisy voxels connecting areas within these regions are excluded and grouped into residual voxels. The connected regions within the region of interest are then reidentified and categorized into blocks and residual voxels based on voxel count thresholds. Subsequently, the method sequentially performs inter-block and residual voxel phase unwrapping using the local polynomial model. The proposed method was evaluated on simulation and in vivo abdominal QSM data, and was compared with the classical Region-growing, Laplacian_based, Graph-cut, and PRELUDE methods.ResultsSimulation experiments, conducted under different signal-to-noise ratios and phase change levels, consistently demonstrate that the proposed method achieves accurate unwrapping results, with mean error ratios not exceeding 0.01%. In contrast, the error ratios of Region-growing (N/A, 84.47%), Laplacian_based (20.65%, N/A), Graph-cut (2.26%, 20.71%), and PRELUDE (4.28%, 10.33%) methods are all substantially higher than those of the proposed method. In vivo abdominal QSM experiments further confirm the effectiveness of the proposed method in unwrapping phase data and successfully reconstructing susceptibility maps, even in scenarios with significant noise, rapidly changing phase, and open-end cutline in a large field of view.ConclusionThe proposed method demonstrates robust and accurate phase unwrapping capabilities, positioning it as a promising option for abdominal QSM applications.
| S-EPMC10684715 | biostudies-literature
Project description:Background To develop an accurate and robust 3-dimensional (3D) phase-unwrapping method that works effectively in the presence of severe noise, disconnected regions, rapid phase changes, and open-ended lines for quantitative susceptibility mapping (QSM). Methods We developed a 3D phase-unwrapping method based on voxel clustering and local polynomial modeling named CLOSE3D, which firstly explores the 26-neighborhood to calculate local variation of the phasor and the phase, and then according to the local variation of the phasor, clusters the phase data into easy-to-unwrap blocks and difficult-to-unwrap residual voxels. Next, CLOSE3D sequentially performs intrablock, interblock, and residual-voxel unwrapping by using the region-growing local polynomial modeling method. CLOSED3D was evaluated in simulation and using in vivo brain QSM data, and was compared with classical region-growing and region-expanding labeling for unwrapping estimates methods. Results The simulation experiments showed that CLOSE3D achieved accurate phase-unwrapping results with a mean error ratio <0.39%, even in the presence of serious noise, disconnected regions, and rapid phase changes. The error ratios of region-growing (P=0.000 and P=0.000) and region-expanding labeling for unwrapping estimates (P=0.007, P=0.014) methods were both significantly higher than that of CLOSE3D, when the noise level was ≥60%. The results of the in vivo brain QSM experiments showed that CLOSE3D unwrapped the phase data and accurately reconstructed quantitative susceptibility data, even with serious noise, rapid-varying phase, or an open-ended cutline. Conclusions CLOSE3D achieves phase unwrapping with high accuracy and robustness, which will help phase-related 3D magnetic resonance imaging (MRI) applications such as QSM and susceptibility weighted imaging.
| S-EPMC10006161 | biostudies-literature