Snapshot hyperspectral light field tomography
Ontology highlight
ABSTRACT:
SUBMITTER: Cui Q
PROVIDER: S-EPMC9202651 | biostudies-literature | 2021 Dec
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Cameras with extreme speeds are enabling technologies in both fundamental and applied sciences. However, existing ultrafast cameras are incapable of coping with extended three-dimensional scenes and fall short for non-line-of-sight imaging, which requires a long sequence of time-resolved two-dimensional data. Current non-line-of-sight imagers, therefore, need to perform extensive scanning in the spatial and/or temporal dimension, restricting their use in imaging only static or slowly moving objects. To address these long-standing challenges, we present here ultrafast light field tomography (LIFT), a transient imaging strategy that offers a temporal sequence of over 1000 and enables highly efficient light field acquisition, allowing snapshot acquisition of the complete four-dimensional space and time. With LIFT, we demonstrated three-dimensional imaging of light in flight phenomena with a <10 picoseconds resolution and non-line-of-sight imaging at a 30 Hz video-rate. Furthermore, we showed how LIFT can benefit from deep learning for an improved and accelerated image formation. LIFT may facilitate broad adoption of time-resolved methods in various disciplines.
| S-EPMC8041853 | biostudies-literature
Project description:Ideal imaging, which is constantly pursued, requires the collection of all kinds of optical information of the objects in view, such as three-dimensional spatial information (3D) including the planar distribution and depth, and the colors, i.e., spectral information (1D). Although three-dimensional spatial imaging and spectral imaging have individually evolved rapidly, their straightforward combination is a cumbersome system, severely hindering the practical applications of four-dimensional (4D) imaging. Here, we demonstrate the ultra-compact spectral light-field imaging (SLIM) by using a transversely dispersive metalens array and a monochrome imaging sensor. With only one snapshot, the SLIM presents advanced imaging with a 4 nm spectral resolution and near-diffraction-limit spatial resolution. Consequently, visually indistinguishable objects and materials can be discriminated through SLIM, which promotes significant progress towards ideal plenoptic imaging.
| S-EPMC9117667 | biostudies-literature
Project description:The observation of ionic signaling dynamics in intact pancreatic islets has contributed greatly to our understanding of both α- and β-cell function. Insulin secretion from β-cells depends on the firing of action potentials and consequent rises of intracellular calcium activity ([Ca(2+)]i). Zinc (Zn(2+)) is cosecreted with insulin, and has been postulated to play a role in cell-to-cell cross talk within an islet, in particular inhibiting glucagon secretion from α-cells. Thus, measuring [Ca(2+)]i and Zn(2+) dynamics from both α- and β-cells will elucidate mechanisms underlying islet hormone secretion. [Ca(2+)]i and intracellular Zn(2+) can be measured using fluorescent biosensors, but the most efficient sensors have overlapping spectra that complicate their discrimination. Hyperspectral imaging can be used to distinguish signals from multiple fluorophores, but available hyperspectral implementations are either too slow to measure the dynamics of ionic signals or not suitable for thick samples. We have developed a five-dimensional (x,y,z,t,λ) imaging system that leverages a snapshot hyperspectral imaging method, image mapping spectrometry, and light-sheet microscopy. This system provides subsecond temporal resolution from deep within multicellular structures. Using a single excitation wavelength (488 nm) we acquired images from triply labeled samples with two biosensors and a genetically expressing fluorescent protein (spectrally overlapping with one of the biosensors) with high temporal resolution. Measurements of [Ca(2+)]i and Zn(2+) within both α- and β-cells as a function of glucose concentration show heterogeneous uptake of Zn(2+) into α-cells that correlates to the known heterogeneities in [Ca(2+)]i. These differences in intracellular Zn(2+) among α-cells may contribute to the inhibition in glucagon secretion observed at elevated glucose levels.
| S-EPMC4968423 | biostudies-literature
Project description:The comprehensive analysis of biological specimens brings about the demand for capturing the spatial, temporal and spectral dimensions of visual information together. However, such high-dimensional video acquisition faces major challenges in developing large data throughput and effective multiplexing techniques. Here, we report the snapshot hyperspectral volumetric microscopy that computationally reconstructs hyperspectral profiles for high-resolution volumes of ~1000 μm × 1000 μm × 500 μm at video rate by a novel four-dimensional (4D) deconvolution algorithm. We validated the proposed approach with both numerical simulations for quantitative evaluation and various real experimental results on the prototype system. Different applications such as biological component analysis in bright field and spectral unmixing of multiple fluorescence are demonstrated. The experiments on moving fluorescent beads and GFP labelled drosophila larvae indicate the great potential of our method for observing multiple fluorescent markers in dynamic specimens.
| S-EPMC4840377 | biostudies-literature
Project description:Vibrational microscopy methods based on Raman scattering or infrared absorption provide a label-free approach for chemical-contrast imaging, but employ point-by-point scanning and impose a compromise between the imaging speed and field-of-view (FOV). Optothermal microscopy has been proposed as a promising imaging modality to avoid this compromise, although at restrictively small FOVs capable of imaging only few cells. Here, we present wide-field optothermal mid-infrared microscopy (WOMiM) for wide-field chemical-contrast imaging based on snapshot pump-probe detection of optothermal signal, using a custom-made condenser-free phase contrast microscopy to capture the phase change of samples after mid-infrared irradiation. We achieved chemical contrast for FOVs up to 180 μm in diameter, yielding 10-fold larger imaging areas than the state-of-the-art, at imaging speeds of 1 ms/frame. The maximum possible imaging speed of WOMiM was determined by the relaxation time of optothermal heat, measured to be 32.8 μs in water, corresponding to a frame rate of ∼30 kHz. This proof-of-concept demonstrates that vibrational imaging can be achieved at an unprecedented imaging speed and large FOV with the potential to significantly facilitate label-free imaging of cellular dynamics.
| S-EPMC8613735 | biostudies-literature
Project description:IntroductionThe eye offers potential for the diagnosis of Alzheimer's disease (AD) with retinal imaging techniques being explored to quantify amyloid accumulation and aspects of neurodegeneration. To assess these changes, this proof-of-concept study combined hyperspectral imaging and optical coherence tomography to build a classification model to differentiate between AD patients and controls.MethodsIn a memory clinic setting, patients with a diagnosis of clinically probable AD (n = 10) or biomarker-proven AD (n = 7) and controls (n = 22) underwent non-invasive retinal imaging with an easy-to-use hyperspectral snapshot camera that collects information from 16 spectral bands (460-620 nm, 10-nm bandwidth) in one capture. The individuals were also imaged using optical coherence tomography for assessing retinal nerve fiber layer thickness (RNFL). Dedicated image preprocessing analysis was followed by machine learning to discriminate between both groups.ResultsHyperspectral data and retinal nerve fiber layer thickness data were used in a linear discriminant classification model to discriminate between AD patients and controls. Nested leave-one-out cross-validation resulted in a fair accuracy, providing an area under the receiver operating characteristic curve of 0.74 (95% confidence interval [0.60-0.89]). Inner loop results showed that the inclusion of the RNFL features resulted in an improvement of the area under the receiver operating characteristic curve: for the most informative region assessed, the average area under the receiver operating characteristic curve was 0.70 (95% confidence interval [0.55, 0.86]) and 0.79 (95% confidence interval [0.65, 0.93]), respectively. The robust statistics used in this study reduces the risk of overfitting and partly compensates for the limited sample size.ConclusionsThis study in a memory-clinic-based cohort supports the potential of hyperspectral imaging and suggests an added value of combining retinal imaging modalities. Standardization and longitudinal data on fully amyloid-phenotyped cohorts are required to elucidate the relationship between retinal structure and cognitive function and to evaluate the robustness of the classification model.
| S-EPMC7654576 | biostudies-literature
Project description:Hyperspectral imaging has tremendous potential to detect important molecular biomarkers of early cancer based on their unique spectral signatures. Several drawbacks have limited its use for in vivo screening applications: most notably the poor temporal and spatial resolution, high expense, and low optical throughput of existing hyperspectral imagers. We present the development of a new real-time hyperspectral endoscope (called the image mapping spectroscopy endoscope) based on an image mapping technique capable of addressing these challenges. The parallel high throughput nature of this technique enables the device to operate at frame rates of 5.2 frames per second while collecting a (x, y, λ) datacube of 350 × 350 × 48. We have successfully imaged tissue in vivo, resolving a vasculature pattern of the lower lip while simultaneously detecting oxy-hemoglobin.
| S-EPMC3107836 | biostudies-other
Project description:High-speed three-dimensional (3D) intravital imaging in animals is useful for studying transient subcellular interactions and functions in health and disease. Light-field microscopy (LFM) provides a computational solution for snapshot 3D imaging with low phototoxicity but is restricted by low resolution and reconstruction artifacts induced by optical aberrations, motion and noise. Here, we propose virtual-scanning LFM (VsLFM), a physics-based deep learning framework to increase the resolution of LFM up to the diffraction limit within a snapshot. By constructing a 40 GB high-resolution scanning LFM dataset across different species, we exploit physical priors between phase-correlated angular views to address the frequency aliasing problem. This enables us to bypass hardware scanning and associated motion artifacts. Here, we show that VsLFM achieves ultrafast 3D imaging of diverse processes such as the beating heart in embryonic zebrafish, voltage activity in Drosophila brains and neutrophil migration in the mouse liver at up to 500 volumes per second.
| S-EPMC10172145 | biostudies-literature
Project description:This study pioneers the application of artificial intelligence (AI) and hyperspectral imaging (HSI) in the diagnosis of skin cancer lesions, particularly focusing on Mycosis fungoides (MF) and its differentiation from psoriasis (PsO) and atopic dermatitis (AD). By utilizing a comprehensive dataset of 1659 skin images, including cases of MF, PsO, AD, and normal skin, a novel multi-frame AI algorithm was used for computer-aided diagnosis. The automatic segmentation and classification of skin lesions were further explored using advanced techniques, such as U-Net Attention models and XGBoost algorithms, transforming images from the color space to the spectral domain. The potential of AI and HSI in dermatological diagnostics was underscored, offering a noninvasive, efficient, and accurate alternative to traditional methods. The findings are particularly crucial for early-stage invasive lesion detection in MF, showcasing the model's robust performance in segmenting and classifying lesions and its superior predictive accuracy validated through k-fold cross-validation. The model attained its optimal performance with a k-fold cross-validation value of 7, achieving a sensitivity of 90.72%, a specificity of 96.76%, an F1-score of 90.08%, and an ROC-AUC of 0.9351. This study marks a substantial advancement in dermatological diagnostics, thereby contributing significantly to the early and precise identification of skin malignancies and inflammatory conditions.
| S-EPMC10778186 | biostudies-literature
Project description:Snapshot recording of transient dynamics in three dimensions (3-D) is highly demanded in both fundamental and applied sciences. Yet it remains challenging for conventional high-speed cameras to address this need due to limited electronic bandwidth and reliance on mechanical scanning. The emergence of light field tomography (LIFT) provides a new solution to these long-standing problems and enables 3-D imaging at an unprecedented frame rate. However, based on sparse-view computed tomography, LIFT can accommodate only a limited number of projections, degrading the resolution in the reconstructed image. To alleviate this problem, we herein present a spectral encoding scheme to significantly increase the number of allowable projections in LIFT while maintaining its snapshot advantage. The resultant system can record 3-D dynamics at a kilohertz volumetric frame rate. Moreover, by using a multichannel compressed sensing algorithm, we improve the image quality with an enhanced spatial resolution and suppressed aliasing artifacts.
| S-EPMC10270672 | biostudies-literature