Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Deeply learned broadband encoding stochastic hyperspectral imaging.

ABSTRACT: Many applications requiring both spectral and spatial information at high resolution benefit from spectral imaging. Although different technical methods have been developed and commercially available, computational spectral cameras represent a compact, lightweight, and inexpensive solution. However, the tradeoff between spatial and spectral resolutions, dominated by the limited data volume and environmental noise, limits the potential of these cameras. In this study, we developed a deeply learned broadband encoding stochastic hyperspectral camera. In particular, using advanced artificial intelligence in filter design and spectrum reconstruction, we achieved 7000-11,000 times faster signal processing and ~10 times improvement regarding noise tolerance. These improvements enabled us to precisely and dynamically reconstruct the spectra of the entire field of view, previously unreachable with compact computational spectral cameras.

SUBMITTER: Zhang W

PROVIDER: S-EPMC8149860 | biostudies-literature | 2021 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Deeply learned broadband encoding stochastic hyperspectral imaging.

Zhang Wenyi W Song Hongya H He Xin X Huang Longqian L Zhang Xiyue X Zheng Junyan J Shen Weidong W Hao Xiang X Liu Xu X

Light, science & applications 20210525 1

Many applications requiring both spectral and spatial information at high resolution benefit from spectral imaging. Although different technical methods have been developed and commercially available, computational spectral cameras represent a compact, lightweight, and inexpensive solution. However, the tradeoff between spatial and spectral resolutions, dominated by the limited data volume and environmental noise, limits the potential of these cameras. In this study, we developed a deeply learne ...[more]

PMID: 34035213

Similar Datasets

Broadband CARS Hyperspectral Classification of Single Immune Cells.

Project description:Broadband CARS is a coherent Raman scattering technique that provides access to the full biological vibrational spectrum within milliseconds, facilitating the recording of widefield hyperspectral Raman images. In this work, BCARS hyperspectral images of unstained cells from two different cell lines of immune lineage (T cell [Jurkat] and pDCs [CAL-1]) were recorded and analyzed using multivariate statistical algorithms in order to determine the spectral differences between the cells. A classifier was trained which could distinguish the known cells with a 97% out-of-bag accuracy. The classifier was then applied to unlabeled samples containing a mixture of the two cell types on the same coverslip. This work demonstrates single-cell analysis of pDCs (CAL-1) and T cells (Jurkat) using BCARS. This approach enables an initial validation of cellular classification. We further demonstrate the capability of BCARS cell classification using single spectra of 5 ms acquisition time.

| S-EPMC11884967 | biostudies-literature

Integration of hyperspectral imaging and transcriptomics from individual cells with HyperSeq

Project description:Microscopy and omics are complementary approaches to probe the molecular state of cells in health and disease, combining granularity with scalability. While important advances have been achieved over the last decade in each area, integrating both imaging- and sequencing-based assays on the same cell has proven challenging. In this study, a new approach called HyperSeq that combines hyperspectral autofluorescence imaging with transcriptomics on the same cell is demonstrated. HyperSeq was applied to Michigan Cancer Foundation 7 (MCF-7) breast cancer cells and identified a subpopulation of cells exhibiting bright autofluorescence rings at the plasma membrane in optical channel 13 (ex = 431 nm, em = 594 nm). Correlating the presence of a ring with the gene expression in the same cell indicated that ringed cells are more likely to express hallmark genes of apoptosis and gene silencing and less likely to express genes associated with ATP production. Further, correlation of cell morphology with gene expression suggested that multiple members of the spliceosome were upregulated in larger cells. A number of genes, albeit evenly expressed across cell sizes, exhibited higher usage of specific exons in larger or smaller cells. Finally, correlation between gene expression and fluorescence within the spectral range of Nicotinamide adenine dinucleotide hydrogen (NADH) provided preliminary insight into the metabolic states of cells. These observations provided a link between the cell’s optical spectrum and its internal molecular state, demonstrating the utility of HyperSeq to study cell biology at single cell resolution by integrating spectral, morphological and transcriptomic analyses into a single, streamlined workflow.

2024-02-05 | GSE254034 | GEO

A broadband hyperspectral image sensor with high spatio-temporal resolution.

Project description:Hyperspectral imaging provides high-dimensional spatial-temporal-spectral information showing intrinsic matter characteristics1-5. Here we report an on-chip computational hyperspectral imaging framework with high spatial and temporal resolution. By integrating different broadband modulation materials on the image sensor chip, the target spectral information is non-uniformly and intrinsically coupled to each pixel with high light throughput. Using intelligent reconstruction algorithms, multi-channel images can be recovered from each frame, realizing real-time hyperspectral imaging. Following this framework, we fabricated a broadband visible-near-infrared (400-1,700 nm) hyperspectral image sensor using photolithography, with an average light throughput of 74.8% and 96 wavelength channels. The demonstrated resolution is 1,024 × 1,024 pixels at 124 fps. We demonstrated its wide applications, including chlorophyll and sugar quantification for intelligent agriculture, blood oxygen and water quality monitoring for human health, textile classification and apple bruise detection for industrial automation, and remote lunar detection for astronomy. The integrated hyperspectral image sensor weighs only tens of grams and can be assembled on various resource-limited platforms or equipped with off-the-shelf optical systems. The technique transforms the challenge of high-dimensional imaging from a high-cost manufacturing and cumbersome system to one that is solvable through on-chip compression and agile computation.

| S-EPMC11541218 | biostudies-literature

MISSING DATA IMPUTATION IN THE ELECTRONIC HEALTH RECORD USING DEEPLY LEARNED AUTOENCODERS.

Project description:Electronic health records (EHRs) have become a vital source of patient outcome data but the widespread prevalence of missing data presents a major challenge. Different causes of missing data in the EHR data may introduce unintentional bias. Here, we compare the effectiveness of popular multiple imputation strategies with a deeply learned autoencoder using the Pooled Resource Open-Access ALS Clinical Trials Database (PRO-ACT). To evaluate performance, we examined imputation accuracy for known values simulated to be either missing completely at random or missing not at random. We also compared ALS disease progression prediction across different imputation models. Autoencoders showed strong performance for imputation accuracy and contributed to the strongest disease progression predictor. Finally, we show that despite clinical heterogeneity, ALS disease progression appears homogenous with time from onset being the most important predictor.

| S-EPMC5144587 | biostudies-literature

A Time-Encoded Technique for fibre-based hyperspectral broadband stimulated Raman microscopy.

Project description:Raman sensing and microscopy are among the most specific optical technologies to identify the chemical compounds of unknown samples, and to enable label-free biomedical imaging. Here we present a method for stimulated Raman scattering spectroscopy and imaging with a time-encoded (TICO) Raman concept. We use continuous wave, rapidly wavelength-swept probe lasers and combine them with a short-duty-cycle actively modulated pump laser. Hence, we achieve high stimulated Raman gain signal levels, while still benefitting from the narrow linewidth and low noise of continuous wave operation. Our all-fibre TICO-Raman setup uses a Fourier domain mode-locked laser source to achieve a unique combination of high speed, broad spectral coverage (750-3,150 cm(-1)) and high resolution (0.5 cm(-1)). The Raman information is directly encoded and acquired in time. We demonstrate quantitative chemical analysis of a solvent mixture and hyperspectral Raman microscopy with molecular contrast of plant cells.

| S-EPMC4410670 | biostudies-literature

Hyperspectral imaging for chloroplast movement detection.

Project description:We employed hyperspectral imaging to detect chloroplast positioning and assess its influence on common vegetation indices. In low blue light, chloroplasts move to cell walls perpendicular to the direction of the incident light. In high blue light, chloroplasts exhibit the avoidance response, moving to cell walls parallel to the light direction. Irradiation with high light resulted in significant changes in leaf reflectance and the shape of the reflectance spectrum. Using mutants with disrupted chloroplast movements, we found that blue light-induced changes in the reflectance spectrum are mostly due to chloroplast relocations. We trained machine learning methods in the classification of leaves according to the chloroplast positioning, based on the reflectance spectra. The convolutional network showed low levels of misclassification of leaves irradiated with high light even when different species were used for training and testing, suggesting that reflectance spectra may be used to detect chloroplast avoidance in heterogeneous vegetation. We also examined the correlation between chloroplast positioning and values of indices of normalized-difference type for various combinations of wavelengths and identified an index sensitive to chloroplast positioning. We found that values of some of the vegetation indices, including those sensitive to the carotenoid levels, may be altered due to chloroplast rearrangements.

| S-EPMC11805589 | biostudies-literature

On the Effect of Learned Clauses on Stochastic Local Search

Project description:There are two competing paradigms in successful SAT solvers: Conflict-driven clause learning (CDCL) and stochastic local search (SLS). CDCL uses systematic exploration of the search space and has the ability to learn new clauses. SLS examines the neighborhood of the current complete assignment. Unlike CDCL, it lacks the ability to learn from its mistakes. This work revolves around the question whether it is beneficial for SLS to add new clauses to the original formula. We experimentally demonstrate that clauses with a large number of correct literals w. r. t. a fixed solution are beneficial to the runtime of SLS. We call such clauses high-quality clauses. Empirical evaluations show that short clauses learned by CDCL possess the high-quality attribute. We study several domains of randomly generated instances and deduce the most beneficial strategies to add high-quality clauses as a preprocessing step. The strategies are implemented in an SLS solver, and it is shown that this considerably improves the state-of-the-art on randomly generated instances. The results are statistically significant.

| S-EPMC7326537 | biostudies-literature

Broadband thermal imaging using meta-optics.

Project description:Subwavelength diffractive optics known as meta-optics have demonstrated the potential to significantly miniaturize imaging systems. However, despite impressive demonstrations, most meta-optical imaging systems suffer from strong chromatic aberrations, limiting their utilities. Here, we employ inverse-design to create broadband meta-optics operating in the long-wave infrared (LWIR) regime (8-12 μm). Via a deep-learning assisted multi-scale differentiable framework that links meta-atoms to the phase, we maximize the wavelength-averaged volume under the modulation transfer function (MTF) surface of the meta-optics. Our design framework merges local phase-engineering via meta-atoms and global engineering of the scatterer within a single pipeline. We corroborate our design by fabricating and experimentally characterizing all-silicon LWIR meta-optics. Our engineered meta-optic is complemented by a simple computational backend that dramatically improves the quality of the captured image. We experimentally demonstrate a six-fold improvement of the wavelength-averaged Strehl ratio over the traditional hyperboloid metalens for broadband imaging.

| S-EPMC10891089 | biostudies-literature

Stochastic image spectroscopy: a discriminative generative approach to hyperspectral image modelling and classification.

Project description:This paper introduces a new latent variable probabilistic framework for representing spectral data of high spatial and spectral dimensionality, such as hyperspectral images. We use a generative Bayesian model to represent the image formation process and provide interpretable and efficient inference and learning methods. Surprisingly, our approach can be implemented with simple tools and does not require extensive training data, detailed pixel-by-pixel labeling, or significant computational resources. Numerous experiments with simulated data and real benchmark scenarios show encouraging image classification performance. These results validate the unique ability of our framework to discriminate complex hyperspectral images, irrespective of the presence of highly discriminative spectral signatures.

| S-EPMC11336186 | biostudies-literature

Comparison of a portable Vis-NIR hyperspectral imaging and a snapscan SWIR hyperspectral imaging for evaluation of meat authenticity.

Project description:The performance of visible-near infrared hyperspectral imaging (Vis-NIR-HSI) (400-1000 nm) and shortwave infrared hyperspectral imaging (SWIR-HSI) (1116-1670 nm) combined with different classification and regression (linear and non-linear) multivariate methods were assessed for meat authentication. In Vis-NIR-HSI, total accuracies in the prediction set for SVM and ANN-BPN (the best classification models) were 96 and 94 % surpassing the performance of SWIR-HSI with 88 and 89 % accuracy, respectively. In Vis-NIR-HSI, the best-obtained coefficient of determinations for the prediction set (R2p) were 0.99, 0.88, and 0.99 with root mean square error in prediction (RMSEP) of 9, 24 and 4 (%w/w) for pork in beef, pork in lamb and pork in chicken, respectively. In SWIR-HSI, the best-obtained R2p were 0.86, 0.77, and 0.89 with RMSEP of 16, 23 and 15 (%w/w) for pork in beef, pork in lamb and pork in chicken, respectively. The results ascertain that Vis-NIR-HSI coupled with multivariate data analysis has better performance rather than SWIR-HIS.

| S-EPMC10314175 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data