Dataset Information

Handheld snapshot multi-spectral camera at tens-of-megapixel resolution.

ABSTRACT: Multi-spectral imaging is a fundamental tool characterizing the constituent energy of scene radiation. However, current multi-spectral video cameras cannot scale up beyond megapixel resolution due to optical constraints and the complexity of the reconstruction algorithms. To circumvent the above issues, we propose a tens-of-megapixel handheld multi-spectral videography approach (THETA), with a proof-of-concept camera achieving 65-megapixel videography of 12 wavebands within visible light range. The high performance is brought by multiple designs: We propose an imaging scheme to fabricate a thin mask for encoding spatio-spectral data using a conventional film camera. Afterwards, a fiber optic plate is introduced for building a compact prototype supporting pixel-wise encoding with a large space-bandwidth product. Finally, a deep-network-based algorithm is adopted for large-scale multi-spectral data decoding, with the coding pattern specially designed to facilitate efficient coarse-to-fine model training. Experimentally, we demonstrate THETA's advantageous and wide applications in outdoor imaging of large macroscopic scenes.

SUBMITTER: Zhang W

PROVIDER: S-EPMC10439928 | biostudies-literature | 2023 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Handheld snapshot multi-spectral camera at tens-of-megapixel resolution.

Zhang Weihang W Suo Jinli J Dong Kaiming K Li Lianglong L Yuan Xin X Pei Chengquan C Dai Qionghai Q

Nature communications 20230819 1

Multi-spectral imaging is a fundamental tool characterizing the constituent energy of scene radiation. However, current multi-spectral video cameras cannot scale up beyond megapixel resolution due to optical constraints and the complexity of the reconstruction algorithms. To circumvent the above issues, we propose a tens-of-megapixel handheld multi-spectral videography approach (THETA), with a proof-of-concept camera achieving 65-megapixel videography of 12 wavebands within visible light range. ...[more]

PMID: 37598234

Similar Datasets

Project description:BackgroundLaparoscopic surgery potentially increases the physical burden to operating theater personnel and can cause physical discomfort. This study aims to evaluate if a robotic camera holder (AutoLap™ system) can improve ergonomics for the surgeon and the camera assistant during laparoscopic procedures.MethodsA total of thirty cases were included and randomized (15 AutoLap™, 15 control). Five types of surgery were included: right hemicolectomy, fundoplication, sigmoid resection, rectopexy, and low anterior resection. The posture of the surgeon and assistant was photographed during predefined steps of the procedure. MATLAB was used to calculate angles relevant for the RULA score. The RULA score is a validated method to evaluate body posture, force and repetition of the upper extremities. Two investigators assessed the RULA score independently. Three subjective questionnaires (SMEQ, NASA TLX, and LED) were used to assess mental and physical discomfort.ResultsNo differences in patient characteristics were observed. Sixteen fundoplications, seven right hemicolectomies, five sigmoid resections, one rectopexy, and one low anterior resection were included. The mean RULA score of the surgeon was comparable in both groups, 2.58 (AutoLap™) versus 2.72 (control). The mean RULA score of the assistant was significantly different in both groups, with 2.55 (AutoLap™) versus 3.70 (control) (p = 0.001). The inter-observer variability (ICC) was excellent with 0.93 (surgeon) and 0.97 (assistant). The questionnaires showed a significant difference in physical discomfort for the assistant. The LED and SMEQ score were significantly lower in the robotic group. The NASA TLX demonstrated a significant reduction in scores in all domains when using robotics with the exception of the mental domain.ConclusionUse of the AutoLap™ system shows improvement in ergonomics and posture of the first assistant, and ergonomics of the surgeon are not affected. Furthermore, the subjective work load is significantly reduced by using a robotic camera holder.Trial registration numberNCT0339960, https://clinicaltrials.gov/ct2/show/study/NCT03339960?term=autolap&rank=5 .

Dataset Information

Handheld snapshot multi-spectral camera at tens-of-megapixel resolution.

Publications

Handheld snapshot multi-spectral camera at tens-of-megapixel resolution.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets