NeRF-OR: neural radiance fields for operating room scene reconstruction from sparse-view RGB-D videos.

ABSTRACT:

Purpose

RGB-D cameras in the operating room (OR) provide synchronized views of complex surgical scenes. Assimilation of this multi-view data into a unified representation allows for downstream tasks such as object detection and tracking, pose estimation, and action recognition. Neural radiance fields (NeRFs) can provide continuous representations of complex scenes with limited memory footprint. However, existing NeRF methods perform poorly in real-world OR settings, where a small set of cameras capture the room from entirely different vantage points. In this work, we propose NeRF-OR, a method for 3D reconstruction of dynamic surgical scenes in the OR.

Methods

Where other methods for sparse-view datasets use either time-of-flight sensor depth or dense depth estimated from col

SUBMITTER: Gerats BGA 

PROVIDER: S-EPMC11758168 | biostudies-literature | 2025 Jan

REPOSITORIES: biostudies-literature