Real-time integration between Microsoft HoloLens 2 and 3D Slicer with demonstration in pedicle screw placement planning.

ABSTRACT:

Purpose

Up to date, there has been a lack of software infrastructure to connect 3D Slicer to any augmented reality (AR) device. This work describes a novel connection approach using Microsoft HoloLens 2 and OpenIGTLink, with a demonstration in pedicle screw placement planning.

Methods

We developed an AR application in Unity that is wirelessly rendered onto Microsoft HoloLens 2 using Holographic Remoting. Simultaneously, Unity connects to 3D Slicer using the OpenIGTLink communication protocol. Geometrical transform and image messages are transferred between both platforms in real time. Through the AR glasses, a user visualizes a patient's computed tomography overlaid onto virtual 3D models showing anatomical structures. We technically evaluated the system by measuring message

SUBMITTER: Pose-Diez-de-la-Lastra A 

PROVIDER: S-EPMC10589185 | biostudies-literature | 2023 Nov

REPOSITORIES: biostudies-literature