Towards markerless surgical tool and hand pose estimation.

ABSTRACT:

Purpose

 : Tracking of tools and surgical activity is becoming more and more important in the context of computer assisted surgery. In this work, we present a data generation framework, dataset and baseline methods to facilitate further research in the direction of markerless hand and instrument pose estimation in realistic surgical scenarios.

Methods

 : We developed a rendering pipeline to create inexpensive and realistic synthetic data for model pretraining. Subsequently, we propose a pipeline to capture and label real data with hand and object pose ground truth in an experimental setup to gather high-quality real data. We furthermore present three state-of-the-art RGB-based pose estimation baselines.

Results

 : We evaluate three baseline models on the proposed data

SUBMITTER: Hein J 

PROVIDER: S-EPMC8134312 | biostudies-literature | 2021 May

REPOSITORIES: biostudies-literature