Temporally consistent sequence-to-sequence translation of cataract surgeries.

ABSTRACT:

Purpose

Image-to-image translation methods can address the lack of diversity in publicly available cataract surgery data. However, applying image-to-image translation to videos-which are frequently used in medical downstream applications-induces artifacts. Additional spatio-temporal constraints are needed to produce realistic translations and improve the temporal consistency of translated image sequences.

Methods

We introduce a motion-translation module that translates optical flows between domains to impose such constraints. We combine it with a shared latent space translation model to improve image quality. Evaluations are conducted regarding translated sequences' image quality and temporal consistency, where we propose novel quantitative metrics for the latter. Finally, t

SUBMITTER: Frisch Y 

PROVIDER: S-EPMC10329626 | biostudies-literature | 2023 Jul

REPOSITORIES: biostudies-literature