Unknown

Dataset Information

0

Pairwise domain adaptation module for CNN-based 2-D/3-D registration.


ABSTRACT: Accurate two-dimensional to three-dimensional (2-D/3-D) registration of preoperative 3-D data and intraoperative 2-D x-ray images is a key enabler for image-guided therapy. Recent advances in 2-D/3-D registration formulate the problem as a learning-based approach and exploit the modeling power of convolutional neural networks (CNN) to significantly improve the accuracy and efficiency of 2-D/3-D registration. However, for surgery-related applications, collecting a large clinical dataset with accurate annotations for training can be very challenging or impractical. Therefore, deep learning-based 2-D/3-D registration methods are often trained with synthetically generated data, and a performance gap is often observed when testing the trained model on clinical data. We propose a pairwise domain adaptation (PDA) module to adapt the model trained on source domain (i.e., synthetic data) to target domain (i.e., clinical data) by learning domain invariant features with only a few paired real and synthetic data. The PDA module is designed to be flexible for different deep learning-based 2-D/3-D registration frameworks, and it can be plugged into any pretrained CNN model such as a simple Batch-Norm layer. The proposed PDA module has been quantitatively evaluated on two clinical applications using different frameworks of deep networks, demonstrating its significant advantages of generalizability and flexibility for 2-D/3-D medical image registration when a small number of paired real-synthetic data can be obtained.

SUBMITTER: Zheng J 

PROVIDER: S-EPMC5767648 | biostudies-other | 2018 Apr

REPOSITORIES: biostudies-other

altmetric image

Publications

Pairwise domain adaptation module for CNN-based 2-D/3-D registration.

Zheng Jiannan J   Miao Shun S   Jane Wang Z Z   Liao Rui R  

Journal of medical imaging (Bellingham, Wash.) 20180113 2


Accurate two-dimensional to three-dimensional (2-D/3-D) registration of preoperative 3-D data and intraoperative 2-D x-ray images is a key enabler for image-guided therapy. Recent advances in 2-D/3-D registration formulate the problem as a learning-based approach and exploit the modeling power of convolutional neural networks (CNN) to significantly improve the accuracy and efficiency of 2-D/3-D registration. However, for surgery-related applications, collecting a large clinical dataset with accu  ...[more]

Similar Datasets

| S-EPMC8430217 | biostudies-literature
| S-EPMC7595231 | biostudies-literature
| S-EPMC5766236 | biostudies-literature
| S-EPMC8442959 | biostudies-literature
| S-EPMC4727538 | biostudies-literature
| S-EPMC11538527 | biostudies-literature
| S-EPMC10942022 | biostudies-literature
| S-EPMC4254498 | biostudies-literature
| S-EPMC6151656 | biostudies-literature
| S-EPMC4505409 | biostudies-literature