Coordinate Translator for Learning Deformable Medical Image Registration

Yihao Liu, Lianrui Zuo, Shuo Han, Yuan Xue, Jerry L. Prince, Aaron Carass

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Scopus citations

Abstract

The majority of deep learning (DL) based deformable image registration methods use convolutional neural networks (CNNs) to estimate displacement fields from pairs of moving and fixed images. This, however, requires the convolutional kernels in the CNN to not only extract intensity features from the inputs but also understand image coordinate systems. We argue that the latter task is challenging for traditional CNNs, limiting their performance in registration tasks. To tackle this problem, we first introduce Coordinate Translator, a differentiable module that identifies matched features between the fixed and moving image and outputs their coordinate correspondences without the need for training. It unloads the burden of understanding image coordinate systems for CNNs, allowing them to focus on feature extraction. We then propose a novel deformable registration network, im2grid, that uses multiple Coordinate Translator’s with the hierarchical features extracted from a CNN encoder and outputs a deformation field in a coarse-to-fine fashion. We compared im2grid with the state-of-the-art DL and non-DL methods for unsupervised 3D magnetic resonance image registration. Our experiments show that im2grid outperforms these methods both qualitatively and quantitatively.

Original languageEnglish (US)
Title of host publicationMultiscale Multimodal Medical Imaging - 3rd International Workshop, MMMI 2022, Held in Conjunction with MICCAI 2022, Proceedings
EditorsXiang Li, Quanzheng Li, Jinglei Lv, Yuankai Huo, Bin Dong, Richard M. Leahy
PublisherSpringer Science and Business Media Deutschland GmbH
Pages98-109
Number of pages12
ISBN (Print)9783031188138
DOIs
StatePublished - 2022
Event3rd International Workshop on Multiscale Multimodal Medical Imaging, MMMI 2022, held in conjunction with the 25th International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2022 - Singapore, Singapore
Duration: Sep 22 2022Sep 22 2022

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13594 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference3rd International Workshop on Multiscale Multimodal Medical Imaging, MMMI 2022, held in conjunction with the 25th International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2022
Country/TerritorySingapore
CitySingapore
Period9/22/229/22/22

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Coordinate Translator for Learning Deformable Medical Image Registration'. Together they form a unique fingerprint.

Cite this