1. SynthMorph: Learning Contrast-Invariant Registration Without Acquired Images
- Author
-
Malte Hoffmann, Douglas N. Greve, Benjamin Billot, Juan Eugenio Iglesias, Adrian V. Dalca, and Bruce Fischl
- Subjects
FOS: Computer and information sciences ,Optimization problem ,Computer science ,Computer Vision and Pattern Recognition (cs.CV) ,Computer Science - Computer Vision and Pattern Recognition ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Image registration ,Neuroimaging ,Geometric shape ,030218 nuclear medicine & medical imaging ,03 medical and health sciences ,0302 clinical medicine ,Image Processing, Computer-Assisted ,FOS: Electrical engineering, electronic engineering, information engineering ,Computer vision ,Electrical and Electronic Engineering ,Invariant (computer science) ,Radiological and Ultrasound Technology ,business.industry ,Image and Video Processing (eess.IV) ,Contrast (statistics) ,Electrical Engineering and Systems Science - Image and Video Processing ,Magnetic Resonance Imaging ,Computer Science Applications ,Range (mathematics) ,Generative model ,FOS: Biological sciences ,Quantitative Biology - Neurons and Cognition ,Neurons and Cognition (q-bio.NC) ,Artificial intelligence ,Focus (optics) ,business ,Software - Abstract
We introduce a strategy for learning image registration without acquired imaging data, producing powerful networks agnostic to contrast introduced by magnetic resonance imaging (MRI). While classical registration methods accurately estimate the spatial correspondence between images, they solve an optimization problem for every new image pair. Learning-based techniques are fast at test time but limited to registering images with contrasts and geometric content similar to those seen during training. We propose to remove this dependency on training data by leveraging a generative strategy for diverse synthetic label maps and images that exposes networks to a wide range of variability, forcing them to learn more invariant features. This approach results in powerful networks that accurately generalize to a broad array of MRI contrasts. We present extensive experiments with a focus on 3D neuroimaging, showing that this strategy enables robust and accurate registration of arbitrary MRI contrasts even if the target contrast is not seen by the networks during training. We demonstrate registration accuracy surpassing the state of the art both within and across contrasts, using a single model. Critically, training on arbitrary shapes synthesized from noise distributions results in competitive performance, removing the dependency on acquired data of any kind. Additionally, since anatomical label maps are often available for the anatomy of interest, we show that synthesizing images from these dramatically boosts performance, while still avoiding the need for real intensity images. Our code is available at https://w3id.org/synthmorph., 16 pages, 15 figures, 3 tables, deformable image registration, data independence, deep learning, MRI-contrast invariance, anatomy agnosticism, final published version
- Published
- 2022
- Full Text
- View/download PDF