Search

Increasing interest in multimodal breast cancer diagnosis has led to the development of methods for MRI to X-ray mammography registration. The severe breast deformation in X-ray mammography is often tackled by biomechanical models, yet there is no common consensus in literature about the required complexity of the deformation model and the simulation strategy. We present for the first time an automated patient-specific biomechanical model based image registration of MRI to digital breast tomosynthesis (DBT). DBT provides three-dimensional information of the compressed breast and as such drives the registration by a volume similarity metric. We compare different simulation strategies and propose a patient-specific optimization of simulation and model parameters. The average three-dimensional breast overlap measured by Dice coefficient of DBT and registered MRI improves for four analyzed subjects by including the estimation of unloaded state, simulation of gravity, and a concentrated pull force that mimics manual positioning of the breast on the plates from 88.1% for a mere compression simulation to 93.1% when including all our proposed simulation steps, whereas additional parameter optimization further increased the value to 94.4%.

Computer aided diagnosis (CAD) of breast cancer is mainly focused on monomodal applications. Here we present a fully automated multimodal CAD, which uses patient-specific image registration of MRI and two-view X-ray mammography. The image registration estimates the spatial correspondence between each voxel in the MRI and each pixel in cranio-caudal and mediolateral-oblique mammograms. Thereby we can combine features from both modalities. As a proof of concept we classify fixed regions of interest (ROI) into normal and suspect tissue. We investigate the classification performance of the multimodal classification in several setups against a classification with MRI features only. The average sensitivity of detecting suspect ROIs improves by approximately 2% when combining MRI with both mammographic views compared to MRI-only detection, while the specificity stays at a constant level. We conclude that automatically combining MRI and X-ray can enhance the result of a breast CAD system.

Computer aided detection CADe of breast cancer is mainly focused on monomodal applications. We propose an automated multimodal CADe approach, which uses patient-specific image registration of MRI and X-ray mammography to estimate the spatial correspondence of tissue structures. Then, based on the spatial correspondence, features are extracted from both MRI and X-ray mammography. As proof of principle, distinct regions of interest ROI were classified into normal and suspect tissue. We investigated the performance of different classifiers, compare our combined approach against a classification with MRI features only and evaluate the influence of the registration error. Using the multimodal information, the sensitivity for detecting suspect ROIs improved by 7i¾?% compared to MRI-only detection. The registration error influences the results: using only datasets with a registration error below $$10\,mm$$, the sensitivity for the multimodal detection increases by 10i¾?% to a maximum of 88i¾?%, while the specificity remains constant. We conclude that automatically combining MRI and X-ray can enhance the result of a CADe system.

Ultrasound Computer Tomography (USCT) is a promising modality for breast imaging. We developed and tested the first full 3D USCT system aimed at in-vivo imaging. It is based on approx. 2000 ultrasound transducers surrounding the breast within a water bath. From the acquired signal data, reflectivity, attenuation and sound speed images are reconstructed. In a first in-vivo study we imaged ten patients and compared them to MRI images. To overcome the considerably different breast positioning in both imaging methods, an image registration and image fusion based on biomechanical modeling of the buoyancy effect and surface-based refinement was applied. The resulting images are promising: compared with the MRI ground truth, similar tissue structures can be identified. While reflection images seem to image even small structures, sound speed imaging seems to be the best modality for detecting cancer. The registration of both imaging methods allows browsing the volume images side by side and enables recognition of correlating tissue structures. The first in-vivo study was successfully completed and encourages for a second in-vivo study with a considerably larger number of patients, which is currently ongoing.