Three-Dimensional Multi-Modality Registration for Orthopaedics and Cardiovascular Settings: State-of-the-Art and Clinical Applications.

The multimodal and multidomain registration of medical images have gained increasing recognition in clinical practice as a powerful tool for fusing and leveraging useful information from different imaging techniques and in different medical fields such as cardiology and orthopedics. Image registration could be a challenging process, and it strongly depends on the correct tuning of registration parameters. In this paper, the robustness and accuracy of a landmarks-based approach have been presented for five cardiac multimodal image datasets. The study is based on 3D Slicer software and it is focused on the registration of a computed tomography (CT) and 3D ultrasound time-series of post-operative mitral valve repair. The accuracy of the method, as a function of the number of landmarks used, was performed by analysing root mean square error (RMSE) and fiducial registration error (FRE) metrics. The validation of the number of landmarks resulted in an optimal number of 10 landmarks. The mean RMSE and FRE values were 5.26 ± 3.17 and 2.98 ± 1.68 mm, respectively, showing comparable performances with respect to the literature. The developed registration process was also tested on a CT orthopaedic dataset to assess the possibility of reconstructing the damaged jaw portion for a pre-operative planning setting. Overall, the proposed work shows how 3D Slicer and registration by landmarks can provide a useful environment for multimodal/unimodal registration.

Coupling synthetic and real-world data for a deep learning-based segmentation process of 4D flow MRI.

BACKGROUND AND OBJECTIVE: Phase contrast magnetic resonance imaging (4D flow MRI) is an imaging technique able to provide blood velocity in vivo and morphological information. This capability has been used to study mainly the hemodynamics of large vessels, such as the thoracic aorta. However, the segmentation of 4D flow MRI data is a complex and time-consuming task. In recent years, neural networks have shown great accuracy in segmentation tasks if large datasets are provided. Unfortunately, in the context of 4D flow MRI, the availability of these data is limited due to its recent adoption in clinical settings. In this study, we propose a pipeline for generating synthetic thoracic aorta phase contrast magnetic resonance angiography (PCMRA) to expand the limited dataset of patient-specific PCMRA images, ultimately improving the accuracy of the neural network segmentation even with a small real dataset. METHODS: The pipeline involves several steps. First, a statistical shape model is used to synthesize new artificial geometries to improve data numerosity and variability. Secondly, computational fluid dynamics simulations are employed to simulate the velocity fields and, finally, after a downsampling and a signal-to-noise and velocity limit adjustment in both frequency and spatial domains, volumes are obtained using the PCMRA formula. These synthesized volumes are used in combination with real-world data to train a 3D U-Net neural network. Different settings of real and synthetic data are tested. RESULTS: Incorporating synthetic data into the training set significantly improved the segmentation performance compared to using only real data. The experiments with synthetic data achieved a DICE score (DS) value of 0.83 and a better target reconstruction with respect to the case with only real data (DS = 0.65). CONCLUSION: The proposed pipeline demonstrated the ability to increase the dataset in terms of numerosity and variability and to improve the segmentation accuracy for the thoracic aorta using PCMRA.