Deep correction of breathing-related artifacts in real-time MR-thermometry.

Real-time MR-imaging has been clinically adapted for monitoring thermal therapies since it can provide on-the-fly temperature maps simultaneously with anatomical information. However, proton resonance frequency based thermometry of moving targets remains challenging since temperature artifacts are induced by the respiratory as well as physiological motion. If left uncorrected, these artifacts lead to severe errors in temperature estimates and impair therapy guidance. In this study, we evaluated deep learning for on-line correction of motion related errors in abdominal MR-thermometry. For this, a convolutional neural network (CNN) was designed to learn the apparent temperature perturbation from images acquired during a preparative learning stage prior to hyperthermia. The input of the designed CNN is the most recent magnitude image and no surrogate of motion is needed. During the subsequent hyperthermia procedure, the recent magnitude image is used as an input for the CNN-model in order to generate an on-line correction for the current temperature map. The method's artifact suppression performance was evaluated on 12 free breathing volunteers and was found robust and artifact-free in all examined cases. Furthermore, thermometric precision and accuracy was assessed for in vivo ablation using high intensity focused ultrasound. All calculations involved at the different stages of the proposed workflow were designed to be compatible with the clinical time constraints of a therapeutic procedure.

Patch-based field-of-view matching in multi-modal images for electroporation-based ablations.

Various multi-modal imaging sensors are currently involved at different steps of an interventional therapeutic work-flow. Cone beam computed tomography (CBCT), computed tomography (CT) or Magnetic Resonance (MR) images thereby provides complementary functional and/or structural information of the targeted region and organs at risk. Merging this information relies on a correct spatial alignment of the observed anatomy between the acquired images. This can be achieved by the means of multi-modal deformable image registration (DIR), demonstrated to be capable of estimating dense and elastic deformations between images acquired by multiple imaging devices. However, due to the typically different field-of-view (FOV) sampled across the various imaging modalities, such algorithms may severely fail in finding a satisfactory solution. In the current study we propose a new fast method to align the FOV in multi-modal 3D medical images. To this end, a patch-based approach is introduced and combined with a state-of-the-art multi-modal image similarity metric in order to cope with multi-modal medical images. The occurrence of estimated patch shifts is computed for each spatial direction and the shift value with maximum occurrence is selected and used to adjust the image field-of-view. The performance of the proposed method - in terms of both registration accuracy and computational needs - is analyzed in the practical case of on-line irreversible electroporation procedures. In total, 30 pairs of pre-/per-operative IRE images are considered to illustrate the efficiency of our algorithm. We show that a regional registration approach using voxel patches provides a good structural compromise between the voxel-wise and "global shifts" approaches. The method was thereby beneficial for CT to CBCT and MRI to CBCT registration tasks, especially when highly different image FOVs are involved. Besides, the benefit of the method for CT to CBCT and MRI to CBCT image registration is analyzed, including the impact of artifacts generated by percutaneous needle insertions. Additionally, the computational needs using commodity hardware are demonstrated to be compatible with clinical constraints in the practical case of on-line procedures. The proposed patch-based workflow thus represents an attractive asset for DIR at different stages of an interventional procedure.

Optimizing 4D abdominal MRI: image denoising using an iterative back-projection approach.

4D-MRI is a promising tool for organ exploration, target delineation and treatment planning. Intra-scan motion artifacts may be greatly reduced by increasing the imaging frame rate. However, poor signal-to-noise ratios (SNR) are observed when increasing spatial and/or frame number per physiological cycle, in particular in the abdomen. In the current work, the proposed 4D-MRI method favored spatial resolution, frame number, isotropic voxels and large field-of-view (FOV) during MR-acquisition. The consequential SNR penalty in the reconstructed data is addressed retrospectively using an iterative back-projection (IBP) algorithm. Practically, after computing individual spatial 3D deformations present in the images using a deformable image registration (DIR) algorithm, each 3D image is individually enhanced by fusing several successive frames in its local temporal neighborood, these latter being likely to cover common independent informations. A tuning parameter allows one to freely readjust the balance between temporal resolution and precision of the 4D-MRI. The benefit of the method was quantitatively evaluated on the thorax of 6 mice under free breathing using a clinically acceptable duration. Improved 4D cardiac imaging was also shown in the heart of 1 mice. Obtained results are compared to theoretical expectations and discussed. The proposed implementation is easily parallelizable and optimized 4D-MRI could thereby be obtained with a clinically acceptable duration.

Anatomically plausible models and quality assurance criteria for online mono- and multi-modal medical image registration.

Medical imaging is currently employed in the diagnosis, planning, delivery and response monitoring of cancer treatments. Due to physiological motion and/or treatment response, the shape and location of the pathology and organs-at-risk may change over time. Establishing their location within the acquired images is therefore paramount for an accurate treatment delivery and monitoring. A feasible solution for tracking anatomical changes during an image-guided cancer treatment is provided by image registration algorithms. Such methods are, however, often built upon elements originating from the computer vision/graphics domain. Since the original design of such elements did not take into consideration the material properties of particular biological tissues, the anatomical plausibility of the estimated deformations may not be guaranteed. In the current work we adapt two existing variational registration algorithms, namely Horn-Schunck and EVolution, to online soft tissue tracking. This is achieved by enforcing an incompressibility constraint on the estimated deformations during the registration process. The existing and the modified registration methods were comparatively tested against several quality assurance criteria on abdominal in vivo MR and CT data. These criteria included: the Dice similarity coefficient (DSC), the Jaccard index, the target registration error (TRE) and three additional criteria evaluating the anatomical plausibility of the estimated deformations. Results demonstrated that both the original and the modified registration methods have similar registration capabilities in high-contrast areas, with DSC and Jaccard index values predominantly in the 0.8-0.9 range and an average TRE of 1.6-2.0 mm. In contrast-devoid regions of the liver and kidneys, however, the three additional quality assurance criteria have indicated a considerable improvement of the anatomical plausibility of the deformations estimated by the incompressibility-constrained methods. Moreover, the proposed registration models maintain the potential of the original methods for online image-based guidance of cancer treatments.

Real-time non-rigid target tracking for ultrasound-guided clinical interventions.

Biological motion is a problem for non- or mini-invasive interventions when conducted in mobile/deformable organs due to the targeted pathology moving/deforming with the organ. This may lead to high miss rates and/or incomplete treatment of the pathology. Therefore, real-time tracking of the target anatomy during the intervention would be beneficial for such applications. Since the aforementioned interventions are often conducted under B-mode ultrasound (US) guidance, target tracking can be achieved via image registration, by comparing the acquired US images to a separate image established as positional reference. However, such US images are intrinsically altered by speckle noise, introducing incoherent gray-level intensity variations. This may prove problematic for existing intensity-based registration methods. In the current study we address US-based target tracking by employing the recently proposed EVolution registration algorithm. The method is, by construction, robust to transient gray-level intensities. Instead of directly matching image intensities, EVolution aligns similar contrast patterns in the images. Moreover, the displacement is computed by evaluating a matching criterion for image sub-regions rather than on a point-by-point basis, which typically provides more robust motion estimates. However, unlike similar previously published approaches, which assume rigid displacements in the image sub-regions, the EVolution algorithm integrates the matching criterion in a global functional, allowing the estimation of an elastic dense deformation. The approach was validated for soft tissue tracking under free-breathing conditions on the abdomen of seven healthy volunteers. Contact echography was performed on all volunteers, while three of the volunteers also underwent standoff echography. Each of the two modalities is predominantly specific to a particular type of non- or mini-invasive clinical intervention. The method demonstrated on average an accuracy of ∼1.5 mm and submillimeter precision. This, together with a computational performance of 20 images per second make the proposed method an attractive solution for real-time target tracking during US-guided clinical interventions.

Combination of principal component analysis and optical-flow motion compensation for improved cardiac MR thermometry.

The use of magnetic resonance (MR) thermometry for the monitoring of thermal ablation is rapidly expanding. However, this technique remains challenging for the monitoring of the treatment of cardiac arrhythmia by radiofrequency ablation due to the heart displacement with respiration and contraction. Recent studies have addressed this problem by compensating in-plane motion in real-time with optical-flow based tracking technique. However, these algorithms are sensitive to local variation of signal intensity on magnitude images associated with tissue heating. In this study, an optical-flow algorithm was combined with a principal component analysis method to reduce the impact of such effects. The proposed method was integrated to a fully automatic cardiac MR thermometry pipeline, compatible with a future clinical workflow. It was evaluated on nine healthy volunteers under free breathing conditions, on a phantom and in vivo on the left ventricle of a sheep. The results showed that local intensity changes in magnitude images had lower impact on motion estimation with the proposed method. Using this strategy, the temperature mapping accuracy was significantly improved.

Real-time auto-adaptive margin generation for MLC-tracked radiotherapy.

In radiotherapy, abdominal and thoracic sites are candidates for performing motion tracking. With real-time control it is possible to adjust the multileaf collimator (MLC) position to the target position. However, positions are not perfectly matched and position errors arise from system delays and complicated response of the electromechanic MLC system. Although, it is possible to compensate parts of these errors by using predictors, residual errors remain and need to be compensated to retain target coverage. This work presents a method to statistically describe tracking errors and to automatically derive a patient-specific, per-segment margin to compensate the arising underdosage on-line, i.e. during plan delivery. The statistics of the geometric error between intended and actual machine position are derived using kernel density estimators. Subsequently a margin is calculated on-line according to a selected coverage parameter, which determines the amount of accepted underdosage. The margin is then applied onto the actual segment to accommodate the positioning errors in the enlarged segment. The proof-of-concept was tested in an on-line tracking experiment and showed the ability to recover underdosages for two test cases, increasing [Formula: see text] in the underdosed area about [Formula: see text] and [Formula: see text], respectively. The used dose model was able to predict the loss of dose due to tracking errors and could be used to infer the necessary margins. The implementation had a running time of 23 ms which is compatible with real-time requirements of MLC tracking systems. The auto-adaptivity to machine and patient characteristics makes the technique a generic yet intuitive candidate to avoid underdosages due to MLC tracking errors.

Correction for photobleaching in dynamic fluorescence microscopy: application in the assessment of pharmacokinetic parameters in ultrasound-mediated drug delivery.

We have previously demonstrated the feasibility of monitoring ultrasound-mediated uptake of a hydrophilic model drug in real time with dynamic confocal fluorescence microscopy. In this study, we evaluate and correct the impact of photobleaching to improve the accuracy of pharmacokinetic parameter estimates. To model photobleaching of the fluorescent model drug SYTOX Green, a photobleaching process was added to the current two-compartment model describing cell uptake. After collection of the uptake profile, a second acquisition was performed when SYTOX Green was equilibrated, to evaluate the photobleaching rate experimentally. Photobleaching rates up to 5.0 10(-3) s(-1) were measured when applying power densities up to 0.2 W.cm(-2). By applying the three-compartment model, the model drug uptake rate of 6.0 10(-3) s(-1) was measured independent of the applied laser power. The impact of photobleaching on uptake rate estimates measured by dynamic fluorescence microscopy was evaluated. Subsequent compensation improved the accuracy of pharmacokinetic parameter estimates in the cell population subjected to sonopermeabilization.

On-line MR imaging for dose validation of abdominal radiotherapy.

For quality assurance and adaptive radiotherapy, validation of the actual delivered dose is crucial.Intrafractional anatomy changes cannot be captured satisfactorily during treatment with hitherto available imaging modalitites. Consequently, dose calculations are based on the assumption of static anatomy throughout the treatment. However, intra- and interfraction anatomy is dynamic and changes can be significant.In this paper, we investigate the use of an MR-linac as a dose tracking modality for the validation of treatments in abdominal targets where both respiratory and long-term peristaltic and drift motion occur.The on-line MR imaging capability of the modality provides the means to perform respiratory gating of both delivery and acquisition yielding a model-free respiratory motion management under free breathing conditions.In parallel to the treatment, the volumetric patient anatomy was captured and used to calculate the applied dose. Subsequently, the individual doses were warped back to the planning grid to obtain the actual dose accumulated over the entire treatment duration. Ultimately, the planned dose was validated by comparison with the accumulated dose.Representative for a site subject to breathing modulation, two kidney cases (25 Gy target dose) demonstrated the working principle on volunteer data and simulated delivery. The proposed workflow successfully showed its ability to track local dosimetric changes. Integration of the on-line anatomy information could reveal local dose variations -2.3-1.5 Gy in the target volume of a volunteer dataset. In the adjacent organs at risk, high local dose errors ranging from -2.5 to 1.9 Gy could be traced back.

On-line 3D motion estimation using low resolution MRI.

Image processing such as deformable image registration finds its way into radiotherapy as a means to track non-rigid anatomy. With the advent of magnetic resonance imaging (MRI) guided radiotherapy, intrafraction anatomy snapshots become technically feasible. MRI provides the needed tissue signal for high-fidelity image registration. However, acquisitions, especially in 3D, take a considerable amount of time. Pushing towards real-time adaptive radiotherapy, MRI needs to be accelerated without degrading the quality of information. In this paper, we investigate the impact of image resolution on the quality of motion estimations. Potentially, spatially undersampled images yield comparable motion estimations. At the same time, their acquisition times would reduce greatly due to the sparser sampling. In order to substantiate this hypothesis, exemplary 4D datasets of the abdomen were downsampled gradually. Subsequently, spatiotemporal deformations are extracted consistently using the same motion estimation for each downsampled dataset. Errors between the original and the respectively downsampled version of the dataset are then evaluated. Compared to ground-truth, results show high similarity of deformations estimated from downsampled image data. Using a dataset with (2.5 mm)3 voxel size, deformation fields could be recovered well up to a downsampling factor of 2, i.e. (5 mm)3. In a therapy guidance scenario MRI, imaging speed could accordingly increase approximately fourfold, with acceptable loss of estimated motion quality.

On the suitability of Elekta's Agility 160 MLC for tracked radiation delivery: closed-loop machine performance.

For motion adaptive radiotherapy, dynamic multileaf collimator tracking can be employed to reduce treatment margins by steering the beam according to the organ motion. The Elekta Agility 160 MLC has hitherto not been evaluated for its tracking suitability. Both dosimetric performance and latency are key figures and need to be assessed generically, independent of the used motion sensor. In this paper, we propose the use of harmonic functions directly fed to the MLC to determine its latency during continuous motion. Furthermore, a control variable is extracted from a camera system and fed to the MLC. Using this setup, film dosimetry and subsequent γ statistics are performed, evaluating the response when tracking (MRI)-based physiologic motion in a closed-loop. The delay attributed to the MLC itself was shown to be a minor contributor to the overall feedback chain as compared to the impact of imaging components such as MRI sequences. Delay showed a linear phase behaviour of the MLC employed in continuously dynamic applications, which enables a general MLC-characterization. Using the exemplary feedback chain, dosimetry showed a vast increase in pass rate employing γ statistics. In this early stage, the tracking performance of the Agility using the test bench yielded promising results, making the technique eligible for translation to tracking using clinical imaging modalities.

Molecular MR imaging and MR-guided ultrasound therapies in cancer.

Imaging in cancer has moved in the last twenty years from morphological detection of diseases to characterization and categorization of different subtypes of tumors. Functional information, based on dynamic contrast-enhanced imaging of tissue perfusion and evaluation of water diffusion, tissue oxygenation, capillary permeability or lymphatic drainage, plays a major role in that field.The next coming steps will concern the differentiation of biological behaviour of tumors according to their phenotypes by identifying specific surface receptors or products of synthesis.These developments allowing an in vivo identification of the tumor biological singularities is a tremendous progress in the management of cancer at the step of diagnosis but, more importantly, to assess the most appropriated treatment to each tumor type. At the same time, minimally invasive methods of treatment of tumors have also developed, mainly in the field of thermotherapies. Ablation of tumors using radiofrequency is now used in clinics as a new standard within the liver and as a promising additional option in many other organs as kidney, lung and bone. High intensity focused ultrasound (HIFU) showed more restricted developments in clinics, mainly applied to prostatic cancer, because of many technical barriers. We believe that magnetic resonance (MR) imaging and MR-guided HIFU (MRgHIFU) have a great potential in that field due to the capacity of MR imaging to monitor temperature changes for an optimal heat deposition and for an optimal safety. This technique has already gained recognition for the treatment of uterine leiomyomas. But it has still to prove its efficacy in treatment of malignant tumors. This review will focus on some recent developments in molecular characterisation of tumors using MR imaging and in technical improvements necessary for accurate application of MRgHIFU in cancer.