Fully automated deep learning based auto-contouring of liver segments and spleen on contrast-enhanced CT images.

Manual delineation of liver segments on computed tomography (CT) images for primary/secondary liver cancer (LC) patients is time-intensive and prone to inter/intra-observer variability. Therefore, we developed a deep-learning-based model to auto-contour liver segments and spleen on contrast-enhanced CT (CECT) images. We trained two models using 3d patch-based attention U-Net ([Formula: see text] and 3d full resolution of nnU-Net ([Formula: see text] to determine the best architecture ([Formula: see text]. BA was used with vessels ([Formula: see text] and spleen ([Formula: see text] to assess the impact on segment contouring. Models were trained, validated, and tested on 160 ([Formula: see text]), 40 ([Formula: see text]), 33 ([Formula: see text]), 25 (CCH) and 20 (CPVE) CECT of LC patients. [Formula: see text] outperformed [Formula: see text] across all segments with median differences in Dice similarity coefficients (DSC) ranging 0.03-0.05 (p < 0.05). [Formula: see text], and [Formula: see text] were not statistically different (p > 0.05), however, both were slightly better than [Formula: see text] by DSC up to 0.02. The final model, [Formula: see text], showed a mean DSC of 0.89, 0.82, 0.88, 0.87, 0.96, and 0.95 for segments 1, 2, 3, 4, 5-8, and spleen, respectively on entire test sets. Qualitatively, more than 85% of cases showed a Likert score [Formula: see text] 3 on test sets. Our final model provides clinically acceptable contours of liver segments and spleen which are usable in treatment planning.

Quantifying the Effect of 4-Dimensional Computed Tomography-Based Deformable Dose Accumulation on Representing Radiation Damage for Patients with Locally Advanced Non-Small Cell Lung Cancer Treated with Standard-Fractionated Intensity-Modulated Radiation Therapy.

PURPOSE: The aim of this study was to investigate the dosimetric and clinical effects of 4-dimensional computed tomography (4DCT)-based longitudinal dose accumulation in patients with locally advanced non-small cell lung cancer treated with standard-fractionated intensity-modulated radiation therapy (IMRT). METHODS AND MATERIALS: Sixty-seven patients were retrospectively selected from a randomized clinical trial. Their original IMRT plan, planning and verification 4DCTs, and ∼4-month posttreatment follow-up CTs were imported into a commercial treatment planning system. Two deformable image registration algorithms were implemented for dose accumulation, and their accuracies were assessed. The planned and accumulated doses computed using average-intensity images or phase images were compared. At the organ level, mean lung dose and normal-tissue complication probability (NTCP) for grade ≥2 radiation pneumonitis were compared. At the region level, mean dose in lung subsections and the volumetric overlap between isodose intervals were compared. At the voxel level, the accuracy in estimating the delivered dose was compared by evaluating the fit of a dose versus radiographic image density change (IDC) model. The dose-IDC model fit was also compared for subcohorts based on the magnitude of NTCP difference (|ΔNTCP|) between planned and accumulated doses. RESULTS: Deformable image registration accuracy was quantified, and the uncertainty was considered for the voxel-level analysis. Compared with planned doses, accumulated doses on average resulted in <1-Gy lung dose increase and <2% NTCP increase (up to 8.2 Gy and 18.8% for a patient, respectively). Volumetric overlap of isodose intervals between the planned and accumulated dose distributions ranged from 0.01 to 0.93. Voxel-level dose-IDC models demonstrated a fit improvement from planned dose to accumulated dose (pseudo-R2 increased 0.0023) and a further improvement for patients with ≥2% |ΔNTCP| versus for patients with <2% |ΔNTCP|. CONCLUSIONS: With a relatively large cohort, robust image registrations, multilevel metric comparisons, and radiographic image-based evidence, we demonstrated that dose accumulation more accurately represents the delivered dose and can be especially beneficial for patients with greater longitudinal response.

Analysis and prediction of liver volume change maps derived from computational tomography scans acquired pre- and post-radiation therapy.

External beam radiation therapy (EBRT) of liver cancers can cause local liver atrophy as a result of tissue damage or hypertrophy as a result of liver regeneration. Predicting those volumetric changes would enable new strategies for liver function preservation during treatment planning. However, understanding of the spatial dose/volume relationship is still limited. This study leverages the use of deep learning-based segmentation and biomechanical deformable image registration (DIR) to analyze and predict this relationship. Pre- and Post-EBRT imaging data were collected for 100 patients treated for hepatocellular carcinomas, cholangiocarcinoma or CRC with intensity-modulated radiotherapy (IMRT) with prescription doses ranging from 50 to 100 Gy delivered in 10-28 fractions. For each patient, DIR between the portal and venous (PV) phase of a diagnostic computed tomography (CT) scan acquired before radiation therapy (RT) planning, and a PV phase of a diagnostic CT scan acquired after the end of RT (on average 147 ± 36 d) was performed to calculate Jacobian maps representing volume changes in the liver. These volume change maps were used: (i): to analyze the dose/volume relationship in the whole liver and individual Couinaud's segments; and (ii): to investigate the use of deep-learning to predict a Jacobian map solely based on the pre-RT diagnostic CT and planned dose distribution. Moderate correlations between mean equivalent dose in 2 Gy fractions (EQD2) and volume change was observed for all liver sub-regions analyzed individually with Pearson correlationrranging from -0.36 to -067. The predicted volume change maps showed a significantly stronger voxel-wise correlation with the DIR-based volume change maps than when considering the original EQD2 distribution (0.63 ± 0.24 versus 0.55 ± 23, respectively), demonstrating the ability of the proposed approach to establish complex relationships between planned dose and liver volume response months after treatment, which represents a promising prediction tool for the development of future adaptive and personalized liver radiation therapy strategies.

Optimization of mesh generation for geometric accuracy, robustness, and efficiency of biomechanical-model-based deformable image registration.

BACKGROUND: Successful generation of biomechanical-model-based deformable image registration (BM-DIR) relies on user-defined parameters that dictate surface mesh quality. The trial-and-error process to determine the optimal parameters can be labor-intensive and hinder DIR efficiency and clinical workflow. PURPOSE: To identify optimal parameters in surface mesh generation as boundary conditions for a BM-DIR in longitudinal liver and lung CT images to facilitate streamlined image registration processes. METHODS: Contrast-enhanced CT images of 29 colorectal liver cancer patients and end-exhale four-dimensional CT images of 26 locally advanced non-small cell lung cancer patients were collected. Different combinations of parameters that determine the triangle mesh quality (voxel side length and triangle edge length) were investigated. The quality of DIRs generated using these parameters was evaluated with metrics for geometric accuracy, robustness, and efficiency. Metrics for geometric accuracy included target registration error (TRE) of internal vessel bifurcations, dice similar coefficient (DSC), mean distance to agreement (MDA), Hausdorff distance (HD) for organ contours, and number of vertices in the triangle mesh. American Association of Physicists in Medicine Task Group 132 was used to ensure parameters met TRE, DSC, MDA recommendations before the comparison among the parameters. Robustness was evaluated as the success rate of DIR generation, and efficiency was evaluated as the total time to generate boundary conditions and compute finite element analysis. RESULTS: Voxel side length of 0.2 cm and triangle edge length of 3 were found to be the optimal parameters for both liver and lung, with success rate of 1.00 and 0.98 and average DIR computation time of 100 and 143 s, respectively. For this combination, the average TRE, DSC, MDA, and HD were 0.38-0.40, 0.96-0.97, 0.09-0.12, and 0.87-1.17 mm, respectively. CONCLUSION: The optimal parameters were found for the analyzed patients. The decision-making process described in this study serves as a recommendation for BM-DIR algorithms to be used for liver and lung. These parameters can facilitate consistence in the evaluation of published studies and more widespread utilization of BM-DIR in clinical practice.

Leveraging deep learning-based segmentation and contours-driven deformable registration for dose accumulation in abdominal structures.

Purpose: Discrepancies between planned and delivered dose to GI structures during radiation therapy (RT) of liver cancer may hamper the prediction of treatment outcomes. The purpose of this study is to develop a streamlined workflow for dose accumulation in a treatment planning system (TPS) during liver image-guided RT and to assess its accuracy when using different deformable image registration (DIR) algorithms. Materials and Methods: Fifty-six patients with primary and metastatic liver cancer treated with external beam radiotherapy guided by daily CT-on-rails (CTOR) were retrospectively analyzed. The liver, stomach and duodenum contours were auto-segmented on all planning CTs and daily CTORs using deep-learning methods. Dose accumulation was performed for each patient using scripting functionalities of the TPS and considering three available DIR algorithms based on: (i) image intensities only; (ii) intensities + contours; (iii) a biomechanical model (contours only). Planned and accumulated doses were converted to equivalent dose in 2Gy (EQD2) and normal tissue complication probabilities (NTCP) were calculated for the stomach and duodenum. Dosimetric indexes for the normal liver, GTV, stomach and duodenum and the NTCP values were exported from the TPS for analysis of the discrepancies between planned and the different accumulated doses. Results: Deep learning segmentation of the stomach and duodenum enabled considerable acceleration of the dose accumulation process for the 56 patients. Differences between accumulated and planned doses were analyzed considering the 3 DIR methods. For the normal liver, stomach and duodenum, the distribution of the 56 differences in maximum doses (D2%) presented a significantly higher variance when a contour-driven DIR method was used instead of the intensity only-based method. Comparing the two contour-driven DIR methods, differences in accumulated minimum doses (D98%) in the GTV were >2Gy for 15 (27%) of the patients. Considering accumulated dose instead of planned dose in standard NTCP models of the duodenum demonstrated a high sensitivity of the duodenum toxicity risk to these dose discrepancies, whereas smaller variations were observed for the stomach. Conclusion: This study demonstrated a successful implementation of an automatic workflow for dose accumulation during liver cancer RT in a commercial TPS. The use of contour-driven DIR methods led to larger discrepancies between planned and accumulated doses in comparison to using an intensity only based DIR method, suggesting a better capability of these approaches in estimating complex deformations of the GI organs.

Viscoelastic biomechanical models to predict inward brain-shift using public benchmark data.

Brain-shift during neurosurgery compromises the accuracy of tracking the boundaries of the tumor to be resected. Although several studies have used various finite element models (FEMs) to predict inward brain-shift, evaluation of their accuracy and efficiency based on public benchmark data has been limited. This study evaluates several FEMs proposed in the literature (various boundary conditions, mesh sizes, and material properties) by using intraoperative imaging data (the public REtroSpective Evaluation of Cerebral Tumors [RESECT] database). Four patients with low-grade gliomas were identified as having inward brain-shifts. We computed the accuracy (using target registration error) of several FEM-based brain-shift predictions and compared our findings. Since information on head orientation during craniotomy is not included in this database, we tested various plausible angles of head rotation. We analyzed the effects of brain tissue viscoelastic properties, mesh size, craniotomy position, CSF drainage level, and rigidity of meninges and then quantitatively evaluated the trade-off between accuracy and central processing unit time in predicting inward brain-shift across all models with second-order tetrahedral FEMs. The mean initial target registration error (TRE) was 5.78 ± 3.78 mm with rigid registration. FEM prediction (edge-length, 5 mm) with non-rigid meninges led to a mean TRE correction of 1.84 ± 0.83 mm assuming heterogeneous material. Results show that, for the low-grade glioma patients in the study, including non-rigid modeling of the meninges was significant statistically. In contrast including heterogeneity was not significant. To estimate the optimal head orientation and CSF drainage, an angle step of 5° and an CSF height step of 5 mm were enough leading to <0.26 mm TRE fluctuation.

A novel use of biomechanical model-based deformable image registration (DIR) for assessing colorectal liver metastases ablation outcomes.

PURPOSE: Colorectal cancer is the third most common form of cancer in the United States, and up to 60% of these patients develop liver metastasis. While hepatic resection is the curative treatment of choice, only 20% of patients are candidates at the time of diagnosis. While percutaneous thermal ablation (PTA) has demonstrated 24%-51% overall 5-year survival rates, assurance of sufficient ablation margin delivery (5 mm) can be challenging, with current methods of 2D distance measurement not ensuring 3D minimum margin. We hypothesized that biomechanical model-based deformable image registration (DIR) can reduce spatial uncertainties and differentiate local tumor progression (LTP) patients from LTP-free patients. METHODS: We retrospectively acquired 30 patients (16 LTP and 14 LTP-free) at our institution who had undergone PTA and had a contrast-enhanced pre-treatment and post-ablation CT scan. Liver, disease, and ablation zone were manually segmented. Biomechanical model-based DIR between the pre-treatment and post-ablation CT mapped the gross tumor volume onto the ablation zone and measured 3D minimum delivered margin (MDM). An in-house cone-tracing algorithm determined if progression qualitatively collocated with insufficient 5 mm margin achieved. RESULTS: Mann-Whitney U test showed a significant difference (p < 0.01) in MDM from the LTP and LTP-free groups. A total of 93% (13/14) of patients with LTP had a correlation between progression and missing 5 mm of margin volume. CONCLUSIONS: Biomechanical DIR is able to reduce spatial uncertainty and allow measurement of delivered 3D MDM. This minimum margin can help ensure sufficient ablation delivery, and our workflow can provide valuable information in a clinically useful timeframe.

Detection of vessel bifurcations in CT scans for automatic objective assessment of deformable image registration accuracy.

PURPOSE: Objective assessment of deformable image registration (DIR) accuracy often relies on the identification of anatomical landmarks in image pairs, a manual process known to be extremely time-expensive. The goal of this study is to propose a method to automatically detect vessel bifurcations in images and assess their use for the computation of target registration errors (TREs). MATERIALS AND METHODS: Three image datasets were retrospectively analyzed. The first dataset included 10 pairs of inhale/exhale phases from lung 4DCTs and full inhale and exhale breath-hold CT scans from 10 patients presenting with chronic obstructive pulmonary disease, with 300 corresponding landmarks available for each case (DIR-Lab). The second dataset included six pairs of inhale/exhale phases from lung 4DCTs (POPI dataset), with 100 pairs of landmarks for each case. The third dataset included 28 pairs of pre/post-radiotherapy liver contrast-enhanced CT scans, each with five manually picked vessel bifurcation correspondences. For all images, the vasculature was autosegmented by computing and thresholding a vesselness image. Images of the vasculature centerline were computed, and bifurcations were detected based on centerline voxel neighbors' count. The vasculature segmentations were independently registered using a Demons algorithm between representations of their surface with distance maps. Detected bifurcations were considered as corresponding when distant by less than 5 mm after vasculature DIR. The selected pairs of bifurcations were used to calculate TRE after registration of the images considering three algorithms: rigid registration, Anaconda, and a Demons algorithm. For comparison with the ground truth, TRE values calculated using the automatically detected correspondences were interpolated in the whole organs to generate TRE maps. The performance of the method in automatically calculating TRE after image registration was quantified by measuring the correlation with the TRE obtained when using the ground truth landmarks. RESULTS: The median Pearson correlation coefficients between ground truth TRE and corresponding values in the generated TRE maps were r = 0.81 and r = 0.67 for the lung and liver cases, respectively. The correlation coefficients between mean TRE for each case were r = 0.99 and r = 0.64 for the lung and liver cases, respectively. CONCLUSION: For lungs or liver CT scans DIR, a strong correlation was obtained between TRE calculated using manually picked or landmarks automatically detected with the proposed method. This tool should be particularly useful in studies requiring assessing the reliability of a high number of DIRs.

Geometric and dosimetric accuracy of deformable image registration between average-intensity images for 4DCT-based adaptive radiotherapy for non-small cell lung cancer.

PURPOSE: Re-planning for four-dimensional computed tomography (4DCT)-based lung adaptive radiotherapy commonly requires deformable dose mapping between the planning average-intensity image (AVG) and the newly acquired AVG. However, such AVG-AVG deformable image registration (DIR) lacks accuracy assessment. The current work quantified and compared geometric accuracies of AVG-AVG DIR and corresponding phase-phase DIRs, and subsequently investigated the clinical impact of such AVG-AVG DIR on deformable dose mapping. METHODS AND MATERIALS: Hybrid intensity-based AVG-AVG and phase-phase DIRs were performed between the planning and mid-treatment 4DCTs of 28 non-small cell lung cancer patients. An automated landmark identification algorithm detected vessel bifurcation pairs in both lungs. Target registration error (TRE) of these landmark pairs was calculated for both DIR types. The correlation between TRE and respiratory-induced landmark motion in the planning 4DCT was analyzed. Global and local dose metrics were used to assess the clinical implications of AVG-AVG deformable dose mapping with both DIR types. RESULTS: TRE of AVG-AVG and phase-phase DIRs averaged 3.2 ± 1.0 and 2.6 ± 0.8 mm respectively (p < 0.001). Using AVG-AVG DIR, TREs for landmarks with <10 mm motion averaged 2.9 ± 2.0 mm, compared to 3.1 ± 1.9 mm for the remaining landmarks (p < 0.01). Comparatively, no significant difference was demonstrated for phase-phase DIRs. Dosimetrically, no significant difference in global dose metrics was observed between doses mapped with AVG-AVG DIR and the phase-phase DIR, but a positive linear relationship existed (p = 0.04) between the TRE of AVG-AVG DIR and local dose difference. CONCLUSIONS: When the region of interest experiences <10 mm respiratory-induced motion, AVG-AVG DIR may provide sufficient geometric accuracy; conversely, extra attention is warranted, and phase-phase DIR is recommended. Dosimetrically, the differences in geometric accuracy between AVG-AVG and phase-phase DIRs did not impact global lung-based metrics. However, as more localized dose metrics are needed for toxicity assessment, phase-phase DIR may be required as its lower mean TRE improved voxel-based dosimetry.

Mapping lung ventilation through stress maps derived from biomechanical models of the lung.

PURPOSE: Most existing computed tomography (CT)-ventilation imaging techniques are based on deformable image registration (DIR) of different respiratory phases of a four-dimensonal CT (4DCT) scan of the lung, followed by the quantification of local breathing-induced changes in Hounsfield Units (HU) or volume. To date, only moderate correlations have been reported between these CT-ventilation metrics and standard ventilation imaging modalities for adaptive lung radiation therapy. This study evaluates the use of stress maps derived from biomechanical model-based DIR as an alternative CT-ventilation metric. MATERIALS AND METHODS: Six patients treated for lung cancer with conventional radiation therapy were retrospectively analyzed. For each patient, a 4DCT scan and Tc-99m SPECT-V image acquired for treatment planning were collected. Biomechanical model-based DIR was applied between the inhale and exhale phase of the 4DCT scans and stress maps were calculated. The voxel-wise correlation between the reference SPECT-V image and map of the maximum principal stress was measured with a Spearman correlation coefficient. The overlap between high (above the 75th percentile) and low (below the 25th percentile) functioning volumes extracted from the reference SPECT-V and the stress maps was measured with Dice similarity coefficients (DSC). The results were compared to those obtained when using two classical CT-ventilation metrics: the change in HU and Jacobian determinant. RESULTS: The mean Spearman correlation coefficients were: 0.37 ± 18 and 0.39 ± 13 and 0.59 ± 0.13 considering the changes in HU, Jacobian and maximum principal stress, respectively. The corresponding mean DSC coefficients were 0.38 ± 0.09, 0.37 ± 0.07 and 0.52 ± 0.07 for the high ventilation function volumes and 0.48 ± 0.13, 0.44 ± 0.09 and 0.52 ± 0.07 for the low ventilation function volumes. CONCLUSION: For presenting a significantly stronger and more consistent correlation with standard SPECT-V images than previously proposed CT-ventilation metrics, stress maps derived with the proposed method appear to be a promising tool for incorporation into functional lung avoidance strategies.

Automatic Segmentation Using Deep Learning to Enable Online Dose Optimization During Adaptive Radiation Therapy of Cervical Cancer.

PURPOSE: This study investigated deep learning models for automatic segmentation to support the development of daily online dose optimization strategies, eliminating the need for internal target volume expansions and thereby reducing toxicity events of intensity modulated radiation therapy for cervical cancer. METHODS AND MATERIALS: The cervix-uterus, vagina, parametrium, bladder, rectum, sigmoid, femoral heads, kidneys, spinal cord, and bowel bag were delineated on 408 computed tomography (CT) scans from patients treated at MD Anderson Cancer Center (n = 214), Polyclinique Bordeaux Nord Aquitaine (n = 30), and enrolled in a Medical Image Computing & Computer Assisted Intervention challenge (n = 3). The data were divided into 255 training, 61 validation, 62 internal test, and 30 external test CT scans. Two models were investigated: the 2-dimensional (2D) DeepLabV3+ (Google) and 3-dimensional (3D) Unet in RayStation (RaySearch Laboratories). Three intensity modulated radiation therapy plans were generated on each CT of the internal and external test sets using either the manual, 2D model, or 3D model segmentations. The dose constraints followed the External beam radiochemotherapy and MRI based adaptive BRAchytherapy in locally advanced CErvical cancer (EMBRACE) II protocol, with reduced margins of 5 and 3 mm for the target and nodal planning target volume. Geometric discrepancies between the manual and predicted contours were assessed using the Dice similarity coefficient (DSC), distance-to-agreement, and Hausdorff distance. Dosimetric discrepancies between the manual and model doses were assessed using clinical indices on the manual contours and the gamma index. Interobserver variability was assessed for the cervix-uterus, parametrium, and vagina for the definition of the primary clinical target volume (CTVT) on the external test set. RESULTS: Average DSCs across all organs were 0.67 to 0.96, 0.71 to 0.97, and 0.42 to 0.92 for the 2D model and 0.66 to 0.96, 0.70 to 0.97, and 0.37 to 0.93 for the 3D model on the validation, internal, and external test sets. Average DSCs of the CTVT were 0.88 and 0.81 for the 2D model and 0.87 and 0.82 for the 3D model on the internal and external test sets. Interobserver variability of the CTVT corresponded to a mean (range) DSC of 0.85 (0.77-0.90) on the external test set. On the internal test set, the doses from the 2D and 3D model contours provided a CTVT V42.75 Gy >98% for 98% and 91% of the CT scans, respectively. On the external test set, these percentages were increased to 100% and 93% for the 2D and 3D models, respectively. CONCLUSIONS: The investigated models provided auto-segmentation of the cervix anatomy with similar performances on 2 institutional data sets and reasonable dosimetric accuracies using small planning target volume margins, paving the way to automatic online dose optimization for advanced adaptive radiation therapy strategies.

Preliminary evaluation of biomechanical modeling of lung deflation during minimally invasive surgery using pneumothorax computed tomography scans.

During minimally invasive surgery (MIS) for lung tumor resection, the localization of tumors or nodules relies on visual inspection of the deflated lung on intra-procedural video. For patients with tumors or nodules located deeper in the lung, this localization is not possible without prior invasive marking techniques. In efforts to avoid the increase of complication rates associated with these invasive techniques, this study investigates the use of biomechanical modeling of the lung deflation to predict the tumor localization during MIS, solely based on a pre-operative computed tomography (CT) scan. The feasibility of the proposed approach is evaluated using preliminary data from six patients who presented with pneumothorax after lung biopsy and underwent chest tube insertion. For each patient, a hyperelastic finite-element model of the lung was created from the CT scan showing the re-inflated lung. Boundary conditions were applied on the lung surface to simulate the gravity and insufflation of carbon dioxide in the chest. The impact of adding rigid constraints around the main airway was also evaluated. To evaluate the accuracy of the model in predicting lung tissues or potential tumor displacement, at least five corresponding landmarks were identified for each patient in the CT scans of their deflated and re-inflated lungs. Using these landmarks, target localization errors (TLE) were measured for different sets of pressure applied to lung surface and shear modulus. For five patients, the minimum achieved mean TLE was inferior to 9 mm using patient-specific parameters and inferior to 10 mm using the same parameterization. The predicted and ground truth deflated lung surfaces presented visually a relatively good agreement. The proposed approach thus appears as a promising tool for integration in future lung surgery image-guidance systems.

Biomechanical modeling of radiation dose-induced volumetric changes of the parotid glands for deformable image registration.

PURPOSE: Early animal studies suggest that parotid gland (PG) toxicity prediction could be improved by an accurate estimation of the radiation dose to sub-regions of the PG. Translation to clinical investigation requires voxel-level dose accumulation in this organ that responds volumetrically throughout treatment. To date, deformable image registration (DIR) has been evaluated for the PG using only surface alignment. We sought to develop and evaluate an advanced DIR technique capable of modeling these complex PG volume changes over the course of radiation therapy. MATERIALS AND METHODS: Planning and mid-treatment magnetic resonance images from 19 patients and computed tomography images from nine patients who underwent radiation therapy for head and neck cancer were retrospectively evaluated. A finite element model (FEM)-based DIR algorithm was applied between the corresponding pairs of images, based on boundary conditions on the PG surfaces only (Morfeus-spatial). To investigate an anticipated improvement in accuracy, we added a population model-based thermal expansion coefficient to simulate the dose distribution effect on the volume change inside the glands (Morfeus-spatialDose). The model accuracy was quantified using target registration error for magnetic resonance images, where corresponding anatomical landmarks could be identified. The potential clinical impact was evaluated using differences in mean dose, median dose, D98, and D50 of the PGs. RESULTS: In the magnetic resonance images, the mean (±standard deviation) target registration error significantly reduced by 0.25 ± 0.38 mm (p = 0.01) when using Morfeus-spatialDose instead of Morfeus-spatial. In the computed tomography images, differences in the mean dose, median dose, D98, and D50 of the PGs reached 2.9 ± 0.8, 3.8, 4.1, and 3.8 Gy, respectively, between Morfeus-spatial and Morfeus-spatialDose. CONCLUSION: Differences between Morfeus-spatial and Morfeus-spatialDose may be impactful when considering high-dose gradients of radiation in the PGs. The proposed DIR model can allow more accurate PG alignment than the standard model and improve dose estimation and toxicity prediction modeling.

Vasculature-Driven Biomechanical Deformable Image Registration of Longitudinal Liver Cholangiocarcinoma Computed Tomographic Scans.

PURPOSE: Deformable image registration (DIR) of longitudinal liver cancer computed tomographic (CT) images can be challenging owing to anatomic changes caused by radiation therapy (RT) or disease progression. We propose a workflow for the DIR of longitudinal contrast-enhanced CT scans of liver cancer based on a biomechanical model of the liver driven by boundary conditions on the liver surface and centerline of an autosegmentation of the vasculature. METHODS AND MATERIALS: Pre- and post-RT CT scans acquired with a median gap of 112 (32-217) days for 28 patients who underwent RT for intrahepatic cholangiocarcinoma were retrospectively analyzed. For each patient, 5 corresponding anatomic landmarks in pre- and post-RT scans were identified in the liver by a clinical expert for evaluation of the accuracy of different DIR strategies. The first strategy corresponded to the use of a biomechanical model-based DIR method with boundary conditions specified on the liver surface (BM_DIR). The second strategy corresponded to the use of an expansion of BM_DIR consisting of the auto-segmentation of the liver vasculature to determine additional boundary conditions in the biomechanical model (BM_DIR_VBC). The 2 strategies were also compared with an intensity-based DIR strategy using a Demons algorithms. RESULTS: The group mean target registration errors were 12.4 ± 7.5, 7.7 ± 3.7 and 4.4 ± 2.5 mm, for the Demons, BM_DIR and BM_DIR_VBC, respectively. CONCLUSIONS: In regard to the large and complex deformation observed in this study and the achieved accuracy of 4.4 mm, the proposed BM_DIR_VBC method might reveal itself as a valuable tool in future studies on the relationship between delivered dose and treatment outcome.

Modeling Complex Deformations of the Sigmoid Colon Between External Beam Radiation Therapy and Brachytherapy Images of Cervical Cancer.

PURPOSE: In this study, we investigated registration methods for estimating the large interfractional sigmoid deformations that occur between external beam radiation therapy (EBRT) and brachytherapy (BT) for cervical cancer. METHODS AND MATERIALS: Sixty-three patients were retrospectively analyzed. The sigmoid colon was delineated on 2 computed tomography images acquired during EBRT (without applicator) and BT (with applicator) for each patient. Five registration approaches were compared to propagate the contour of the sigmoid from BT to EBRT anatomies: rigid registration, commercial hybrid (ANAtomically CONstrained Deformation Algorithm), controlling ROI surface projection of RayStation, and the classical and constrained symmetrical thin-plate spline robust point matching (sTPS-RPM) methods. Deformation of the sigmoid due to insertion of the BT applicator was reported. Registration performance was compared by using the Dice similarity coefficient (DSC), distance to agreement, and Hausdorff distance. The 2 sTPS-RPM methods were compared by using surface triangle quality criteria between deformed surfaces. Using the deformable approaches, the BT dose of the sigmoid was deformed toward the EBRT anatomy. The displacement and discrepancy between the deformable methods to propagate the planned D1cm3 and D2cm3 of the sigmoid from BT to EBRT anatomies were reported for 55 patients. RESULTS: Large and complex deformations of the sigmoid were observed for each patient. Rigid registration resulted in poor sigmoid alignment with a mean DSC of 0.26. Using the contour to drive the deformation, ANAtomically CONstrained Deformation Algorithm was able to slightly improve the alignment of the sigmoid with a mean DSC of 0.57. Using only the sigmoid surface as controlling ROI, the mean DSC was improved to 0.79. The classical and constrained sTPS-RPM methods provided mean DSCs of 0.95 and 0.96, respectively, with an average inverse consistency error <1 mm. The constrained sTPS-RPM provided more realistic deformations and better surface topology of the deformed sigmoids. The planned mean (range) D1cm3 and D2cm3 of the sigmoid were 13.4 Gy (1-24.1) and 12.2 Gy (1-21.5) on the BT anatomy, respectively. Using the constrained sTPS-RPM to deform the sigmoid from BT to EBRT anatomies, these hotspots had a mean (range) displacement of 27.1 mm (6.8-81). CONCLUSIONS: Large deformations of the sigmoid were observed between the EBRT and BT anatomies, suggesting that the D1cm3 and D2cm3 of the sigmoid would unlikely to be at the same position throughout treatment. The proposed constrained sTPS-RPM seems to be the preferred approach to manage the large deformation due to BT applicator insertion. Such an approach could be used to map the EBRT dose to the BT anatomy for personalized BT planning optimization.

Accuracy of deformable image registration techniques for alignment of longitudinal cholangiocarcinoma CT images.

PURPOSE: Response assessment of radiotherapy for the treatment of intrahepatic cholangiocarcinoma (IHCC) across longitudinal images is challenging due to anatomical changes. Advanced deformable image registration (DIR) techniques are required to correlate corresponding tissues across time. In this study, the accuracy of five commercially available DIR algorithms in four treatment planning systems (TPS) was investigated for the registration of planning images with posttreatment follow-up images for response assessment or re-treatment purposes. METHODS: Twenty-nine IHCC patients treated with hypofractionated radiotherapy and with pretreatment and posttreatment contrast-enhanced computed tomography (CT) images were analyzed. Liver segmentations were semiautomatically generated on all CTs and the posttreatment CT was then registered to the pretreatment CT using five commercially available algorithms (Demons, B-splines, salient feature-based, anatomically constrained and finite element-based) in four TPSs. This was followed by an in-depth analysis of 10 DIR strategies (plus global and liver-focused rigid registration) in one of the TPSs. Eight of the strategies were variants of the anatomically constrained DIR while the two were based on a finite element-based biomechanical registration. The anatomically constrained techniques were combinations of: (a) initializations with the two rigid registrations; (b) two similarity metrics - correlation coefficient (CC) and mutual information (MI); and (c) with and without a controlling region of interest (ROI) - the liver. The finite element-based techniques were initialized by the two rigid registrations. The accuracy of each registration was evaluated using target registration error (TRE) based on identified vessel bifurcations. The results were statistically analyzed with a one-way analysis of variance (ANOVA) and pairwise comparison tests. Stratified analysis was conducted on the inter-TPS data (plus the liver-focused rigid registration) using treatment volume changes, slice thickness, time between scans, and abnormal lab values as stratifying factors. RESULTS: The complex deformation observed following treatment resulted in average TRE exceeding the image voxel size for all techniques. For the inter-TPS comparison, the Demons algorithm had the lowest TRE, which was significantly superior to all the other algorithms. The respective mean (standard deviation) TRE (in mm) for the Demons, B-splines, salient feature-based, anatomically constrained, and finite element-based algorithms were 4.6 (2.0), 7.4 (2.7), 7.2 (2.6), 6.3 (2.3), and 7.5 (4.0). In the follow-up comparison of the anatomically constrained DIR, the strategy with liver-focused rigid registration initialization, CC as similarity metric and liver as a controlling ROI had the lowest mean TRE - 6.0 (2.0). The maximum TRE for all techniques exceeded 10 mm. Selection of DIR strategy was found to be a statistically significant factor for registration accuracy. Tumor volume change had a significant effect on TRE for finite element-based registration and B-splines DIR. Time between scans had a substantial effect on TRE for all registrations but was only significant for liver-focused rigid, finite element-based and salient feature-based DIRs. CONCLUSIONS: This study demonstrates the limitations of commercially available DIR techniques in TPSs for alignment of longitudinal images of liver cancer presenting complex anatomical changes including local hypertrophy and fibrosis/necrosis. DIR in this setting should be used with caution and careful evaluation.

Biomechanical modeling of neck flexion for deformable alignment of the salivary glands in head and neck cancer images.

During head and neck (HN) cancer radiation therapy, analysis of the dose-response relationship for the parotid glands (PG) relies on the ability to accurately align soft tissue organs between longitudinal images. In order to isolate the response of the salivary glands to delivered dose, from deformation due to patient position, it is important to resolve the patient postural changes, mainly due to neck flexion. In this study we evaluate the use of a biomechanical model-based deformable image registration (DIR) algorithm to estimate the displacements and deformations of the salivary glands due to postural changes. A total of 82 pairs of CT images of HN cancer patients with varying angles of neck flexion were retrospectively obtained. The pairs of CTs of each patient were aligned using bone-based rigid registration. The images were then deformed using biomechanical model-based DIR method that focused on the mandible, C1 vertebrae, C3 vertebrae, and external contour. For comparison, an intensity-based DIR was also performed. The accuracy of the biomechanical model-based DIR was assessed using Dice similarity coefficient (DSC) for all images and for the subset of images where the PGs had a volume change within 20%. The accuracy was compared to the intensity-based DIR. The PG mean ± STD DSC were 0.63 ± 0.18, 0.80 ± 0.08, and 0.82 ± 0.15 for the rigid registration, biomechanical model-based DIR, and intensity based DIR, respectively, for patients with a PG volume change up to 20%. For the entire cohort of patients, where the PG volume change was up to 57%, the PG mean ± STD DSC were 0.60 ± 0.18, 0.78 ± 0.09, and 0.81 ± 0.14 for the rigid registration, biomechanical model-based DIR, and intensity based DIR, respectively. The difference in DSC of the intensity and biomechanical model-based DIR methods was not statistically significant when the volume change was less than 20% (two-sided paired t-test, p  = 0.12). When all volume changes were considered, there was a significant difference between the two registration approaches, although the magnitude was small. These results demonstrate that the proposed biomechanical model with boundary conditions on the bony anatomy can serve to describe the varying angles of neck flexion appearing in images during radiation treatment and to align the salivary glands for proper analysis of dose-response relationships. It also motivates the need for dose response modeling following neck flexion for cases where parotid gland response is noted.

Deformable image registration for radiation therapy: principle, methods, applications and evaluation.

Background: Deformable image registration (DIR) is increasingly used in the field of radiation therapy (RT) to account for anatomical deformations. The aims of this paper are to describe the main applications of DIR in RT and discuss current DIR evaluation methods. Methods: Articles on DIR published from January 2000 to October 2018 were extracted from PubMed and Science Direct. Our search was restricted to articles that report data obtained from humans, were written in English, and address DIR methods for RT. A total of 207 articles were selected from among 2506 identified in the search process. Results: At planning, DIR is used for organ delineation using atlas-based segmentation, deformation-based planning target volume definition, functional planning and magnetic resonance imaging-based dose calculation. In image-guided RT, DIR is used for contour propagation and dose calculation on per-treatment imaging. DIR is also used to determine the accumulated dose from fraction to fraction in external beam RT and brachytherapy, both for dose reporting and adaptive RT. In the case of re-irradiation, DIR can be used to estimate the cumulated dose of the two irradiations. Finally, DIR can be used to predict toxicity in voxel-wise population analysis. However, the evaluation of DIR remains an open issue, especially when dealing with complex cases such as the disappearance of matter. To quantify DIR uncertainties, most evaluation methods are limited to geometry-based metrics. Software companies have now integrated DIR tools into treatment planning systems for clinical use, such as contour propagation and fraction dose accumulation. Conclusions: DIR is increasingly important in RT applications, from planning to toxicity prediction. DIR is routinely used to reduce the workload of contour propagation. However, its use for complex dosimetric applications must be carefully evaluated by combining quantitative and qualitative analyses.

Effect of setup and inter-fraction anatomical changes on the accumulated dose in CT-guided breath-hold intensity modulated proton therapy of liver malignancies.

PURPOSE: To evaluate the effect of setup uncertainties including uncertainties between different breath holds (BH) and inter-fractional anatomical changes under CT-guided BH with intensity-modulated proton therapy (IMPT) in patients with liver cancer. METHODS AND MATERIALS: This retrospective study considered 17 patients with liver tumors who underwent feedback-guided BH (FGBH) IMRT treatment with daily CT-on-rail imaging. Planning CT images were acquired at simulation using FGBH, and FGBH CT-on-rail images were also acquired prior to each treatment. Selective robust IMPT plans were generated using planning CT and re-calculated on each daily CT-on-rail image. Subsequently, the fractional doses were deformed and accumulated onto the planning CT according to the deformable image registration between daily and planning CTs. The doses to the target and organs at risk (OARs) were compared between IMRT, planned IMPT, and accumulated IMPT doses. RESULTS: For IMPT plans, the mean of D98% of CTV for all 17 patients was slightly reduced from the planned dose of 68.90 ±â€¯1.61 Gy to 66.48 ±â€¯1.67 Gy for the accumulated dose. The target coverage could be further improved by adjusting planning techniques. The dose-volume histograms of both planned and accumulated IMPT doses showed better sparing of OARs than that of the IMRT. CONCLUSIONS: IMPT with FGBH and CT-on-rail guidance is a robust treatment approach for liver tumor cases.

The VAMPIRE challenge: A multi-institutional validation study of CT ventilation imaging.

PURPOSE: CT ventilation imaging (CTVI) is being used to achieve functional avoidance lung cancer radiation therapy in three clinical trials (NCT02528942, NCT02308709, NCT02843568). To address the need for common CTVI validation tools, we have built the Ventilation And Medical Pulmonary Image Registration Evaluation (VAMPIRE) Dataset, and present the results of the first VAMPIRE Challenge to compare relative ventilation distributions between different CTVI algorithms and other established ventilation imaging modalities. METHODS: The VAMPIRE Dataset includes 50 pairs of 4DCT scans and corresponding clinical or experimental ventilation scans, referred to as reference ventilation images (RefVIs). The dataset includes 25 humans imaged with Galligas 4DPET/CT, 21 humans imaged with DTPA-SPECT, and 4 sheep imaged with Xenon-CT. For the VAMPIRE Challenge, 16 subjects were allocated to a training group (with RefVI provided) and 34 subjects were allocated to a validation group (with RefVI blinded). Seven research groups downloaded the Challenge dataset and uploaded CTVIs based on deformable image registration (DIR) between the 4DCT inhale/exhale phases. Participants used DIR methods broadly classified into B-splines, Free-form, Diffeomorphisms, or Biomechanical modeling, with CT ventilation metrics based on the DIR evaluation of volume change, Hounsfield Unit change, or various hybrid approaches. All CTVIs were evaluated against the corresponding RefVI using the voxel-wise Spearman coefficient rS , and Dice similarity coefficients evaluated for low function lung ( DSClow ) and high function lung ( DSChigh ). RESULTS: A total of 37 unique combinations of DIR method and CT ventilation metric were either submitted by participants directly or derived from participant-submitted DIR motion fields using the in-house software, VESPIR. The rS and DSC results reveal a high degree of inter-algorithm and intersubject variability among the validation subjects, with algorithm rankings changing by up to ten positions depending on the choice of evaluation metric. The algorithm with the highest overall cross-modality correlations used a biomechanical model-based DIR with a hybrid ventilation metric, achieving a median (range) of 0.49 (0.27-0.73) for rS , 0.52 (0.36-0.67) for DSClow , and 0.45 (0.28-0.62) for DSChigh . All other algorithms exhibited at least one negative rS value, and/or one DSC value less than 0.5. CONCLUSIONS: The VAMPIRE Challenge results demonstrate that the cross-modality correlation between CTVIs and the RefVIs varies not only with the choice of CTVI algorithm but also with the choice of RefVI modality, imaging subject, and the evaluation metric used to compare relative ventilation distributions. This variability may arise from the fact that each of the different CTVI algorithms and RefVI modalities provides a distinct physiologic measurement. Ultimately this variability, coupled with the lack of a "gold standard," highlights the ongoing importance of further validation studies before CTVI can be widely translated from academic centers to the clinic. It is hoped that the information gleaned from the VAMPIRE Challenge can help inform future validation efforts.