Task-based image quality assessment in radiation therapy: initial characterization and demonstration with computer-simulation study.

In the majority of current radiation therapy (RT) applications, image quality is still assessed subjectively or by utilizing physical measures. A novel theory that applies objective task-based image quality assessment in radiation therapy (IQA-in-RT) was recently proposed, in which the area under the therapeutic operating characteristic curve (AUTOC) was employed as the figure-of-merit (FOM) for evaluating RT effectiveness. Although theoretically more appealing than conventional subjective or physical measures, a comprehensive implementation and evaluation of this novel task-based IQA-in-RT theory is required for its further application in improving clinical RT. In this work, a practical and modular IQA-in-RT framework is presented for implementing this theory for the assessment of imaging components on the basis of RT treatment outcomes. Computer-simulation studies are conducted to demonstrate the feasibility and utility of the proposed IQA-in-RT framework in optimizing x-ray computed tomography (CT) pre-treatment imaging, including the optimization of CT imaging dose and image reconstruction parameters. The potential advantages of optimizing imaging components in the RT workflow by use of the AUTOC as the FOM are also compared against those of other physical measures. The results demonstrate that optimization using the AUTOC leads to selecting different parameters from those indicated by physical measures, potentially improving RT performance. The sources of systemic randomness and bias that affect the determination of the AUTOC are also analyzed. The presented work provides a practical solution for the further investigation and analysis of the task-based IQA-in-RT theory and advances its applications in improving RT clinical practice and cancer patient care.

Technical Note: A feasibility study of using the flat panel detector on linac for the kV x-ray generator test.

PURPOSE: To investigate the feasibility of using kV flat panel detector on linac for consistency evaluations of kV x-ray generator performance. METHODS: An in-house designed aluminum (Al) array phantom with six 9 × 9 cm2 square regions having various thickness was proposed and used in this study. Through XML script-driven image acquisition, kV images with various acquisition settings were obtained using the kV flat panel detector. Utilizing pre-established baseline curves, the consistency of x-ray tube output characteristics, including tube voltage accuracy, exposure accuracy and exposure linearity was assessed through image quality assessment metrics including ROI mean intensity, ROI standard deviation (SD), and noise power spectrums (NPS). The robustness of this method was tested on two linacs for a 3-month period. RESULTS: With the proposed method, tube voltage accuracy can be verified through conscience check with a 2% tolerance and 2 kVp intervals for forty different kVp settings. The exposure accuracy can be tested with a 4% consistency tolerance for three mAs settings over forty kVp settings. The exposure linearity tested with 3 mAs settings achieved a coefficient of variation (CV) of 0.1. CONCLUSION: We proposed a novel approach that uses the kV flat panel detector available on linac for x-ray generator test. This approach eliminates the inefficiencies and variability associated with using third-party QA detectors while enabling an automated process.

Learning-based stochastic object models for characterizing anatomical variations.

It is widely known that the optimization of imaging systems based on objective, task-based measures of image quality via computer-simulation requires the use of a stochastic object model (SOM). However, the development of computationally tractable SOMs that can accurately model the statistical variations in human anatomy within a specified ensemble of patients remains a challenging task. Previously reported numerical anatomic models lack the ability to accurately model inter-patient and inter-organ variations in human anatomy among a broad patient population, mainly because they are established on image data corresponding to a few of patients and individual anatomic organs. This may introduce phantom-specific bias into computer-simulation studies, where the study result is heavily dependent on which phantom is used. In certain applications, however, databases of high-quality volumetric images and organ contours are available that can facilitate this SOM development. In this work, a novel and tractable methodology for learning a SOM and generating numerical phantoms from a set of volumetric training images is developed. The proposed methodology learns geometric attribute distributions (GAD) of human anatomic organs from a broad patient population, which characterize both centroid relationships between neighboring organs and anatomic shape similarity of individual organs among patients. By randomly sampling the learned centroid and shape GADs with the constraints of the respective principal attribute variations learned from the training data, an ensemble of stochastic objects can be created. The randomness in organ shape and position reflects the learned variability of human anatomy. To demonstrate the methodology, a SOM of an adult male pelvis is computed and examples of corresponding numerical phantoms are created.

Rapid acceptance testing of modern linac using on-board MV and kV imaging systems.

PURPOSE: The purpose of this study was to develop a novel process for using on-board MV and kV Electronic Portal Imaging Devices (EPIDs) to perform linac acceptance testing (AT) for two reasons: (a) to standardize the assessment of new equipment performance, and (b) to reduce the time to clinical use while reducing physicist workload. METHODS AND MATERIALS: In this study, Varian TrueBeam linacs equipped with amorphous silicon-based EPID (aS1000) were used. The conventional set of AT tests and tolerances were used as a baseline guide. A novel methodology was developed or adopted from published literature to perform as many tests as possible using the MV and kV EPIDs. The developer mode on Varian TrueBeam linacs was used to automate the process. In the EPID-based approach, most of mechanical tests were conducted by acquiring images through a custom phantom and software tools were developed for quantitative analysis to extract different performance parameters. The embedded steel-spheres in a custom phantom provided both visual and radiographic guidance for beam geometry testing. For photon beams, open field EPID images were used to extract inline/crossline profiles to verify the beam energy, flatness and symmetry. EPID images through a double wedge phantom were used for evaluating electron beam properties via diagonal profile. Testing was augmented with a commercial automated application (Machine Performance Check) which was used to perform several geometric accuracy tests such as gantry, collimator rotations, and couch rotations/translations. RESULTS: The developed process demonstrated that the tests, which required customer demonstration, were efficiently performed using EPIDs. The AT tests that were performed using EPIDs were fully automated using the developer mode on the Varian TrueBeam system, while some tests, such as the light field versus radiation field congruence, and collision interlock checks required user interaction. CONCLUSIONS: On-board imagers are quite suitable for both geometric and dosimetric testing of linac system involved in AT. Electronic format of the acquired data lends itself to benchmarking, transparency, as well as longitudinal use of AT data. While the tests were performed on a specific model of a linear accelerator, the proposed approach can be extended to other linacs.

An integrated model-driven method for in-treatment upper airway motion tracking using cine MRI in head and neck radiation therapy.

PURPOSE: For the first time, MRI-guided radiation therapy systems can acquire cine images to dynamically monitor in-treatment internal organ motion. However, the complex head and neck (H&N) structures and low-contrast/resolution of on-board cine MRI images make automatic motion tracking a very challenging task. In this study, the authors proposed an integrated model-driven method to automatically track the in-treatment motion of the H&N upper airway, a complex and highly deformable region wherein internal motion often occurs in an either voluntary or involuntary manner, from cine MRI images for the analysis of H&N motion patterns. METHODS: Considering the complex H&N structures and ensuring automatic and robust upper airway motion tracking, the authors firstly built a set of linked statistical shapes (including face, face-jaw, and face-jaw-palate) using principal component analysis from clinically approved contours delineated on a set of training data. The linked statistical shapes integrate explicit landmarks and implicit shape representation. Then, a hierarchical model-fitting algorithm was developed to align the linked shapes on the first image frame of a to-be-tracked cine sequence and to localize the upper airway region. Finally, a multifeature level set contour propagation scheme was performed to identify the upper airway shape change, frame-by-frame, on the entire image sequence. The multifeature fitting energy, including the information of intensity variations, edge saliency, curve geometry, and temporal shape continuity, was minimized to capture the details of moving airway boundaries. Sagittal cine MR image sequences acquired from three H&N cancer patients were utilized to demonstrate the performance of the proposed motion tracking method. RESULTS: The tracking accuracy was validated by comparing the results to the average of two manual delineations in 50 randomly selected cine image frames from each patient. The resulting average dice similarity coefficient (93.28% ± 1.46%) and margin error (0.49 ± 0.12 mm) showed good agreement between the automatic and manual results. The comparison with three other deformable model-based segmentation methods illustrated the superior shape tracking performance of the proposed method. Large interpatient variations of swallowing frequency, swallowing duration, and upper airway cross-sectional area were observed from the testing cine image sequences. CONCLUSIONS: The proposed motion tracking method can provide accurate upper airway motion tracking results, and enable automatic and quantitative identification and analysis of in-treatment H&N upper airway motion. By integrating explicit and implicit linked-shape representations within a hierarchical model-fitting process, the proposed tracking method can process complex H&N structures and low-contrast/resolution cine MRI images. Future research will focus on the improvement of method reliability, patient motion pattern analysis for providing more information on patient-specific prediction of structure displacements, and motion effects on dosimetry for better H&N motion management in radiation therapy.

A comparative study based on image quality and clinical task performance for CT reconstruction algorithms in radiotherapy.

CT image reconstruction is typically evaluated based on the ability to reduce the radiation dose to as-low-as-reasonably-achievable (ALARA) while maintaining acceptable image quality. However, the determination of common image quality metrics, such as noise, contrast, and contrast-to-noise ratio, is often insufficient for describing clinical radiotherapy task performance. In this study we designed and implemented a new comparative analysis method associating image quality, radiation dose, and patient size with radiotherapy task performance, with the purpose of guiding the clinical radiotherapy usage of CT reconstruction algorithms. The iDose4 iterative reconstruction algorithm was selected as the target for comparison, wherein filtered back-projection (FBP) reconstruction was regarded as the baseline. Both phantom and patient images were analyzed. A layer-adjustable anthropomorphic pelvis phantom capable of mimicking 38-58 cm lateral diameter-sized patients was imaged and reconstructed by the FBP and iDose4 algorithms with varying noise-reduction-levels, respectively. The resulting image sets were quantitatively assessed by two image quality indices, noise and contrast-to-noise ratio, and two clinical task-based indices, target CT Hounsfield number (for electron density determination) and structure contouring accuracy (for dose-volume calculations). Additionally, CT images of 34 patients reconstructed with iDose4 with six noise reduction levels were qualitatively evaluated by two radiation oncologists using a five-point scoring mechanism. For the phantom experiments, iDose4 achieved noise reduction up to 66.1% and CNR improvement up to 53.2%, compared to FBP without considering the changes of spatial resolution among images and the clinical acceptance of reconstructed images. Such improvements consistently appeared across different iDose4 noise reduction levels, exhibiting limited interlevel noise (< 5 HU) and target CT number variations (< 1 HU). The radiation dose required to achieve similar contouring accuracy decreased when using iDose4 in place of FBP, up to 32%. Contouring accuracy improvement for iDose4 images, when compared to FBP, was greater in larger patients than smaller-sized patients. Overall, the iDose4 algorithm provided superior radiation dose control while maintaining or improving task performance, when compared to FBP. The reader study on image quality improvement of patient cases shows that physicians preferred iDose4-reconstructed images on all cases compared to those from FBP algorithm with overall quality score: 1.21 vs. 3.15, p = 0.0022. However, qualitative evaluation strongly indicated that the radiation oncologists chose iDose4 noise reduction levels of 3-4 with additional consideration of task performance, instead of image quality metrics alone. Although higher iDose4 noise reduction levels improved the CNR through the further reduction of noise, there was pixelization of anatomical/tumor structures. Very-low-dose scans yielded severe photon starvation artifacts, which decreased target visualization on both FBP and iDose4 reconstructions, especially for the 58 cm phantom size. The iDose4 algorithm with a moderate noise reduction level is hence suggested for CT simulation and treatment planning. Quantitative task-based image quality metrics should be further investigated to accommodate additional clinical applications.

Practical considerations for noise power spectra estimation for clinical CT scanners.

Local noise power spectra (NPS) have been commonly calculated to represent the noise properties of CT imaging systems, but their properties are significantly affected by the utilized calculation schemes. In this study, the effects of varied calculation parameters on the local NPS were analyzed, and practical suggestions were provided regarding the estimation of local NPS for clinical CT scanners. The uniformity module of a Catphan phantom was scanned with a Philips Brilliance 64 slice CT simulator with varied scanning protocols. Images were reconstructed using FBP and iDose4 iterative reconstruction with noise reduction levels 1, 3, and 6. Local NPS were calculated and compared for varied region of interest (ROI) locations and sizes, image background removal methods, and window functions. Additionally, with a predetermined NPS as a ground truth, local NPS calculation accuracy was compared for computer simulated ROIs, varying the aforementioned parameters in addition to ROI number. An analysis of the effects of these varied calculation parameters on the magnitude and shape of the NPS was conducted. The local NPS varied depending on calculation parameters, particularly at low spatial frequencies below ~ 0.15 mm-1. For the simulation study, NPS calculation error decreased exponentially as ROI number increased. For the Catphan study the NPS magnitude varied as a function of ROI location, which was better observed when using smaller ROI sizes. The image subtraction method for background removal was the most effective at reducing low-frequency background noise, and produced similar results no matter which ROI size or window function was used. The PCA background removal method with a Hann window function produced the closest match to image subtraction, with an average percent difference of 17.5%. Image noise should be analyzed locally by calculating the NPS for small ROI sizes. A minimum ROI size is recommended based on the chosen radial bin size and image pixel dimensions. As the ROI size decreases, the NPS becomes more dependent on the choice of background removal method and window function. The image subtraction method is most accurate, but other methods can achieve similar accuracy if certain window functions are applied. All dependencies should be analyzed and taken into account when considering the interpretation of the NPS for task-based image quality assessment.

Automated contouring error detection based on supervised geometric attribute distribution models for radiation therapy: a general strategy.

PURPOSE: One of the most critical steps in radiation therapy treatment is accurate tumor and critical organ-at-risk (OAR) contouring. Both manual and automated contouring processes are prone to errors and to a large degree of inter- and intraobserver variability. These are often due to the limitations of imaging techniques in visualizing human anatomy as well as to inherent anatomical variability among individuals. Physicians/physicists have to reverify all the radiation therapy contours of every patient before using them for treatment planning, which is tedious, laborious, and still not an error-free process. In this study, the authors developed a general strategy based on novel geometric attribute distribution (GAD) models to automatically detect radiation therapy OAR contouring errors and facilitate the current clinical workflow. METHODS: Considering the radiation therapy structures' geometric attributes (centroid, volume, and shape), the spatial relationship of neighboring structures, as well as anatomical similarity of individual contours among patients, the authors established GAD models to characterize the interstructural centroid and volume variations, and the intrastructural shape variations of each individual structure. The GAD models are scalable and deformable, and constrained by their respective principal attribute variations calculated from training sets with verified OAR contours. A new iterative weighted GAD model-fitting algorithm was developed for contouring error detection. Receiver operating characteristic (ROC) analysis was employed in a unique way to optimize the model parameters to satisfy clinical requirements. A total of forty-four head-and-neck patient cases, each of which includes nine critical OAR contours, were utilized to demonstrate the proposed strategy. Twenty-nine out of these forty-four patient cases were utilized to train the inter- and intrastructural GAD models. These training data and the remaining fifteen testing data sets were separately employed to test the effectiveness of the proposed contouring error detection strategy. RESULTS: An evaluation tool was implemented to illustrate how the proposed strategy automatically detects the radiation therapy contouring errors for a given patient and provides 3D graphical visualization of error detection results as well. The contouring error detection results were achieved with an average sensitivity of 0.954/0.906 and an average specificity of 0.901/0.909 on the centroid/volume related contouring errors of all the tested samples. As for the detection results on structural shape related contouring errors, an average sensitivity of 0.816 and an average specificity of 0.94 on all the tested samples were obtained. The promising results indicated the feasibility of the proposed strategy for the detection of contouring errors with low false detection rate. CONCLUSIONS: The proposed strategy can reliably identify contouring errors based upon inter- and intrastructural constraints derived from clinically approved contours. It holds great potential for improving the radiation therapy workflow. ROC and box plot analyses allow for analytically tuning of the system parameters to satisfy clinical requirements. Future work will focus on the improvement of strategy reliability by utilizing more training sets and additional geometric attribute constraints.