Search of low-contrast liver lesions in abdominal CT: the importance of scrolling behavior.

Purpose: Visual search using volumetric images is becoming the standard in medical imaging. However, we do not fully understand how eye movement strategies mediate diagnostic performance. A recent study on computed tomography (CT) images showed that the search strategies of radiologists could be classified based on saccade amplitudes and cross-quadrant eye movements [eye movement index (EMI)] into two categories: drillers and scanners. Approach: We investigate how the number of times a radiologist scrolls in a given direction during analysis of the images (number of courses) could add a supplementary variable to use to characterize search strategies. We used a set of 15 normal liver CT images in which we inserted 1 to 5 hypodense metastases of two different signal contrast amplitudes. Twenty radiologists were asked to search for the metastases while their eye-gaze was recorded by an eye-tracker device (EyeLink1000, SR Research Ltd., Mississauga, Ontario, Canada). Results: We found that categorizing radiologists based on the number of courses (rather than EMI) could better predict differences in decision times, percentage of image covered, and search error rates. Radiologists with a larger number of courses covered more volume in more time, found more metastases, and made fewer search errors than those with a lower number of courses. Our results suggest that the traditional definition of drillers and scanners could be expanded to include scrolling behavior. Drillers could be defined as scrolling back and forth through the image stack, each time exploring a different area on each image (low EMI and high number of courses). Scanners could be defined as scrolling progressively through the stack of images and focusing on different areas within each image slice (high EMI and low number of courses). Conclusions: Together, our results further enhance the understanding of how radiologists investigate three-dimensional volumes and may improve how to teach effective reading strategies to radiology residents.

Channelized Hotelling observer correlation with human observers for low-contrast detection in liver CT images.

Task-based image quality procedures in CT that substitute a human observer with a model observer usually use single-slice images with uniform backgrounds from homogeneous phantoms. However, anatomical structures and inhomogeneities in organs generate noise that can affect the detection performance of human observers. The purpose of this work was to assess the impact of background type, uniform or liver, and the viewing modality, single- or multislice, on the detection performance of human and model observers. We collected abdominal CT scans from patients and homogeneous phantom scans in which we digitally inserted low-contrast signals that mimicked a liver lesion. We ran a rating experiment with the two background conditions with three signal sizes and three human observers presenting images in two reading modalities: single- and multislice. In addition, channelized Hotelling observers (CHO) for single- and multislice detection were implemented and evaluated according to their degree of correlation with the human observer performance. For human observers, there was a small but significant improvement in performance with multislice compared to the single-slice viewing mode. Our data did not reveal a significant difference between uniform and anatomical backgrounds. Model observers demonstrated a good correlation with human observers for both viewing modalities. Human observers have very similar performances in both multi- and single-slice viewing mode. It is therefore preferable to use single-slice CHO as this model is computationally more tractable than multislice CHO. However, using images from a homogeneous phantom can result in overestimating image quality as CHO performance tends to be higher in uniform than anatomical backgrounds, while human observers have similar detection performances.

Task-based quantification of image quality using a model observer in abdominal CT: a multicentre study.

OBJECTIVE: We investigated the variability in diagnostic information inherent in computed tomography (CT) images acquired at 68 different CT units, with the selected acquisition protocols aiming to answer the same clinical question. METHODS: An anthropomorphic abdominal phantom with two optional rings was scanned on 68 CT systems from 62 centres using the local clinical acquisition parameters of the portal venous phase for the detection of focal liver lesions. Low-contrast detectability (LCD) was assessed objectively with channelised Hotelling observer (CHO) using the receiver operating characteristic (ROC) paradigm. For each lesion size, the area under the ROC curve (AUC) was calculated and considered as a figure of merit. The volume computed tomography dose index (CTDIvol) was used to indicate radiation dose exposure. RESULTS: The median CTDIvol used was 5.8 mGy, 10.5 mGy and 16.3 mGy for the small, medium and large phantoms, respectively. The median AUC obtained from clinical CT protocols was 0.96, 0.90 and 0.83 for the small, medium and large phantoms, respectively. CONCLUSIONS: Our study used a model observer to highlight the difference in image quality levels when dealing with the same clinical question. This difference was important and increased with growing phantom size, which generated large variations in patient exposure. In the end, a standardisation initiative may be launched to ensure comparable diagnostic information for well-defined clinical questions. The image quality requirements, related to the clinical question to be answered, should be the starting point of patient dose optimisation. KEY POINTS: • Model observers enable to assess image quality objectively based on clinical tasks. • Objective image quality assessment should always include several patient sizes. • Clinical diagnostic image quality should be the starting point for patient dose optimisation. • Dose optimisation by applying DRLs only is insufficient for ensuring clinical requirements.

Inter-laboratory comparison of channelized hotelling observer computation.

PURPOSE: The task-based assessment of image quality using model observers is increasingly used for the assessment of different imaging modalities. However, the performance computation of model observers needs standardization as well as a well-established trust in its implementation methodology and uncertainty estimation. The purpose of this work was to determine the degree of equivalence of the channelized Hotelling observer performance and uncertainty estimation using an intercomparison exercise. MATERIALS AND METHODS: Image samples to estimate model observer performance for detection tasks were generated from two-dimensional CT image slices of a uniform water phantom. A common set of images was sent to participating laboratories to perform and document the following tasks: (a) estimate the detectability index of a well-defined CHO and its uncertainty in three conditions involving different sized targets all at the same dose, and (b) apply this CHO to an image set where ground truth was unknown to participants (lower image dose). In addition, and on an optional basis, we asked the participating laboratories to (c) estimate the performance of real human observers from a psychophysical experiment of their choice. Each of the 13 participating laboratories was confidentially assigned a participant number and image sets could be downloaded through a secure server. Results were distributed with each participant recognizable by its number and then each laboratory was able to modify their results with justification as model observer calculation are not yet a routine and potentially error prone. RESULTS: Detectability index increased with signal size for all participants and was very consistent for 6 mm sized target while showing higher variability for 8 and 10 mm sized target. There was one order of magnitude between the lowest and the largest uncertainty estimation. CONCLUSIONS: This intercomparison helped define the state of the art of model observer performance computation and with thirteen participants, reflects openness and trust within the medical imaging community. The performance of a CHO with explicitly defined channels and a relatively large number of test images was consistently estimated by all participants. In contrast, the paper demonstrates that there is no agreement on estimating the variance of detectability in the training and testing setting.

Objective comparison of high-contrast spatial resolution and low-contrast detectability for various clinical protocols on multiple CT scanners.

PURPOSE: We sought to compare objectively computed tomography (CT) scanner performance for three clinically relevant protocols using a task-based image quality assessment method in order to assess the potential for radiation dose reduction. METHODS: Four CT scanners released between 2003 and 2007 by different manufacturers were compared with four CT scanners released between 2012 and 2014 by the same manufacturers using ideal linear model observers (MO): prewhitening (PW) MO and channelized Hotelling (CHO) MO with Laguerre-Gauss channels for high-contrast spatial resolution and low-contrast detectability (LCD) performance, respectively. High-contrast spatial resolution was assessed using a custom-made phantom that enabled the computation of the target transfer function (TTF) and noise power spectrum (NPS). Low-contrast detectability was assessed using a commercially available anthropomorphic abdominal phantom providing equivalent diameters of 24, 29.6, and 34.6 cm. Three protocols were reviewed: a head (trauma) and an abdominal (urinary stones) protocol were applied to assess high-contrast spatial resolution performance; and another abdominal (focal liver lesions) protocol was applied for LCD. The liver protocol was tested using fixed and modulated tube currents. The PW MO was proposed for assessing high-contrast detectability performance of the various CT scanners. RESULTS: Compared with older generation CT scanners, three newer systems displayed significant improvements in high-contrast detectability over that of their predecessors. A fourth, newer system had lower performance. The CHO MO was appropriate for assessing LCD performance and revealed that an excellent level of image quality could be obtained with newer scanners at significantly lower dose levels. CONCLUSIONS: This study shows that MO can objectively benchmark CT scanners using a task-based image quality method, thus helping to estimate the potential for further dose reductions offered by the latest systems. Such an approach may be useful for adequately and quantitatively comparing clinically relevant image quality among various scanners.

Assessment of low contrast detection in CT using model observers: Developing a clinically-relevant tool for characterising adaptive statistical and model-based iterative reconstruction.

PURPOSE: This study aims to assess CT image quality in a way that would meet specific requirements of clinical practice. Physics metrics like Fourier transform derived metrics were traditionally employed for that. However, assessment methods through a detection task have also developed quite extensively lately, and we chose here to rely on this modality for image quality assessment. Our goal was to develop a tool adapted for a fast and reliable CT image quality assessment in order to pave the way for new CT benchmarking techniques in a clinical context. Additionally, we also used this method to estimate the benefits brought by some IR algorithms. MATERIALS AND METHODS: A modified QRM chest phantom containing spheres of 5 and 8mm at contrast levels of 10 and 20HU at 120kVp was used. Images of the phantom were acquired at CTDIvol of 0.8, 3.6, 8.2 and 14.5mGy, before being reconstructed using FBP, ASIR 40 and MBIR on a GE HD 750 CT scanner. They were then assessed by eight human observers undergoing a 4-AFC test. After that, these data were compared with the results obtained from two different model observers (NPWE and CHO with DDoG channels). The study investigated the effects of the acquisition conditions as well as reconstruction methods. RESULTS: NPWE and CHO models both gave coherent results and approximated human observer results well. Moreover, the reconstruction technique used to retrieve the images had a clear impact on the PC values. Both models suggest that switching from FBP to ASIR 40 and particularly to MBIR produces an increase of the low contrast detection, provided a minimum level of exposure is reached. CONCLUSION: Our work shows that both CHO with DDoG channels and NPWE models both approximate the trend of humans performing a detection task. Both models also suggest that the use of MBIR goes along with an increase of the PCs, indicating that further dose reduction is still possible when using those techniques. Eventually, the CHO model associated to the protocol we described in this study happened to be an efficient way to assess CT images in a clinical environment. In the future, this simple method could represent a sound basis to benchmark clinical practice and CT devices.

Comparison of low-contrast detectability between two CT reconstruction algorithms using voxel-based 3D printed textured phantoms.

PURPOSE: To use novel voxel-based 3D printed textured phantoms in order to compare low-contrast detectability between two reconstruction algorithms, FBP (filtered-backprojection) and SAFIRE (sinogram affirmed iterative reconstruction) and determine what impact background texture (i.e., anatomical noise) has on estimating the dose reduction potential of SAFIRE. METHODS: Liver volumes were segmented from 23 abdominal CT cases. The volumes were characterized in terms of texture features from gray-level co-occurrence and run-length matrices. Using a 3D clustered lumpy background (CLB) model, a fitting technique based on a genetic optimization algorithm was used to find CLB textures that were reflective of the liver textures, accounting for CT system factors of spatial blurring and noise. With the modeled background texture as a guide, four cylindrical phantoms (Textures A-C and uniform, 165 mm in diameter, and 30 mm height) were designed, each containing 20 low-contrast spherical signals (6 mm diameter at nominal contrast levels of ∼3.2, 5.2, 7.2, 10, and 14 HU with four repeats per signal). The phantoms were voxelized and input into a commercial multimaterial 3D printer (Object Connex 350), with custom software for voxel-based printing (using principles of digital dithering). Images of the textured phantoms and a corresponding uniform phantom were acquired at six radiation dose levels (SOMATOM Flash, Siemens Healthcare) and observer model detection performance (detectability index of a multislice channelized Hotelling observer) was estimated for each condition (5 contrasts × 6 doses × 2 reconstructions × 4 backgrounds = 240 total conditions). A multivariate generalized regression analysis was performed (linear terms, no interactions, random error term, log link function) to assess whether dose, reconstruction algorithm, signal contrast, and background type have statistically significant effects on detectability. Also, fitted curves of detectability (averaged across contrast levels) as a function of dose were constructed for each reconstruction algorithm and background texture. FBP and SAFIRE were compared for each background type to determine the improvement in detectability at a given dose, and the reduced dose at which SAFIRE had equivalent performance compared to FBP at 100% dose. RESULTS: Detectability increased with increasing radiation dose (P = 2.7 × 10-59) and contrast level (P = 2.2 × 10-86) and was higher in the uniform phantom compared to the textured phantoms (P = 6.9 × 10-51). Overall, SAFIRE had higher d' compared to FBP (P = 0.02). The estimated dose reduction potential of SAFIRE was found to be 8%, 10%, 27%, and 8% for Texture-A, Texture-B, Texture-C and uniform phantoms. CONCLUSIONS: In all background types, detectability was higher with SAFIRE compared to FBP. However, the relative improvement observed from SAFIRE was highly dependent on the complexity of the background texture. Iterative algorithms such as SAFIRE should be assessed in the most realistic context possible.

PATIENT EXPOSURE OPTIMISATION THROUGH TASK-BASED ASSESSMENT OF A NEW MODEL-BASED ITERATIVE RECONSTRUCTION TECHNIQUE.

The goal of the present work was to report and investigate the performances of a new iterative reconstruction algorithm, using a model observer. For that, a dedicated low-contrast phantom containing different targets was scanned at four volume computed tomography dose index (CTDIvol) levels on a Siemens SOMATOM Force computed tomography (CT). The acquired images were reconstructed using the ADMIRE algorithm and were then assessed by three human observers who performed alternative forced choice experiments. Next, a channelised hotelling observer model was applied on the same set of images. The comparison between the two was performed using the percentage correct as a figure of merit. The results indicated a strong agreement between human and model observer as well as an improvement in the low-contrast detection when switching from an ADMIRE strength of 1-3. Good results were also observed even in situations where the target was hard to detect, suggesting that patient dose could be further reduced and optimised.

BENCHMARKING OF CT FOR PATIENT EXPOSURE OPTIMISATION.

Patient dose optimisation in computed tomography (CT) should be done using clinically relevant tasks when dealing with image quality assessments. In the present work, low-contrast detectability for an average patient morphology was assessed on 56 CT units, using a model observer applied on images acquired with two specific protocols of an anthropomorphic phantom containing spheres. Images were assessed using the channelised Hotelling observer (CHO) with dense difference of Gaussian channels. The results were computed by performing receiver operating characteristics analysis (ROC) and using the area under the ROC curve (AUC) as a figure of merit. The results showed a small disparity at a volume computed tomography dose index (CTDIvol) of 15 mGy depending on the CT units for the chosen image quality criterion. For 8-mm targets, AUCs were 0.999 ± 0.018 at 20 Hounsfield units (HU) and 0.927 ± 0.054 at 10 HU. For 5-mm targets, AUCs were 0.947 ± 0.059 and 0.702 ± 0.068 at 20 and 10 HU, respectively. The robustness of the CHO opens the way for CT protocol benchmarking and optimisation processes.

OBJECTIVE TASK-BASED ASSESSMENT OF LOW-CONTRAST DETECTABILITY IN ITERATIVE RECONSTRUCTION.

Evaluating image quality by using receiver operating characteristic studies is time consuming and difficult to implement. This work assesses a new iterative algorithm using a channelised Hotelling observer (CHO). For this purpose, an anthropomorphic abdomen phantom with spheres of various sizes and contrasts was scanned at 3 volume computed tomography dose index (CTDIvol) levels on a GE Revolution CT. Images were reconstructed using the iterative reconstruction method adaptive statistical iterative reconstruction-V (ASIR-V) at ASIR-V 0, 50 and 70 % and assessed by applying a CHO with dense difference of Gaussian and internal noise. Both CHO and human observers (HO) were compared based on a four-alternative forced-choice experiment, using the percentage correct as a figure of merit. The results showed accordance between CHO and HO. Moreover, an improvement in the low-contrast detection was observed when switching from ASIR-V 0 to 50 %. The results underpin the finding that ASIR-V allows dose reduction.

Anthropomorphic model observer performance in three-dimensional detection task for low-contrast computed tomography.

X-ray medical imaging is increasingly becoming three-dimensional (3-D). The dose to the population and its management are of special concern in computed tomography (CT). Task-based methods with model observers to assess the dose-image quality trade-off are promising tools, but they still need to be validated for real volumetric images. The purpose of the present work is to evaluate anthropomorphic model observers in 3-D detection tasks for low-contrast CT images. We scanned a low-contrast phantom containing four types of signals at three dose levels and used two reconstruction algorithms. We implemented a multislice model observer based on the channelized Hotelling observer (msCHO) with anthropomorphic channels and investigated different internal noise methods. We found a good correlation for all tested model observers. These results suggest that the msCHO can be used as a relevant task-based method to evaluate low-contrast detection for CT and optimize scan protocols to lower dose in an efficient way.

Objective assessment of low contrast detectability in computed tomography with Channelized Hotelling Observer.

PURPOSE: Iterative algorithms introduce new challenges in the field of image quality assessment. The purpose of this study is to use a mathematical model to evaluate objectively the low contrast detectability in CT. MATERIALS AND METHODS: A QRM 401 phantom containing 5 and 8 mm diameter spheres with a contrast level of 10 and 20 HU was used. The images were acquired at 120 kV with CTDIvol equal to 5, 10, 15, 20 mGy and reconstructed using the filtered back-projection (FBP), adaptive statistical iterative reconstruction 50% (ASIR 50%) and model-based iterative reconstruction (MBIR) algorithms. The model observer used is the Channelized Hotelling Observer (CHO). The channels are dense difference of Gaussian channels (D-DOG). The CHO performances were compared to the outcomes of six human observers having performed four alternative forced choice (4-AFC) tests. RESULTS: For the same CTDIvol level and according to CHO model, the MBIR algorithm gives the higher detectability index. The outcomes of human observers and results of CHO are highly correlated whatever the dose levels, the signals considered and the algorithms used when some noise is added to the CHO model. The Pearson coefficient between the human observers and the CHO is 0.93 for FBP and 0.98 for MBIR. CONCLUSION: The human observers' performances can be predicted by the CHO model. This opens the way for proposing, in parallel to the standard dose report, the level of low contrast detectability expected. The introduction of iterative reconstruction requires such an approach to ensure that dose reduction does not impair diagnostics.