A statistical methodology for mammographic density detection.

A statistical methodology is presented based on a chi-square probability analysis that allows the automated discrimination of radiolucent tissue (fat) from radiographic densities (fibroglandular tissue) in digitized mammograms. The method is based on earlier work developed at this facility that shows mammograms may be considered as evolving from a linear filtering operation where a random input field is passed through a 1/f filtering process. The filtering process is reversible which allows the solution of the input field with knowledge obtained from the raw image (the output). The input field solution is analogous to a prewhitening technique or deconvolution. This field contains all the information of the raw image in a much simplified format that can be approximated and analyzed with parametric methods. In the work presented here evidence indicates that there are two random events occurring in the input field with differing variances: (1) one relating to fat tissue with the smaller variance, and (2) the second relating to all other tissue with the larger variance. A statistical comparison of the variances is made by scanning the image with a small search window. A relaxation method allows for making a reliable estimate of the smaller variance which is considered as the global reference. If a local variance deviates significantly from the reference variance, based on chi-square analysis, it is labeled as nonfat; otherwise it is labeled as fat. This statistical test procedure results in a region by region continuous labeling of fat and nonfat tissue across the image. In the work presented here, the emphasis is on the methodology development with supporting preliminary results that are very encouraging. It is widely accepted that mammographic density is a breast cancer risk factor. An important application of this work is to incorporate density-based risk analysis into the ongoing statistical-based detection work developed at this facility. Additional applications include risk analysis dependent on either percentages or total amounts of fat or dense tissue. This work may be considered as the initial step in introducing many of the known breast cancer risk factors into the actual image data analysis.

On the statistical nature of mammograms.

We show that digitized mammograms can be considered as evolving from a simple process. A given image results from passing a random input field through a linear filtering operation, where the filter transfer function has a self-similar characteristic. By estimating the functional form of the filter and solving the corresponding filtering equation, the analysis shows that the input field gray value distribution and spectral content can be approximated with parametric methods. The work gives a simple explanation for the variegated image appearance and multimodal character of the gray value distribution common to mammograms. Using the image analysis as a guide, a simulated mammogram is generated that has many statistical characteristics of real mammograms. Additional benefits may follow from understanding the functional form of the filter in conjunction with the input field characteristics that include the approximate parametric description of mammograms, showing the distinction between homogeneously dense and nondense images, and the development of mass analysis methods.

Feature extraction for MRI segmentation.

Magnetic resonance images (MRIs) of the brain are segmented to measure the efficacy of treatment strategies for brain tumors. To date, no reproducible technique for measuring tumor size is available to the clinician, which hampers progress of the search for good treatment protocols. Many segmentation techniques have been proposed, but the representation (features) of the MRI data has received little attention. A genetic algorithm (GA) search was used to discover a feature set from multi-spectral MRI data. Segmentations were performed using the fuzzy c-means (FCM) clustering technique. Seventeen MRI data sets from five patients were evaluated. The GA feature set produces a more accurate segmentation. The GA fitness function that achieves the best results is the Wilks's lambda statistic when applied to FCM clusters. Compared to linear discriminant analysis, which requires class labels, the same or better accuracy is obtained by the features constructed from a GA search without class labels, allowing fully operator independent segmentation. The GA approach therefore provides a better starting point for the measurement of the response of a brain tumor to treatment.

Review and evaluation of MRI nonuniformity corrections for brain tumor response measurements.

Current MRI nonuniformity correction techniques are reviewed and investigated. Many approaches are used to remedy this artifact, but it is not clear which method is the most appropriate in a given situation, as the applications have been with different MRI coils and different clinical applications. In this work four widely used nonuniformity correction techniques are investigated in order to assess the effect on tumor response measurements (change in tumor volume over time): a phantom correction method, an image smoothing technique, homomorphic filtering, and surface fitting approach. Six brain tumor cases with baseline and follow-up MRIs after treatment with varying degrees of difficulty of segmentation were analyzed without and with each of the nonuniformity corrections. Different methods give significantly different correction images, indicating that rf nonuniformity correction is not yet well understood. No improvement in tumor segmentation or in tumor growth/shrinkage assessment was achieved using any of the evaluated corrections.

Automatic tumor segmentation using knowledge-based techniques.

A system that automatically segments and labels glioblastoma-multiforme tumors in magnetic resonance images (MRI's) of the human brain is presented. The MRI's consist of T1-weighted, proton density, and T2-weighted feature images and are processed by a system which integrates knowledge-based (KB) techniques with multispectral analysis. Initial segmentation is performed by an unsupervised clustering algorithm. The segmented image, along with cluster centers for each class are provided to a rule-based expert system which extracts the intracranial region. Multispectral histogram analysis separates suspected tumor from the rest of the intracranial region, with region analysis used in performing the final tumor labeling. This system has been trained on three volume data sets and tested on thirteen unseen volume data sets acquired from a single MRI system. The KB tumor segmentation was compared with supervised, radiologist-labeled "ground truth" tumor volumes and supervised k-nearest neighbors tumor segmentations. The results of this system generally correspond well to ground truth, both on a per slice basis and more importantly in tracking total tumor volume during treatment over time.

MRI measurement of brain tumor response: comparison of visual metric and automatic segmentation.

An automatic magnetic resonance imaging (MRI) multispectral segmentation method and a visual metric are compared for their effectiveness to measure tumor response to therapy. Automatic response measurements are important for multicenter clinical trials. A visual metric such as the product of the largest diameter and the largest perpendicular diameter of the tumor is a standard approach, and is currently used in the Radiation Treatment Oncology Group (RTOG) and the Eastern Cooperative Oncology Group (EGOG) clinical trials. In the standard approach, the tumor response is based on the percentage change in the visual metric and is categorized into cure, partial response, stable disease, or progression. Both visual and automatic methods are applied to six brain tumor cases (gliomas) of varying levels of segmentation difficulty. The analyzed data were serial multispectral MR images, collected using MR contrast enhancement. A fully automatic knowledge guided method (KG) was applied to the MRI multispectral data, while the visual metric was taken from the MRI films using the T1 gadolinium enhanced image, with repeat measurements done by two radiologists and two residents. Tumor measurements from both visual and automatic methods are compared to "ground truth," (GT) i.e., manually segmented tumor. The KG method was found to slightly overestimate tumor volume, but in a consistent manner, and the estimated tumor response compared very well to hand-drawn ground truth with a correlation coefficient of 0.96. In contrast, the visually estimated metric had a large variation between observers, particularly for difficult cases, where the tumor margins are not well delineated. The inter-observer variation for the measurement of the visual metric was only 16%, i.e., observers generally agreed on the lengths of the diameters. However, in 30% of the studied cases no consensus was found for the categorical tumor response measurement, indicating that the categories are very sensitive to variations in the diameter measurements. Moreover, the method failed to correctly identify the response in half of the cases. The data demonstrate that automatic 3D methods are clearly necessary for objective and clinically meaningful assessment of tumor volume in single or multicenter clinical trials.

Monitoring brain tumor response to therapy using MRI segmentation.

The performance evaluation of a semi-supervised fuzzy c-means (SFCM) clustering method for monitoring brain tumor volume changes during the course of routine clinical radiation-therapeutic and chemo-therapeutic regimens is presented. The tumor volume determined using the SFCM method was compared with the volume estimates obtained using three other methods: (a) a k nearest neighbor (kNN) classifier, b) a grey level thresholding and seed growing (ISG-SG) method and c) a manual pixel labeling (GT) method for ground truth estimation. The SFCM and kNN methods are applied to the multispectral, contrast enhanced T1, proton density, and T2 weighted, magnetic resonance images (MRI) whereas the ISG-SG and GT methods are applied only to the contrast enhanced T1 weighted image. Estimations of tumor volume were made on eight patient cases with follow-up MRI scans performed over a 32 week interval during treatment. The tumor cases studied include one meningioma, two brain metastases and five gliomas. Comparisons with manually labeled ground truth estimations showed that there is a limited agreement between the segmentation methods for absolute tumor volume measurements when using images of patients after treatment. The average intraobserver reproducibility for the SFCM, kNN and ISG-SG methods was found to be 5.8%, 6.6% and 8.9%, respectively. The average of the interobserver reproducibility of these methods was found to be 5.5%, 6.5% and 11.4%, respectively. For the measurement of relative change of tumor volume as required for the response assessment, the multi-spectral methods kNN and SFCM are therefore preferred over the seedgrowing method.

Normal brain volume measurements using multispectral MRI segmentation.

The performance of a supervised k-nearest neighbor (kNN) classifier and a semisupervised fuzzy c-means (SFCM) clustering segmentation method are evaluated for reproducible measurement of the volumes of normal brain tissues and cerebrospinal fluid. The stability of the two segmentation methods is evaluated for (a) operator selection of training data, (b) reproducibility during repeat imaging sessions to determine any variations in the sensor performance over time, (c) variations in the measured volumes between different subjects, and (d) variability with different imaging parameters. The variations were found to be dependent on the type of measured tissue and the operator performing the segmentations. The variability during repeat imaging sessions for the SFCM method was < 3%. The absolute volumes of the brain matter and cerebrospinal fluid between subjects varied quite large, ranging from 9% to 13%. The intraobserver and interobserver reproducibility for SFCM were < 4% for the soft tissues and 6% for cerebrospinal fluid. The corresponding results for the kNN segmentation method were higher compared to the SFCM method.

Unsupervised measurement of brain tumor volume on MR images.

We examined unsupervised methods of segmentation of MR images of the brain for measuring tumor volume in response to treatment. Two clustering methods were used: fuzzy c-means and a nonfuzzy clustering algorithm. Results were compared with volume segmentations by two supervised methods, k-nearest neighbors and region growing, and all results were compared with manual labelings. Results of individual segmentations are presented as well as comparisons on the application of the different methods with 10 data sets of patients with brain tumors. Unsupervised segmentation is preferred for measuring tumor volumes in response to treatment, as it eliminates operator dependency and may be adequate for delineation of the target volume in radiation therapy. Some obstacles need to be overcome, in particular regarding the detection of anatomically relevant tissue classes. This study shows that these improvements are possible.

Automatic magnetic resonance tissue characterization for three-dimensional magnetic resonance imaging of the brain.

Computer-assisted diagnostic systems enhance the information available from magnetic resonance imaging. Segmentations are the basis on which three-dimensional volume renderings are made. The application of a raw data-based, operator-independent (automatic), magnetic resonance segmentation technique for tissue differentiation is demonstrated. Segmentation images of vasogenic edema with gross and histopathological correlation are presented for demonstration of the technique. A pixel was classified into a tissue class based on a feature vector using unsupervised fuzzy clustering techniques as the pattern recognition method. Correlation of fuzzy segmentations and gross and histopathology were successfully performed. Based on the results of neuropathological correlation, the application of fuzzy magnetic resonance image segmentation to a patient with a brain tumor and extensive edema represents a viable technique for automatically displaying clinically important tissue differentiation. With this pattern recognition technique, it is possible to generate automatic segmentation images that display diagnostically relevant neuroanatomical and neuropathological tissue contrast information from raw magnetic resonance data for use in three-dimensional volume reconstructions.

MRI segmentation: methods and applications.

The current literature on MRI segmentation methods is reviewed. Particular emphasis is placed on the relative merits of single image versus multispectral segmentation, and supervised versus unsupervised segmentation methods. Image pre-processing and registration are discussed, as well as methods of validation. The application of MRI segmentation for tumor volume measurements during the course of therapy is presented here as an example, illustrating problems associated with inter- and intra-observer variations inherent to supervised methods.

Application of fuzzy c-means segmentation technique for tissue differentiation in MR images of a hemorrhagic glioblastoma multiforme.

The application of a raw data-based, operator-independent MR segmentation technique to differentiate boundaries of tumor from edema or hemorrhage is demonstrated. A case of a glioblastoma multiforme with gross and histopathologic correlation is presented. The MR image data set was segmented into tissue classes based on three different MR weighted image parameters (T1-, proton density-, and T2-weighted) using unsupervised fuzzy c-means (FCM) clustering algorithm technique for pattern recognition. A radiological examination of the MR images and correlation with fuzzy clustering segmentations was performed. Results were confirmed by gross and histopathology which, to the best of our knowledge, reports the first application of this demanding approach. Based on the results of neuropathologic correlation, the application of FCM MR image segmentation to several MR images of a glioblastoma multiforme represents a viable technique for displaying diagnostically relevant tissue contrast information used in 3D volume reconstruction. With this technique, it is possible to generate segmentation images that display clinically important neuroanatomic and neuropathologic tissue contrast information from raw MR image data.

Comparison of supervised MRI segmentation methods for tumor volume determination during therapy.

Two different multispectral pattern recognition methods are used to segment magnetic resonance images (MRI) of the brain for quantitative estimation of tumor volume and volume changes with therapy. A supervised k-nearest neighbor (kNN) rule and a semi-supervised fuzzy c-means (SFCM) method are used to segment MRI slice data. Tumor volumes as determined by the kNN and SFCM segmentation methods are compared with two reference methods, based on image grey scale, as a basis for an estimation of ground truth, namely: (a) a commonly used seed growing method that is applied to the contrast enhanced T1-weighted image, and (b) a manual segmentation method using a custom-designed graphical user interface applied to the same raw image (T1-weighted) dataset. Emphasis is placed on measurement of intra and inter observer reproducibility using the proposed methods. Intra- and interobserver variation for the kNN method was 9% and 5%, respectively. The results for the SFCM method was a little better at 6% and 4%, respectively. For the seed growing method, the intra-observer variation was 6% and the interobserver variation was 17%, significantly larger when compared with the multispectral methods. The absolute tumor volume determined by the multispectral segmentation methods was consistently smaller than that observed for the reference methods. The results of this study are found to be very patient case-dependent. The results for SFCM suggest that it should be useful for relative measurements of tumor volume during therapy, but further studies are required. This work demonstrates the need for minimally supervised or unsupervised methods for tumor volume measurements.

Enhanced detection of normal retinal nerve-fiber striations using a charge-coupled device and digital filtering.

We used a 1024 x 1024 pixel, 15-microns, 16-bit-encoding, multi-pin-phase charge-coupled device (CCD) to obtain images of the normal human retinal nerve fiber layer. This device, which operates at room temperature, offers significantly better signal-to-noise ratio, linearity, and dynamic range than do photographic film, video imaging techniques, or commercially available CCDs. We demonstrate the use of a nonlinear digital filter, together with filter windows, that enhances fine detail of NFL striations, while suppressing noise, in limited areas of the CCD images. High-sensitivity imaging of this type, together with appropriate digital processing, may prove useful in diagnosing and following nerve-fiber-layer damage due to glaucoma.

MRI: stability of three supervised segmentation techniques.

Supervised segmentation methods from three families of pattern recognition techniques were used to segment multispectral MRI data. Studied were the maximum likelihood method (MLM), k-nearest neighbors (k-NN), and a back-propagation artificial neural net (ANN). Performance was measured in terms of execution speed, and stability for the selection of training data, namely, region of interest (ROI) selection, and interslice and interpatient classifications. MLM proved to have the smallest execution times, but demonstrated the least stability. k-NN showed the best stability for training data selection. To evaluate the segmentation techniques, multispectral images were used of normal volunteers and patients with gliomas, the latter with and without MR contrast material. All measures applied indicated that k-NN provides the best results.

A comparison of neural network and fuzzy clustering techniques in segmenting magnetic resonance images of the brain.

Magnetic resonance (MR) brain section images are segmented and then synthetically colored to give visual representations of the original data with three approaches: the literal and approximate fuzzy c-means unsupervised clustering algorithms, and a supervised computational neural network. Initial clinical results are presented on normal volunteers and selected patients with brain tumors surrounded by edema. Supervised and unsupervised segmentation techniques provide broadly similar results. Unsupervised fuzzy algorithms were visually observed to show better segmentation when compared with raw image data for volunteer studies. For a more complex segmentation problem with tumor/edema or cerebrospinal fluid boundary, where the tissues have similar MR relaxation behavior, inconsistency in rating among experts was observed, with fuzz-c-means approaches being slightly preferred over feedforward cascade correlation results. Various facets of both approaches, such as supervised versus unsupervised learning, time complexity, and utility for the diagnostic process, are compared.