Manual and semiautomatic segmentation of bone sarcomas on MRI have high similarity.

The aims of this study were to evaluate the intra- and interobserver reproducibility of manual segmentation of bone sarcomas in magnetic resonance imaging (MRI) studies and to compare manual and semiautomatic segmentation methods. This retrospective study included twelve osteosarcoma and eight Ewing sarcoma MRI studies performed prior to any therapeutic intervention. All cases were histopathologically confirmed. Three radiologists used 3D-Slicer software to perform manual segmentation of bone sarcomas in a blinded and independent manner. One radiologist segmented manually and also performed semiautomatic segmentation with the GrowCut tool. Segmentation exercises were timed for comparison. The dice similarity coefficient (DSC) and Hausdorff distance (HD) were used to evaluate similarity between the segmentation results and further statistical analyses were performed to compare DSC, HD, and volumetric results. Manual segmentation was reproducible with intraobserver DSC varying from 0.83 to 0.97 and HD from 3.37 to 28.73 mm. Interobserver DSC of manual segmentation showed variation from 0.73 to 0.97 and HD from 3.93 to 33.40 mm. Semiautomatic segmentation compared to manual segmentation resulted in DSCs of 0.71-0.96 and HDs of 5.38-31.54 mm. Semiautomatic segmentation required significantly less time compared to manual segmentation (P value ≤0.05). Among all situations compared, tumor volumetry did not show significant statistical differences (P value >0.05). We found excellent intra- and interobserver agreement for manual segmentation of osteosarcoma and Ewing sarcoma. There was high similarity between manual and semiautomatic segmentation, with a significant reduction of segmentation time using the semiautomatic method.

Manual and semiautomatic segmentation of bone sarcomas on MRI have high similarity

The aims of this study were to evaluate the intra- and interobserver reproducibility of manual segmentation of bone sarcomas in magnetic resonance imaging (MRI) studies and to compare manual and semiautomatic segmentation methods. This retrospective study included twelve osteosarcoma and eight Ewing sarcoma MRI studies performed prior to any therapeutic intervention. All cases were histopathologically confirmed. Three radiologists used 3D-Slicer software to perform manual segmentation of bone sarcomas in a blinded and independent manner. One radiologist segmented manually and also performed semiautomatic segmentation with the GrowCut tool. Segmentation exercises were timed for comparison. The dice similarity coefficient (DSC) and Hausdorff distance (HD) were used to evaluate similarity between the segmentation results and further statistical analyses were performed to compare DSC, HD, and volumetric results. Manual segmentation was reproducible with intraobserver DSC varying from 0.83 to 0.97 and HD from 3.37 to 28.73 mm. Interobserver DSC of manual segmentation showed variation from 0.73 to 0.97 and HD from 3.93 to 33.40 mm. Semiautomatic segmentation compared to manual segmentation resulted in DSCs of 0.71−0.96 and HDs of 5.38−31.54 mm. Semiautomatic segmentation required significantly less time compared to manual segmentation (P value ≤0.05). Among all situations compared, tumor volumetry did not show significant statistical differences (P value >0.05). We found excellent intra- and interobserver agreement for manual segmentation of osteosarcoma and Ewing sarcoma. There was high similarity between manual and semiautomatic segmentation, with a significant reduction of segmentation time using the semiautomatic method.

Classification of vertebral compression fractures in magnetic resonance images using spectral and fractal analysis.

Fractures with partial collapse of vertebral bodies are generically referred to as "vertebral compression fractures" or VCFs. VCFs can have different etiologies comprising trauma, bone failure related to osteoporosis, or metastatic cancer affecting bone. VCFs related to osteoporosis (benign fractures) and to cancer (malignant fractures) are commonly found in the elderly population. In the clinical setting, the differentiation between benign and malignant fractures is complex and difficult. This paper presents a study aimed at developing a system for computer-aided diagnosis to help in the differentiation between malignant and benign VCFs in magnetic resonance imaging (MRI). We used T1-weighted MRI of the lumbar spine in the sagittal plane. Images from 47 consecutive patients (31 women, 16 men, mean age 63 years) were studied, including 19 malignant fractures and 54 benign fractures. Spectral and fractal features were extracted from manually segmented images of 73 vertebral bodies with VCFs. The classification of malignant vs. benign VCFs was performed using the k-nearest neighbor classifier with the Euclidean distance. Results obtained show that combinations of features derived from Fourier and wavelet transforms, together with the fractal dimension, were able to obtain correct classification rate up to 94.7% with area under the receiver operating characteristic curve up to 0.95.

Estimation of the breast skin-line in mammograms using multidirectional Gabor filters.

Segmentation of the breast region is a fundamental step in any system for computerized analysis of mammograms. In this work, we propose a novel procedure for the estimation of the breast skin-line based upon multidirectional Gabor filtering. The method includes an adaptive values-of-interest (VOI) transformation, extraction of the skin-air ribbon by Otsu's thresholding method and the Euclidean distance transform, Gabor filtering with 18 real kernels, and a step for suppression of false edge points using the magnitude and phase responses of the filters. On a test set of 361 images from different acquisition modalities (screen-film and full-field digital mammograms), the average Hausdorff and polyline distances obtained were 2.85 mm and 0.84 mm, respectively, with reference to the ground-truth boundaries provided by an expert radiologist. When compared with the results obtained by other state-of-the-art methods on the same set of images and with respect to the same ground-truth boundaries, our method mostly outperformed the other approaches. The results demonstrate the effectiveness and robustness of the proposed algorithm.

Classification of color images of dermatological ulcers.

We present color image processing methods for the analysis of images of dermatological lesions. The focus of the present work is on the application of feature extraction and selection methods for classification and analysis of the tissue composition of skin lesions or ulcers, in terms of granulation (red), fibrin (yellow), necrotic (black), callous (white), and mixed tissue composition. The images were analyzed and classified by an expert dermatologist into the classes mentioned above. Indexing of the images was performed based on statistical texture features derived from cooccurrence matrices of the RGB (Red, Green, and Blue), HSI (Hue, Saturation, and Intensity), L*a*b*, and L*u*v* color components. Feature selection methods were applied using the Wrapper algorithm with different classifiers. The performance of classification was measured in terms of the percentage of correctly classified images and the area under the receiver operating characteristic curve, with values of up to 73.8% and 0.82, respectively.

Radon-domain detection of the nipple and the pectoral muscle in mammograms.

In this paper, methods are presented for automatic detection of the nipple and the pectoral muscle edge in mammograms via image processing in the Radon domain. Radon-domain information was used for the detection of straight-line candidates with high gradient. The longest straight-line candidate was used to identify the pectoral muscle edge. The nipple was detected as the convergence point of breast tissue components, indicated by the largest response in the Radon domain. Percentages of false-positive (FP) and false-negative (FN) areas were determined by comparing the areas of the pectoral muscle regions delimited manually by a radiologist and by the proposed method applied to 540 mediolateral-oblique (MLO) mammographic images. The average FP and FN were 8.99% and 9.13%, respectively. In the detection of the nipple, an average error of 7.4 mm was obtained with reference to the nipple as identified by a radiologist on 1,080 mammographic images (540 MLO and 540 craniocaudal views).

Classification of breast masses in mammograms using genetic programming and feature selection.

Mammography is a widely used screening tool and is the gold standard for the early detection of breast cancer. The classification of breast masses into the benign and malignant categories is an important problem in the area of computer-aided diagnosis of breast cancer. A small dataset of 57 breast mass images, each with 22 features computed, was used in this investigation; the same dataset has been previously used in other studies. The extracted features relate to edge-sharpness, shape, and texture. The novelty of this paper is the adaptation and application of the classification technique called genetic programming (GP), which possesses feature selection implicitly. To refine the pool of features available to the GP classifier, we used feature-selection methods, including the introduction of three statistical measures--Student's t test, Kolmogorov-Smirnov test, and Kullback-Leibler divergence. Both the training and test accuracies obtained were high: above 99.5% for training and typically above 98% for test experiments. A leave-one-out experiment showed 97.3% success in the classification of benign masses and 95.0% success in the classification of malignant tumors. A shape feature known as fractional concavity was found to be the most important among those tested, since it was automatically selected by the GP classifier in almost every experiment.

Estimation of the tissue composition of the tumour mass in neuroblastoma using segmented CT images.

Neuroblastoma is the most common extra-cranial, solid, malignant tumour in children. Advances in radiology have made possible the detection and staging of the disease. Nevertheless, there is no method available at present that can go beyond detection and qualitative analysis, towards quantitative assessment of the tissue composition of the primary tumour mass in neuroblastoma. Such quantitative analysis could provide important information and serve as a decision-support tool to the radiologist and the oncologist, result in better treatment and follow-up and even lead to the avoidance of delayed surgery. The problem investigated was the improvement of the analysis of the primary tumour mass, in patients with neuroblastoma, using X-ray computed tomography (CT) images. A methodology was proposed for the estimation of the tissue content of the mass: it comprised a Gaussian mixture model for estimation, from segmented CT images, of the tissue composition of the primary tumour. To demonstrate the potential of the method, the results are presented of its application to ten CT examinations of four patients. The method provides quantitative information, and it was observed that the tumour in one of the patients reduced from 523 cm3 to 81 cm3 in volume, with an increase in calcification from about 20% to about 88% of the tumour volume, in response to chemotherapy over a period of five months. Results indicate that the proposed technique may be of considerable value in assessing the response to therapy of patients with neuroblastoma.

Segmentation of the fibro-glandular disc in mammograms using Gaussian mixture modelling.

The paper presents a technique for the segmentation of the fibro-glandular disc in mammograms based upon a statistical model of breast density. The density function of the model was represented by a mixture of up to four weighted Gaussians, each one corresponding to a specific density class in the breast. The parameters of the model and the number of tissue classes in the breast were determined using the expectation-maximisation algorithm and the minimum description length method. Grey-level statistics of the pectoral muscle were used to determine the tissue categories that are likely to represent the fibro-glandular disc. The method was applied to 84 medio-lateral oblique mammograms from the Mini-MIAS database. The results of the segmented fibro-glandular disc were assessed by a radiologist using the original and the segmented images, with reference to a ranking table categorising the results of segmentation as: 1: excellent; 2: good; 3: average; 4: poor; and 5: complete failure. Of the 84 cases analysed, 64.3% were rated as excellent, 16.7% were rated as good, 10.7% were rated as average, and 4.7% were rated as poor; only 3.6% of the cases were rated as a complete failure with regard to segmentation of the fibro-glandular disc.

Identification of the breast boundary in mammograms using active contour models.

A method for the identification of the breast boundary in mammograms is presented. The method can be used in the preprocessing stage of a system for computer-aided diagnosis (CAD) of breast cancer and also in the reduction of image file size in picture archiving and communication system applications. The method started with modification of the contrast of the original image. A binarisation procedure was then applied to the image, and the chain-code algorithm was used to find an approximate breast contour. Finally, the identification of the true breast boundary was performed by using the approximate contour as the input to an active contour model algorithm specially tailored for this purpose. After demarcation of the breast boundary, all artifacts outside the breast region were eliminated. The method was applied to 84 medio-lateral oblique mammograms from the Mini-MIAS database. Evaluation of the detected breast boundary was performed based upon the percentage of false-positive and false-negative pixels determined by a quantitative comparison between the contours identified by a radiologist and those identified by the proposed method. The average false positive and false negative rates were 0.41% and 0.58%, respectively. The two radiologists who evaluated the results considered the segmentation results to be acceptable for CAD purposes.

Automatic identification of the pectoral muscle in mammograms.

The pectoral muscle represents a predominant density region in most medio-lateral oblique (MLO) views of mammograms; its inclusion can affect the results of intensity-based image processing methods or bias procedures in the detection of breast cancer. Local analysis of the pectoral muscle may be used to identify the presence of abnormal axillary lymph nodes, which may be the only manifestation of occult breast carcinoma. We propose a new method for the identification of the pectoral muscle in MLO mammograms based upon a multiresolution technique using Gabor wavelets. This new method overcomes the limitation of the straight-line representation considered in our initial investigation using the Hough transform. The method starts by convolving a group of Gabor filters, specially designed for enhancing the pectoral muscle edge, with the region of interest containing the pectoral muscle. After computing the magnitude and phase images using a vector-summation procedure, the magnitude value of each pixel is propagated in the direction of the phase. The resulting image is then used to detect the relevant edges. Finally, a post-processing stage is used to find the true pectoral muscle edge. The method was applied to 84 MLO mammograms from the Mini-MIAS (Mammographic Image Analysis Society, London, U.K.) database. Evaluation of the pectoral muscle edge detected in the mammograms was performed based upon the percentage of false-positive (FP) and false-negative (FN) pixels determined by comparison between the numbers of pixels enclosed in the regions delimited by the edges identified by a radiologist and by the proposed method. The average FP and FN rates were, respectively, 0.58% and 5.77%. Furthermore, the results of the Gabor-filter-based method indicated low Hausdorff distances with respect to the hand-drawn pectoral muscle edges, with the mean and standard deviation being 3.84 +/- 1.73 mm over 84 images.

The application of Efron's bootstrap methods in validating feature classification using artificial neural networks for the analysis of mammographic masses.

Efron's bootstrap resampling method is used to analyze the performance of artificial neural networks (ANNs) in the area of feature classification for the analysis of mammographic masses. The purpose of feature classification in mammography is to discover the salient information that can be used to discriminate benign from malignant masses. The performance of ANNs is typically measured in terms of the area under the receiver operating characteristics (ROC) curve (A/sub z/). Performance uncertainty problems and the generalization problems of ANNs are still the critical issues that impede the further application of ANNs in clinical medicine. It is unreasonable and impractical to justify the performance of one ANN being better than another just by its best A/sub z/ value. Efron's bootstrap methods make it possible to quantitatively analyze the performance of ANNs and anticipate its change tendency with relatively high accuracy. Our experimental results show that the probability model of A/sub z/ is close to a normal distribution. The performance of ANNs is more sensitive to the change of topology than that of the size and the composition of the training set. Bootstrap methods can be used to find the optimal epochs and avoid overfitting.

Analysis of asymmetry in mammograms via directional filtering with Gabor wavelets.

This paper presents a procedure for the analysis of left-right (bilateral) asymmetry in mammograms. The procedure is based upon the detection of linear directional components by using a multiresolution representation based upon Gabor wavelets. A particular wavelet scheme with two-dimensional Gabor filters as elementary functions with varying tuning frequency and orientation, specifically designed in order to reduce the redundancy in the wavelet-based representation, is applied to the given image. The filter responses for different scales and orientation are analyzed by using the Karhunen-Loève (KL) transform and Otsu's method of thresholding. The KL transform is applied to select the principal components of the filter responses, preserving only the most relevant directional elements appearing at all scales. The selected principal components, thresholded by using Otsu's method, are used to obtain the magnitude and phase of the directional components of the image. Rose diagrams computed from the phase images and statistical measures computed thereof are used for quantitative and qualitative analysis of the oriented patterns. A total of 80 images from 20 normal cases, 14 asymmetric cases, and six architectural distortion cases from the Mini-MIAS (Mammographic Image Analysis Society, London, U.K.) database were used to evaluate the scheme using the leave-one-out methodology. Average classification accuracy rates of up to 74.4% were achieved.

Detection of breast masses in mammograms by density slicing and texture flow-field analysis.

We propose a method for the detection of masses in mammographic images that employs Gaussian smoothing and sub-sampling operations as preprocessing steps. The mass portions are segmented by establishing intensity links from the central portions of masses into the surrounding areas. We introduce methods for analyzing oriented flow-like textural information in mammograms. Features based on flow orientation in adaptive ribbons of pixels across the margins of masses are proposed to classify the regions detected as true mass regions or false-positives (FPs). The methods yielded a mass versus normal tissue classification accuracy represented as an area (Az) of 0.87 under the receiver operating characteristics (ROCs) curve with a dataset of 56 images including 30 benign disease, 13 malignant disease, and 13 normal cases selected from the mini Mammographic Image Analysis Society database. A sensitivity of 81% was achieved at 2.2 FPs/image. Malignant tumor versus normal tissue classification resulted in a higher Az value of 0.9 under the ROC curve using only the 13 malignant and 13 normal cases with a sensitivity of 85% at 2.45 FPs/image. The mass detection algorithm could detect all the 13 malignant tumors successfully, but achieved a success rate of only 63% (19/30) in detecting the benign masses. The mass regions that were successfully segmented were further classified as benign or malignant disease by computing five texture features based on gray-level co-occurrence matrices (GCMs) and using the features in a logistic regression method. The features were computed using adaptive ribbons of pixels across the boundaries of the masses. Benign versus malignant classification using the GCM-based texture features resulted in Az = 0.79 with 19 benign and 13 malignant cases.

Auditory display of knee-joint vibration signals.

Sounds generated due to rubbing of knee-joint surfaces may lead to a potential tool for noninvasive assessment of articular cartilage degeneration. In the work reported in the present paper, an attempt is made to perform computer-assisted auscultation of knee joints by auditory display (AD) of vibration signals (also known as vibroarthrographic or VAG signals) emitted during active movement of the leg. Two types of AD methods are considered: audification and sonification. In audification, the VAG signals are scaled in time and frequency using a time-frequency distribution to facilitate aural analysis. In sonification, the instantaneous mean frequency and envelope of the VAG signals are derived and used to synthesize sounds that are expected to facilitate more accurate diagnosis than the original signals by improving their aural quality. Auditory classification experiments were performed by two orthopedic surgeons with 37 VAG signals including 19 normal and 18 abnormal cases. Sensitivity values (correct detection of abnormality) of 31%, 44%, and 83%, and overall classification accuracies of 53%, 40%, and 57% were obtained with the direct playback, audification, and sonification methods, respectively. The corresponding d' scores were estimated to be 1.10. -0.36, and 0.55. The high sensitivity of the sonification method indicates that the technique could lead to improved detection of knee-joint abnormalities; however, additional work is required to improve its specificity and achieve better overall performance.

Gradient and texture analysis for the classification of mammographic masses.

Computer-aided classification of benign and malignant masses on mammograms is attempted in this study by computing gradient-based and texture-based features. Features computed based on gray-level co-occurrence matrices (GCMs) are used to evaluate the effectiveness of textural information possessed by mass regions in comparison with the textural information present in mass margins. A method involving polygonal modeling of boundaries is proposed for the extraction of a ribbon of pixels across mass margins. Two gradient-based features are developed to estimate the sharpness of mass boundaries in the ribbons of pixels extracted from their margins. A total of 54 images (28 benign and 26 malignant) containing 39 images from the Mammographic Image Analysis Society (MIAS) database and 15 images from a local database are analyzed. The best benign versus malignant classification of 82.1%, with an area (Az) of 0.85 under the receiver operating characteristics (ROC) curve, was obtained with the images from the MIAS database by using GCM-based texture features computed from mass margins. The classification method used is based on posterior probabilities computed from Mahalanobis distances. The corresponding accuracy using jack-knife classification was observed to be 74.4%, with Az = 0.67. Gradient-based features achieved Az = 0.6 on the MIAS database and Az = 0.76 on the combined database. The corresponding values obtained using jack-knife classification were observed to be 0.52 and 0.73 for the MIAS and combined databases, respectively.

Boundary modelling and shape analysis methods for classification of mammographic masses.

The problem of computer-aided classification of benign and malignant breast masses using shape features is addressed. The aim of the study is to look at the exceptions in shapes of masses such as circumscribed malignant tumours and spiculated benign masses which are difficult to classify correctly using common shape analysis methods. The proposed methods of shape analysis treat the object's boundary in terms of local details. The boundaries of masses analysed using the proposed methods were manually drawn on mammographic images by an expert radiologist (JELD). A boundary segmentation method is used to separate major portions of the boundary and to label them as concave or convex segments. To analyse the shape information localised in each segment, features are computed through an iterative procedure for polygonal modelling of the mass boundaries. Features are based on the concavity fraction of a mass boundary and the degree of narrowness of spicules as characterised by a spiculation index. Two features comprising spiculation index (SI) and fractional concavity (fcc) developed in the present study when used in combination with the global shape feature of compactness resulted in a benign/malignant classification accuracy of 82%, with an area (Az) of 0.79 under the receiver operating characteristics (ROC) curve with a database of the boundaries of 28 benign masses and 26 malignant tumours. SI alone resulted in a classification accuracy of 80% with Az of 0.82. The combination of all the three features achieved 91% accuracy of circumscribed versus spiculated classification of masses based on shape.

Adaptive time-frequency analysis of knee joint vibroarthrographic signals for noninvasive screening of articular cartilage pathology.

Vibroarthrographic (VAG) signals emitted by human knee joints are nonstationary and multicomponent in nature; time-frequency distributions (TFD's) provide powerful means to analyze such signals. The objective of this paper is to construct adaptive TFD's of VAG signals suitable for feature extraction. An adaptive TFD was constructed by minimum cross-entropy optimization of the TFD obtained by the matching pursuit decomposition algorithm. Parameters of VAG signals such as energy, energy spread, frequency, and frequency spread were extracted from their adaptive TFD's. The parameters carry information about the combined TF dynamics of the signals. The mean and standard deviation of the parameters were computed, and each VAG signal was represented by a set of just six features. Statistical pattern classification experiments based on logistic regression analysis of the parameters showed an overall normal/abnormal screening accuracy of 68.9% with 90 VAG signals (51 normals and 39 abnormals), and a higher accuracy of 77.5% with a database of 71 signals with 51 normals and 20 abnormals of a specific type of patellofemoral disorder. The proposed method of VAG signal analysis is independent of joint angle and clinical information, and shows good potential for noninvasive diagnosis and monitoring of patellofemoral disorders such as chondromalacia patella.

Automatic de-noising of knee-joint vibration signals using adaptive time-frequency representations.

A novel de-noising method for improving the signal-to-noise ratio of knee-joint vibration signals (also known as vibro-arthrographic (VAG) signals) is proposed. The de-noising methods considered are based on signal decomposition techniques, such as wavelets, wavelet packets and the matching pursuit (MP) method. Performance evaluation with synthetic signals simulated with the characteristics expected of VAG signals indicates good de-noising results with the MP method. Statistical pattern classification of non-stationary signal features extracted from time-frequency distributions of 37 (19 normal and 18 abnormal) MP method-de-noised VAG signals shows a sensitivity of 83.3%, a specificity of 84.2% and an overall accuracy of 83.8%.

Adaptive-neighborhood filtering of images corrupted by signal-dependent noise.

In many image-processing applications the noise that corrupts the images is signal dependent, the most widely encountered types being multiplicative, Poisson, film-grain, and speckle noise. Their common feature is that the power of the noise is related to the brightness of the corrupted pixel. This results in brighter areas appearing to be noisier than darker areas. We propose a new adaptive-neighborhood approach to filtering images corrupted by signal-dependent noise. Instead of using fixed-size, fixed-shape neighborhoods, statistics of the noise and the signal are computed within variable-size, variable-shape neighborhoods that are grown for every pixel to contain only pixels that belong to the same object. Results of adaptive-neighborhood filtering are compared with those given by two local-statistics-based filters (the refined Lee filter and the noise-updating repeated Wiener filter), both in terms of subjective and objective measures. The adaptive-neighborhood approach provides better noise suppression as indicated by lower mean-squared errors as well as better retention of edge sharpness than the other approaches considered.