Image Processing Methods for Coronal Hole Segmentation, Matching, and Map Classification.

The paper presents the results from a multi-year effort to develop and validate image processing methods for selecting the best physical models based on solar image observations. The approach consists of selecting the physical models based on their agreement with coronal holes extracted from the images. Ultimately, the goal is to use physical models to predict geomagnetic storms. We decompose the problem into three subproblems: (i) coronal hole segmentation based on physical constraints, (ii) matching clusters of coronal holes between different maps, and (iii) physical map classification. For segmenting coronal holes, we develop a multi-modal method that uses segmentation maps from three different methods to initialize a level-set method that evolves the initial coronal hole segmentation to the magnetic boundary. Then, we introduce a new method based on Linear Programming for matching clusters of coronal holes. The final matching is then performed using Random Forests. The methods were carefully validated using consensus maps derived from multiple readers, manual clustering, manual map classification, and method validation for 50 maps. The proposed multi-modal segmentation method significantly outperformed SegNet, U-net, Henney-Harvey, and FCN by providing accurate boundary detection. Overall, the method gave a 95.5% map classification accuracy.

Adaptive emergency scenery video communications using HEVC for responsive decision support in disaster incidents.

This study proposes a unifying framework for m-Health video communication systems that provides for the joint optimization of video quality, bitrate demands, and encoding time. The framework is video modality and infrastructure independent and facilitates adaptation to the best available encoding mode that satisfies underlying technology and application imposed constraints. The scalability of the proposed algorithm is demonstrated using different HEVC encoding configurations and realistic modelling of 802.11× wireless infrastructure for emergency scenery and response videos. Extensive experimentation shows that a jointly optimal solution in the encoding time, bitrate, and video quality space is feasible.

Prediction of the time period of stroke based on ultrasound image analysis of initially asymptomatic carotid plaques.

Non-invasive ultrasound imaging of carotid plaques can provide information on the characteristics of the arterial wall including the size, morphology and texture of the atherosclerotic plaques. Several studies were carried out that demonstrated the usefulness of these feature sets for differentiating between asymptomatic and symptomatic plaques and their corresponding cerebrovascular risk stratification. The aim of this study was to develop predictive modelling for estimating the time period of a stroke event by determining the risk for short term (less or equal to three years) or long term (more than three years) events. Data from 108 patients that had a stroke event have been used. The information collected included clinical and ultrasound imaging data. The prediction was performed at base line where patients were still asymptomatic. Several image texture analysis and clinical features were used in order to create a classification model. The different features were statistically analyzed and we conclude that image texture analysis features extracted using Spatial Gray Level Dependencies method had the best statistical significance. Several predictive models were derived based on Binary Logistic Regression (BLR) and Support Vector Machines (SVM) modelling. The best results were obtained with the SVM modelling models with an average correct classifications score of 77±7% for differentiating between stroke event occurrences within 3 years versus more than 3 years. Further work is needed in investigating additional multiscale texture analysis features as well as more modelling techniques on more subjects.

Computer-aided diagnosis in hysteroscopic imaging.

The paper presents the development of a computer-aided diagnostic (CAD) system for the early detection of endometrial cancer. The proposed CAD system supports reproducibility through texture feature standardization, standardized multifeature selection, and provides physicians with comparative distributions of the extracted texture features. The CAD system was validated using 516 regions of interest (ROIs) extracted from 52 subjects. The ROIs were equally distributed among normal and abnormal cases. To support reproducibility, the RGB images were first gamma corrected and then converted into HSV and YCrCb. From each channel of the gamma-corrected YCrCb, HSV, and RGB color systems, we extracted the following texture features: 1) statistical features (SFs), 2) spatial gray-level dependence matrices (SGLDM), and 3) gray-level difference statistics (GLDS). The texture features were then used as inputs with support vector machines (SVMs) and the probabilistic neural network (PNN) classifiers. After accounting for multiple comparisons, texture features extracted from abnormal ROIs were found to be significantly different than texture features extracted from normal ROIs. Compared to texture features extracted from normal ROIs, abnormal ROIs were characterized by lower image intensity, while variance, entropy, and contrast gave higher values. In terms of ROI classification, the best results were achieved by using SF and GLDS features with an SVM classifier. For this combination, the proposed CAD system achieved an 81% correct classification rate.

Despeckle Filtering for Multiscale Amplitude-Modulation Frequency-Modulation (AM-FM) Texture Analysis of Ultrasound Images of the Intima-Media Complex.

The intima-media thickness (IMT) of the common carotid artery (CCA) is widely used as an early indicator of cardiovascular disease (CVD). Typically, the IMT grows with age and this is used as a sign of increased risk of CVD. Beyond thickness, there is also clinical interest in identifying how the composition and texture of the intima-media complex (IMC) changed and how these textural changes grow into atherosclerotic plaques that can cause stroke. Clearly though texture analysis of ultrasound images can be greatly affected by speckle noise, our goal here is to develop effective despeckle noise methods that can recover image texture associated with increased rates of atherosclerosis disease. In this study, we perform a comparative evaluation of several despeckle filtering methods, on 100 ultrasound images of the CCA, based on the extracted multiscale Amplitude-Modulation Frequency-Modulation (AM-FM) texture features and visual image quality assessment by two clinical experts. Texture features were extracted from the automatically segmented IMC for three different age groups. The despeckle filters hybrid median and the homogeneous mask area filter showed the best performance by improving the class separation between the three age groups and also yielded significantly improved image quality.

M-health medical video communication systems: an overview of design approaches and recent advances.

The emergence of the new, High Efficiency Video Coding (HEVC) standard, combined with wide deployment of 4G wireless networks, will provide significant support toward the adoption of mobile-health (m-health) medical video communication systems in standard clinical practice. For the first time since the emergence of m-health systems and services, medical video communication systems can be deployed that can rival the standards of in-hospital examinations. In this paper, we provide a thorough overview of today's advancements in the field, discuss existing approaches, and highlight the future trends and objectives.

Fast localization and segmentation of optic disk in retinal images using directional matched filtering and level sets.

The optic disk (OD) center and margin are typically requisite landmarks in establishing a frame of reference for classifying retinal and optic nerve pathology. Reliable and efficient OD localization and segmentation are important tasks in automatic eye disease screening. This paper presents a new, fast, and fully automatic OD localization and segmentation algorithm developed for retinal disease screening. First, OD location candidates are identified using template matching. The template is designed to adapt to different image resolutions. Then, vessel characteristics (patterns) on the OD are used to determine OD location. Initialized by the detected OD center and estimated OD radius, a fast, hybrid level-set model, which combines region and local gradient information, is applied to the segmentation of the disk boundary. Morphological filtering is used to remove blood vessels and bright regions other than the OD that affect segmentation in the peripapillary region. Optimization of the model parameters and their effect on the model performance are considered. Evaluation was based on 1200 images from the publicly available MESSIDOR database. The OD location methodology succeeded in 1189 out of 1200 images (99% success). The average mean absolute distance between the segmented boundary and the reference standard is 10% of the estimated OD radius for all image sizes. Its efficiency, robustness, and accuracy make the OD localization and segmentation scheme described herein suitable for automatic retinal disease screening in a variety of clinical settings.

High efficiency video coding for ultrasound video communication in m-health systems.

Emerging high efficiency video compression methods and wider availability of wireless network infrastructure will significantly advance existing m-health applications. For medical video communications, the emerging video compression and network standards support low-delay and high-resolution video transmission, at the clinically acquired resolution and frame rates. Such advances are expected to further promote the adoption of m-health systems for remote diagnosis and emergency incidents in daily clinical practice. This paper compares the performance of the emerging high efficiency video coding (HEVC) standard to the current state-of-the-art H.264/AVC standard. The experimental evaluation, based on five atherosclerotic plaque ultrasound videos encoded at QCIF, CIF, and 4CIF resolutions demonstrates that 50% reductions in bitrate requirements is possible for equivalent clinical quality.

Atherosclerotic plaque ultrasound video encoding, wireless transmission, and quality assessment using H.264.

We propose a unifying framework for efficient encoding, transmission, and quality assessment of atherosclerotic plaque ultrasound video. The approach is based on a spatially varying encoding scheme, where video-slice quantization parameters are varied as a function of diagnostic significance. Video slices are automatically set based on a segmentation algorithm. They are then encoded using a modified version of H.264/AVC flexible macroblock ordering (FMO) technique that allows variable quality slice encoding and redundant slices (RSs) for resilience over error-prone transmission channels. We evaluate our scheme on a representative collection of ten ultrasound videos of the carotid artery for packet loss rates up to 30%. Extensive simulations incorporating three FMO encoding methods, different quantization parameters, and different packet loss scenarios are investigated. Quality assessment is based on a new clinical rating system that provides independent evaluations of the different parts of the video (subjective). We also use objective video-quality assessment metrics and estimate their correlation to the clinical quality assessment of plaque type. We find that some objective quality assessment measures computed over the plaque video slices gave very good correlations to mean opinion scores (MOSs). Here, MOSs were computed using two medical experts. Experimental results show that the proposed method achieves enhanced performance in noisy environments, while at the same time achieving significant bandwidth demands reductions, providing transmission over 3G (and beyond) wireless networks.

Multiscale amplitude-modulation frequency-modulation (AM-FM) texture analysis of ultrasound images of the intima and media layers of the carotid artery.

The intima-media thickness (IMT) of the common carotid artery (CCA) is widely used as an early indicator of cardiovascular disease (CVD). Clinically, there is strong interest in identifying how the composition and texture of the media layer (ML) can be associated with the risk of stroke. In this study, we use 2-D amplitude-modulation frequency-modulation (AM-FM) analysis of the intima-media complex (IMC), the ML, and intima layer (IL) of the CCA to detect texture changes as a function of age and sex. The study was performed on 100 ultrasound images acquired from asymptomatic subjects at risk of atherosclerosis. To investigate texture variations associated with age, we separated them into three age groups: 1) patients younger than 50; 2) patients aged between 50 and 60 years old; and 3) patients over 60 years old. We also separated the patients by sex. The IMC, ML, and IL were segmented manually by a neurovascular expert and also by a snake-based segmentation system. To reject strong edge artifacts, we prefilter with an AM-FM filterbank that is centered along the horizontal frequency axis (parallel to the long axis of the IMC, ML, and IL), while removing the low-pass filter estimates and frequency bands with large, vertical frequency components. To investigate significant texture changes, we extract the instantaneous amplitude (IA) and the magnitude of the instantaneous frequency (IF) over each layer component, for low-, medium-, and high-frequency AM-FM components. We detected significant texture differences between the higher risk age group of >60 years versus the lower risk age group of <50 and the 50-60 group. In particular, between the <50 and >60 groups, we found significant differences in the medium-scale IA extracted from the IMC. Between the >60 and the 50-60 groups, we found significant texture changes in the low-scale IA and high-scale IF magnitude extracted from the IMC, and the low-scale IA extracted from the IL. Also, we noted that the IA for the ML showed significant differences between males and females for all age groups. The AM--FM features provide complimentary information to classical texture analysis features like the gray-scale median, contrast, and coarseness. These findings provide evidence that AM--FM texture features can be associated with the progression of cardiovascular risk for disease and the risk of stroke with age. However, a larger scale study is needed to establish the application in clinical practice.

Multiscale amplitude-modulation frequency-modulation (AM-FM) texture analysis of multiple sclerosis in brain MRI images.

This study introduces the use of multiscale amplitude modulation-frequency modulation (AM-FM) texture analysis of multiple sclerosis (MS) using magnetic resonance (MR) images from brain. Clinically, there is interest in identifying potential associations between lesion texture and disease progression, and in relating texture features with relevant clinical indexes, such as the expanded disability status scale (EDSS). This longitudinal study explores the application of 2-D AM-FM analysis of brain white matter MS lesions to quantify and monitor disease load. To this end, MS lesions and normal-appearing white matter (NAWM) from MS patients, as well as normal white matter (NWM) from healthy volunteers, were segmented on transverse T2-weighted images obtained from serial brain MR imaging (MRI) scans (0 and 6-12 months). The instantaneous amplitude (IA), the magnitude of the instantaneous frequency (IF), and the IF angle were extracted from each segmented region at different scales. The findings suggest that AM-FM characteristics succeed in differentiating 1) between NWM and lesions; 2) between NAWM and lesions; and 3) between NWM and NAWM. A support vector machine (SVM) classifier succeeded in differentiating between patients that, two years after the initial MRI scan, acquired an EDSS ≤ 2 from those with EDSS > 2 (correct classification rate = 86%). The best classification results were obtained from including the combination of the low-scale IA and IF magnitude with the medium-scale IA. The AM-FM features provide complementary information to classical texture analysis features like the gray-scale median, contrast, and coarseness. The findings of this study provide evidence that AM-FM features may have a potential role as surrogate markers of lesion load in MS.

eEmergency health care information systems.

In this paper we provide an overview of the way that information and communication technologies have been used for emergency healthcare support. The paper provides a literature review of case studies exploring information systems for monitoring signals, images, medical videos, as well as information protocols used during emergency health care support, and describes future trends. We anticipate that eEmergency systems can significantly improve the delivery of healthcare during emergency cases. However, the monitoring and evaluation of these systems and especially their use in daily practice still remains a goal to be achieved.

An overview of recent end-to-end wireless medical video telemedicine systems using 3G.

Advances in video compression, network technologies, and computer technologies have contributed to the rapid growth of mobile health (m-health) systems and services. Wide deployment of such systems and services is expected in the near future, and it's foreseen that they will soon be incorporated in daily clinical practice. This study focuses in describing the basic components of an end-to-end wireless medical video telemedicine system, providing a brief overview of the recent advances in the field, while it also highlights future trends in the design of telemedicine systems that are diagnostically driven.

Robust and efficient ultrasound video coding in noisy channels using H.264.

In this paper we define diagnostic Regions of Interest (ROIs) for carotid ultrasound medical video, which we then use as input for Flexible Macroblock Ordering (FMO) slice encoding. We extend the FMO concept by enabling variable quality slice encoding, tightly coupled by each region's diagnostic importance. Redundant Slices (RS) utilization increases compressed video's resilience over error prone transmission mediums. We evaluate our scheme on a series of five (5) carotid ultrasound videos at QCIF and CIF resolutions, for packet loss rates up to 30%. Quality assessment based on a clinical rating system that provides for independent evaluations of the different parts of the video (subjective), as well as PSNR ratings (objective), shows that encoded videos attain enhanced diagnostic performance under noisy environments, while at the same time achieving significant bandwidth demands reductions.

Multidimensional AM-FM models and methods for biomedical image computing.

This paper provides an overview of multidimensional AM-FM methods for analyzing medical images and videos. Over the last decade, several new AM-FM demodulation methods have been developed. We provide a discussion of what many of these methods share in common, and give some details on recent, Hilbert-based approaches. Medical image applications range from medical image segmentation, resolution enhancement, classification, reconstruction to new methods for video motion estimation. A brief summary of suggestions for future work in this area is also given.

An overview of recent health care support systems for eEmergency and mHealth applications.

Advances in mobile communications and medical technologies facilitate the development of emerging mobile systems and applications for healthcare. The objective of this paper is to provide an overview and the current status of mobile health care systems (mHealth) and their applications for Emergency healthcare support (eEmergency). Our paper reports on journal papers that use wireless, emergency telemedicine systems that appeared since 2000. The majority of the applications are focused on the transmission of crucial biosignals (mainly ECG) for the support of heart-related healthcare. A limited number of new studies were focused on supporting emergency healthcare for trauma by facilitating both 2D image or video transmission (eg: ultrasound). Alternatively, new studies have focused on integrated systems for specialized emergency scenaria such as stroke. This paper is an extension of work previously published by our group [1].

Ultrasound image texture analysis of the intima and media layers of the common carotid artery and its correlation with age and gender.

The intima-media thickness (IMT) of the common carotid artery (CCA) is widely used as an early indicator of cardiovascular disease (CVD). It was proposed but not thoroughly investigated that the composition and texture of the media layer (ML) can be used as an indicator for the risk of stroke. In this study, we investigate the application of texture analysis of the ML of the CCA and how texture is affected by age and gender. The study was performed on 100 longitudinal-section ultrasound images acquired from asymptomatic subjects at risk of atherosclerosis. The images were separated into three different age groups, namely below 50, 50-60, and above 60 years old. Furthermore, the images were separated according to gender. A total of 61 different texture features were extracted from the intima layer (IL), the ML, and the intima-media complex (IMC). The ML and the IMC were segmented manually by a neurovascular expert and also automatically by a snakes segmentation system. We have found that male patients tended to have larger media layer thickness (MLT) values as compared to the MLT of female patients of the same age. We have found significant differences among texture features extracted from the IL, ML and IMC from different age groups. Furthermore, for some texture features, we found that they follow trends that correlate with a patient's age. For example, the gray-scale median GSM of the ML falls linearly with increasing MLT and with increasing age. Our findings suggest that ultrasound image texture analysis of the media layer has potential as an assessment biomarker for the risk of stroke.

Wireless medical ultrasound video transmission through noisy channels.

Recent advances in video compression such as the current state-of-the-art H.264/AVC standard in conjunction with increasingly available bitrate through new technologies like 3G, and WiMax have brought mobile health (m-Health) healthcare systems and services closer to reality. Despite this momentum towards m-Health systems and especially e-Emergency systems, wireless channels remain error prone, while the absence of objective quality metrics limits the ability of providing medical video of adequate diagnostic quality at a required bitrate. In this paper we investigate different encoding schemes and loss rates in medical ultrasound video transmission and come to conclusions involving efficiency, the trade-off between bitrate and quality, while we highlight the relationship linking video quality and the error ratio of corrupted P and B frames. More specifically, we investigate IPPP, IBPBP and IBBPBBP coding structures under packet loss rates of 2%, 5%, 8% and 10% and derive that the latter attains higher SNR ratings in all tested cases. A preliminary clinical evaluation shows that for SNR ratings higher than 30 db, video diagnostic quality may be adequate, while above 30.5 db the diagnostic information available in the reconstructed ultrasound video is close to that of the original.

Color multiscale texture classification of hysteroscopy images of the endometrium.

The objective of this study was to investigate the diagnostic performance of a Computer Aided Diagnostic (CAD) system based on color multiscale texture analysis for the classification of hysteroscopy images of the endometrium, in support of the early detection of gynaecological cancer. A total of 416 Regions of Interest (ROIs) of the endometrium were extracted (208 normal and 208 abnormal) from 45 subjects. RGB images were gamma corrected and were converted to the YCrCb color system. The following texture features were extracted from the Y, Cr and Cb channels: (i) Statistical Features (SF), (ii) Spatial Gray Level Dependence Matrices (SGLDM), and (iii) Gray Level Difference Statistics (GLDS). The Probabilistic Neural Network (PNN), statistical learning and the Support Vector Machine (SVM) neural network classifiers were also applied for the investigation of classifying normal and abnormal ROIs in different scales. Results showed that the highest percentage of correct classification (%CC) score was 79% and was achieved for the SVM models trained with the SF and GLDS features for the 1x1 scale. This %CC was higher by only 2% when compared with the CAD system developed, based on the SF and GLDS feature sets computed from the Y channel only. Further increase in scale from 2x2 to 9x9, dropped the %CC in the region of 60% for the SF, SGLDM, and GLDS, feature sets, and their combinations. Concluding, a CAD system based on texture analysis and SVM models can be used to classify normal and abnormal endometrium tissue in difficult cases of gynaecological cancer. The proposed system has to be investigated with more cases before it is applied in clinical practise.