Finding similar 2D X-ray coronary angiograms.

In clinical practice, physicians often exploit previously observed patterns in coronary angiograms from similar patients to quickly assess the state of the disease in a current patient. These assessments involve visually observed features such as the distance of a junction from the root and the tortuosity of the arteries. In this paper, we show how these visual features can be automatically extracted from coronary artery images and used for finding similar coronary angiograms from a database. Testing on a large collection has shown the method finds clinically similar coronary angiograms from patients with similar clinical history.

Shape-based Similarity Retrieval of Doppler Images for Clinical Decision Support.

Flow Doppler imaging has become an integral part of an echocardiographic exam. Automated interpretation of flow doppler imaging has so far been restricted to obtaining hemodynamic information from velocity-time profiles depicted in these images. In this paper we exploit the shape patterns in Doppler images to infer the similarity in valvular disease labels for purposes of automated clinical decision support. Specifically, we model the similarity in appearance of Doppler images from the same disease class as a constrained non-rigid translation transform of the velocity envelopes embedded in these images. The shape similarity between two Doppler images is then judged by recovering the alignment transform using a variant of dynamic shape warping. Results of similarity retrieval of doppler images for cardiac decision support on a large database of images are presented.

Characterizing spatio-temporal patterns for disease discrimination in cardiac echo videos.

Disease-specific understanding of echocardiographic sequences requires accurate characterization of spatio-temporal motion patterns. In this paper we present a method of automatic extraction and matching of spatio-temporal patterns from cardiac echo videos. Specifically, we extract cardiac regions (chambers and walls) using a variation of multiscale normalized cuts that combines motion estimates from deformable models with image intensity. We then derive spatio-temporal trajectories of region measurements such as wall motion, volume and thickness. The region trajectories are then matched to infer the similarities in disease labels of patients. Validation results on patient data sets collected from many hospitals are presented.

Image representations for visual learning.

Computer vision researchers are developing new approaches to object recognition and detection that are based almost directly on images and avoid the use of intermediate three-dimensional models. Many of these techniques depend on a representation of images that induce a linear vector space structure and in principle requires dense feature correspondence. This image representation allows the use of learning techniques for the analysis of images (for computer vision) as well as for the synthesis of images (for computer graphics).