Framework for lumen-based nonrigid tomographic coregistration of intravascular images.

Purpose: Modern medical imaging enables clinicians to effectively diagnose, monitor, and treat diseases. However, clinical decision-making often relies on combined evaluation of either longitudinal or disparate image sets, necessitating coregistration of multiple acquisitions. Promising coregistration techniques have been proposed; however, available methods predominantly rely on time-consuming manual alignments or nontrivial feature extraction with limited clinical applicability. Addressing these issues, we present a fully automated, robust, nonrigid registration method, allowing for coregistering of multimodal tomographic vascular image datasets using luminal annotation as the sole alignment feature. Approach: Registration is carried out by the use of the registration metrics defined exclusively for lumens shapes. The framework is primarily broken down into two sequential parts: longitudinal and rotational registration. Both techniques are inherently nonrigid in nature to compensate for motion and acquisition artifacts in tomographic images. Results: Performance was evaluated across multimodal intravascular datasets, as well as in longitudinal cases assessing pre-/postinterventional coronary images. Low registration error in both datasets highlights method utility, with longitudinal registration errors-evaluated throughout the paired tomographic sequences-of 0.29 ± 0.14 mm ( < 2 longitudinal image frames) and 0.18 ± 0.16 mm ( < 1 frame) for multimodal and interventional datasets, respectively. Angular registration for the interventional dataset rendered errors of 7.7 ° ± 6.7 ° , and 29.1 ° ± 23.2 ° for the multimodal set. Conclusions: Satisfactory results across datasets, along with additional attributes such as the ability to avoid longitudinal over-fitting and correct nonlinear catheter rotation during nonrigid rotational registration, highlight the potential wide-ranging applicability of our presented coregistration method.

Impact and implications of mixed plaque class in automated characterization of complex atherosclerotic lesions.

Atherosclerosis is a complex disease altering vasculature morphology, and subsequently flow, with progressive plaque formation, mural disruption, and lumen occlusion. Determination of clinically-relevant plaque components-particularly calcium, lipid, and fibrous tissue-has driven automated image-based tissue characterization. Atherosclerotic tissue of mixed composition type arises when these principal components interdigitate and combine during the course of progressive atherosclerosis. Nevertheless, such mixed plaque is treated non-uniformly, and often neglected, as a distinct class in image analysis. We therefore quantitatively investigate frameworks to characterize mixed and other plaque tissue types, and examine their implications. Convolutional neural networks operated on labeled intravascular optical coherence tomography images using various characterization frameworks. The treatment of mixed plaque by image-based classifiers influenced the accuracy and homogeneity of the segmented classes. Excluding mixed plaque as a class on to itself necessarily assigns heterogeneous lesion subcomponents to one of the three homogeneous subtypes; when included, 61.7% of mixed tissue is labeled as calcium, reducing specificity in homogeneous calcium detection by 34.8%. Segmenting mixed plaque as distinct from homogeneous, non-mixed tissue improves lesion classification. This can be achieved either on the basis of homogeneous tissue classifier prediction uncertainty (77.8% overall accuracy) or by training classifiers to identify mixed plaque as a discrete tissue class (82.9% overall accuracy). Alternatively, mixed plaque can be grouped with one of the homogeneous classes, yielding a single histologically diverse class that helps preserve the homogeneity of the others. Ultimately, the best approach depends upon the alignment of histological and functional distinctions. While no vascular lesion characterization framework or method is universally optimal or appropriate, context should remain central in selecting tissue characterization techniques.

An inverse method for mechanical characterization of heterogeneous diseased arteries using intravascular imaging.

The increasing prevalence of finite element (FE) simulations in the study of atherosclerosis has spawned numerous inverse FE methods for the mechanical characterization of diseased tissue in vivo. Current approaches are however limited to either homogenized or simplified material representations. This paper presents a novel method to account for tissue heterogeneity and material nonlinearity in the recovery of constitutive behavior using imaging data acquired at differing intravascular pressures by incorporating interfaces between various intra-plaque tissue types into the objective function definition. Method verification was performed in silico by recovering assigned material parameters from a pair of vessel geometries: one derived from coronary optical coherence tomography (OCT); one generated from in silico-based simulation. In repeated tests, the method consistently recovered 4 linear elastic (0.1 ± 0.1% error) and 8 nonlinear hyperelastic (3.3 ± 3.0% error) material parameters. Method robustness was also highlighted in noise sensitivity analysis, where linear elastic parameters were recovered with average errors of 1.3 ± 1.6% and 8.3 ± 10.5%, at 5% and 20% noise, respectively. Reproducibility was substantiated through the recovery of 9 material parameters in two more models, with mean errors of 3.0 ± 4.7%. The results highlight the potential of this new approach, enabling high-fidelity material parameter recovery for use in complex cardiovascular computational studies.

A platform for high-fidelity patient-specific structural modelling of atherosclerotic arteries: from intravascular imaging to three-dimensional stress distributions.

The pathophysiology of atherosclerotic lesions, including plaque rupture triggered by mechanical failure of the vessel wall, depends directly on the plaque morphology-modulated mechanical response. The complex interplay between lesion morphology and structural behaviour can be studied with high-fidelity computational modelling. However, construction of three-dimensional (3D) and heterogeneous models is challenging, with most previous work focusing on two-dimensional geometries or on single-material lesion compositions. Addressing these limitations, we here present a semi-automatic computational platform, leveraging clinical optical coherence tomography images to effectively reconstruct a 3D patient-specific multi-material model of atherosclerotic plaques, for which the mechanical response is obtained by structural finite-element simulations. To demonstrate the importance of including multi-material plaque components when recovering the mechanical response, a computational case study was conducted in which systematic variation of the intraplaque lipid and calcium was performed. The study demonstrated that the inclusion of various tissue components greatly affected the lesion mechanical response, illustrating the importance of multi-material formulations. This platform accordingly provides a viable foundation for studying how plaque micro-morphology affects plaque mechanical response, allowing for patient-specific assessments and extension into clinically relevant patient cohorts.

Artificial intelligence to generate medical images: augmenting the cardiologist's visual clinical workflow.

Artificial intelligence (AI) offers great promise in cardiology, and medicine broadly, for its ability to tirelessly integrate vast amounts of data. Applications in medical imaging are particularly attractive, as images are a powerful means to convey rich information and are extensively utilized in cardiology practice. Departing from other AI approaches in cardiology focused on task automation and pattern recognition, we describe a digital health platform to synthesize enhanced, yet familiar, clinical images to augment the cardiologist's visual clinical workflow. In this article, we present the framework, technical fundamentals, and functional applications of the methodology, especially as it pertains to intravascular imaging. A conditional generative adversarial network was trained with annotated images of atherosclerotic diseased arteries to generate synthetic optical coherence tomography and intravascular ultrasound images on the basis of specified plaque morphology. Systems leveraging this unique and flexible construct, whereby a pair of neural networks is competitively trained in tandem, can rapidly generate useful images. These synthetic images replicate the style, and in several ways exceed the content and function, of normally acquired images. By using this technique and employing AI in such applications, one can ameliorate challenges in image quality, interpretability, coherence, completeness, and granularity, thereby enhancing medical education and clinical decision-making.

A Domain Enriched Deep Learning Approach to Classify Atherosclerosis using Intravascular Ultrasound Imaging.

Intravascular ultrasound (IVUS) imaging is widely used for diagnostic imaging in interventional cardiology. The detection and quantification of atherosclerosis from acquired images is typically performed manually by medical experts or by virtual histology IVUS (VH-IVUS) software. VH-IVUS analyzes backscattered radio frequency (RF) signals to provide a color-coded tissue map, and is the method of choice for assessing atherosclerotic plaque in situ. However, a significant amount of tissue cannot be analyzed in reasonable time because the method can be applied just once per cardiac cycle. Furthermore, only hardware and software compatible with RF signal acquisition and processing may be used. We present an image-based tissue characterization method that can be applied to entire acquisition sequences post hoc for the assessment of diseased vessels. The pixel-based method utilizes domain knowledge of arterial pathology and physiology, and leverages technological advances of convolutional neural networks to segment diseased vessel walls into the same tissue classes as virtual histology using only grayscale IVUS images. The method was trained and tested on patches extracted from VH-IVUS images acquired from several patients, and achieved overall accuracy of 93.5% for all segmented tissue. Imposing physically-relevant spatial constraints driven by domain knowledge was key to achieving such strong performance. This enriched approach offers capabilities akin to VH-IVUS without the constraints of RF signals or limited once-per-cycle analysis, offering superior potential information acquisition speed, reduced hardware and software requirements, and more widespread applicability. Such an approach may well yield promise for future clinical and research applications.

A Mechanical Approach for Smooth Surface Fitting to Delineate Vessel Walls in Optical Coherence Tomography Images.

Automated analysis of vascular imaging techniques is limited by the inability to precisely determine arterial borders. Intravascular optical coherence tomography (OCT) offers unprecedented detail of artery wall structure and composition, but does not provide consistent visibility of the outer border of the vessel due to the limited penetration depth. Existing interpolation and surface fitting methods prove insufficient to accurately fill the gaps between the irregularly spaced and sometimes unreliably identified visible segments of the vessel outer border. This paper describes an intuitive, efficient, and flexible new method of 3D surface fitting and smoothing suitable for this task. An anisotropic linear-elastic mesh is fit to irregularly spaced and uncertain data points corresponding to visible segments of vessel borders, enabling the fully automated delineation of the entire inner and outer borders of diseased vessels in OCT images for the first time. In a clinical dataset, the proposed smooth surface fitting approach had great agreement when compared with human annotations: areas differed by just 11 ± 11% (0.93 ± 0.84 mm2), with a coefficient of determination of 0.89. Overlapping and non-overlapping area ratios were 0.91 and 0.18, respectively, with a sensitivity of 90.8 and specificity of 99.0. This spring mesh method of contour fitting significantly outperformed all alternative surface fitting and interpolation approaches tested. The application of this promising proposed method is expected to enhance clinical intervention and translational research using OCT.