Subject2Vec: Generative-Discriminative Approach from a Set of Image Patches to a Vector.

We propose an attention-based method that aggregates local image features to a subject-level representation for predicting disease severity. In contrast to classical deep learning that requires a fixed dimensional input, our method operates on a set of image patches; hence it can accommodate variable length input image without image resizing. The model learns a clinically interpretable subject-level representation that is reflective of the disease severity. Our model consists of three mutually dependent modules which regulate each other: (1) a discriminative network that learns a fixed-length representation from local features and maps them to disease severity; (2) an attention mechanism that provides interpretability by focusing on the areas of the anatomy that contribute the most to the prediction task; and (3) a generative network that encourages the diversity of the local latent features. The generative term ensures that the attention weights are non-degenerate while maintaining the relevance of the local regions to the disease severity. We train our model end-to-end in the context of a large-scale lung CT study of Chronic Obstructive Pulmonary Disease (COPD). Our model gives state-of-the art performance in predicting clinical measures of severity for COPD.The distribution of the attention provides the regional relevance of lung tissue to the clinical measurements.

A Likelihood-Free Approach for Characterizing Heterogeneous Diseases in Large-Scale Studies.

We propose a non-parametric approach for characterizing heterogeneous diseases in large-scale studies. We target diseases where multiple types of pathology present simultaneously in each subject and a more severe disease manifests as a higher level of tissue destruction. For each subject, we model the collection of local image descriptors as samples generated by an unknown subject-specific probability density. Instead of approximating the probability density via a parametric family, we propose to side step the parametric inference by directly estimating the divergence between subject densities. Our method maps the collection of local image descriptors to a signature vector that is used to predict a clinical measurement. We are able to interpret the prediction of the clinical variable in the population and individual levels by carefully studying the divergences. We illustrate an application this method on simulated data as well as on a large-scale lung CT study of Chronic Obstructive Pulmonary Disease (COPD). Our approach outperforms classical methods on both simulated and COPD data and demonstrates the state-of-the-art prediction on an important physiologic measure of airflow (the forced respiratory volume in one second, FEV1).

Spherical Topic Models for Imaging Phenotype Discovery in Genetic Studies.

In this paper, we use Spherical Topic Models to discover the latent structure of lung disease. This method can be widely employed when a measurement for each subject is provided as a normalized histogram of relevant features. In this paper, the resulting descriptors are used as phenotypes to identify genetic markers associated with the Chronic Obstructive Pulmonary Disease (COPD). Features extracted from images capture the heterogeneity of the disease and therefore promise to improve detection of relevant genetic variants in Genome Wide Association Studies (GWAS). Our generative model is based on normalized histograms of image intensity of each subject and it can be readily extended to other forms of features as long as they are provided as normalized histograms. The resulting algorithm represents the intensity distribution as a combination of meaningful latent factors and mixing co-efficients that can be used for genetic association analysis. This approach is motivated by a clinical hypothesis that COPD symptoms are caused by multiple coexisting disease processes. Our experiments show that the new features enhance the previously detected signal on chromosome 15 with respect to standard respiratory and imaging measurements.

Prediction of MCI to AD conversion, via MRI, CSF biomarkers, and pattern classification.

Magnetic resonance imaging (MRI) patterns were examined together with cerebrospinal fluid (CSF) biomarkers in serial scans of Alzheimer's Disease Neuroimaging Initiative (ADNI) participants with mild cognitive impairment (MCI). The SPARE-AD score, summarizing brain atrophy patterns, was tested as a predictor of short-term conversion to Alzheimer's disease (AD). MCI individuals that converted to AD (MCI-C) had mostly positive baseline SPARE-AD (Spatial Pattern of Abnormalities for Recognition of Early AD) and atrophy in temporal lobe gray matter (GM) and white matter (WM), posterior cingulate/precuneous, and insula. MCI individuals that converted to AD had mostly AD-like baseline CSF biomarkers. MCI nonconverters (MCI-NC) had mixed baseline SPARE-AD and CSF values, suggesting that some MCI-NC subjects may later convert. Those MCI-NC with most negative baseline SPARE-AD scores (normal brain structure) had significantly higher baseline Mini Mental State Examination (MMSE) scores (28.67) than others, and relatively low annual rate of Mini Mental State Examination decrease (-0.25). MCI-NC with midlevel baseline SPARE-AD displayed faster annual rates of SPARE-AD increase (indicating progressing atrophy). SPARE-AD and CSF combination improved prediction over individual values. In summary, both SPARE-AD and CSF biomarkers showed high baseline sensitivity, however, many MCI-NC had abnormal baseline SPARE-AD and CSF biomarkers. Longer follow-up will elucidate the specificity of baseline measurements.

DISEASE CLASSIFICATION AND PREDICTION VIA SEMI-SUPERVISED DIMENSIONALITY REDUCTION.

We present a new semi-supervised algorithm for dimensionality reduction which exploits information of unlabeled data in order to improve the accuracy of image-based disease classification based on medical images. We perform dimensionality reduction by adopting the formalism of constrained matrix decomposition of [1] to semi-supervised learning. In addition, we add a new regularization term to the objective function to better captur the affinity between labeled and unlabeled data. We apply our method to a data set consisting of medical scans of subjects classified as Normal Control (CN) and Alzheimer (AD). The unlabeled data are scans of subjects diagnosed with Mild Cognitive Impairment (MCI), which are at high risk to develop AD in the future. We measure the accuracy of our algorithm in classifying scans as AD and NC. In addition, we use the classifier to predict which subjects with MCI will converge to AD and compare those results to the diagnosis given at later follow ups. The experiments highlight that unlabeled data greatly improves the accuracy of our classifier.