Atlas-Based Labeling of Resting-State fMRI.

BACKGROUND: Functional Magnetic Resonance Imaging (fMRI) has the potential to provide non-invasive functional mapping of the brain with high spatial and temporal resolution. However, fMRI independent components (ICs) must be manually inspected, selected, and interpreted, requiring time and expertise. We propose a novel approach for automated labeling of fMRI independent components by establishing their characteristic spatio-functional relationship. METHODS: The approach identifies 9 Resting State Networks and 45 independent components and generates a functional activation feature map that quantifies the spatial distribution, relative to an anatomical labeled atlas, of the z-scores of each IC across a cohort of 176 subjects. The cosine-similarity metric was used to classify unlabeled independent component based on the similarity to the spatial distribution of activation with the pre-generated feature map. The approach was tested on three fMRI datasets from the 1000 functional connectome project, consisting of 280 subjects, that were not included in feature map generation. RESULTS: The results demonstrate the effectiveness of the approach in classifying independent components based on their spatial features with an accuracy of better than 95%. CONCLUSIONS: The approach significantly reduces expert time and computation time required for labeling independent components while improving reliability and accuracy. The spatio-functional relationship also provides an explainable relationship between the functional activation and the anatomically defined regions.

An atlas of inter- and intra-tumor heterogeneity of apoptosis competency in colorectal cancer tissue at single-cell resolution.

Cancer cells' ability to inhibit apoptosis is key to malignant transformation and limits response to therapy. Here, we performed multiplexed immunofluorescence analysis on tissue microarrays with 373 cores from 168 patients, segmentation of 2.4 million individual cells, and quantification of 18 cell lineage and apoptosis proteins. We identified an enrichment for BCL2 in immune, and BAK, SMAC, and XIAP in cancer cells. Ordinary differential equation-based modeling of apoptosis sensitivity at single-cell resolution was conducted and an atlas of inter- and intra-tumor heterogeneity in apoptosis susceptibility generated. Systems modeling at single-cell resolution identified an enhanced sensitivity of cancer cells to mitochondrial permeabilization and executioner caspase activation compared to immune and stromal cells, but showed significant inter- and intra-tumor heterogeneity.

Stratification of chemotherapy-treated stage III colorectal cancer patients using multiplexed imaging and single-cell analysis of T-cell populations.

Colorectal cancer (CRC) has one of the highest cancer incidences and mortality rates. In stage III, postoperative chemotherapy benefits <20% of patients, while more than 50% will develop distant metastases. Biomarkers for identification of patients at increased risk of disease recurrence following adjuvant chemotherapy are currently lacking. In this study, we assessed immune signatures in the tumor and tumor microenvironment (TME) using an in situ multiplexed immunofluorescence imaging and single-cell analysis technology (Cell DIVETM) and evaluated their correlations with patient outcomes. Tissue microarrays (TMAs) with up to three 1 mm diameter cores per patient were prepared from 117 stage III CRC patients treated with adjuvant fluoropyrimidine/oxaliplatin (FOLFOX) chemotherapy. Single sections underwent multiplexed immunofluorescence staining for immune cell markers (CD45, CD3, CD4, CD8, FOXP3, PD1) and tumor/cell segmentation markers (DAPI, pan-cytokeratin, AE1, NaKATPase, and S6). We used annotations and a probabilistic classification algorithm to build statistical models of immune cell types. Images were also qualitatively assessed independently by a Pathologist as 'high', 'moderate' or 'low', for stromal and total immune cell content. Excellent agreement was found between manual assessment and total automated scores (p < 0.0001). Moreover, compared to single markers, a multi-marker classification of regulatory T cells (Tregs: CD3+/CD4+FOXP3+/PD1-) was significantly associated with disease-free survival (DFS) and overall survival (OS) (p = 0.049 and 0.032) of FOLFOX-treated patients. Our results also showed that PD1- Tregs rather than PD1+ Tregs were associated with improved survival. These findings were supported by results from an independent FOLFOX-treated cohort of 191 stage III CRC patients, where higher PD1- Tregs were associated with an increase overall survival (p = 0.015) for CD3+/CD4+/FOXP3+/PD1-. Overall, compared to single markers, multi-marker classification provided more accurate quantitation of immune cell types with stronger correlations with outcomes.

Comparison of Multiplexed Immunofluorescence Imaging to Chromogenic Immunohistochemistry of Skin Biomarkers in Response to Monkeypox Virus Infection.

Over the last 15 years, advances in immunofluorescence-imaging based cycling methods, antibody conjugation methods, and automated image processing have facilitated the development of a high-resolution, multiplexed tissue immunofluorescence (MxIF) method with single cell-level quantitation termed Cell DIVETM. Originally developed for fixed oncology samples, here it was evaluated in highly fixed (up to 30 days), archived monkeypox virus-induced inflammatory skin lesions from a retrospective study in 11 rhesus monkeys to determine whether MxIF was comparable to manual H-scoring of chromogenic stains. Six protein markers related to immune and cellular response (CD68, CD3, Hsp70, Hsp90, ERK1/2, ERK1/2 pT202_pY204) were manually quantified (H-scores) by a pathologist from chromogenic IHC double stains on serial sections and compared to MxIF automated single cell quantification of the same markers that were multiplexed on a single tissue section. Overall, there was directional consistency between the H-score and the MxIF results for all markers except phosphorylated ERK1/2 (ERK1/2 pT202_pY204), which showed a decrease in the lesion compared to the adjacent non-lesioned skin by MxIF vs an increase via H-score. Improvements to automated segmentation using machine learning and adding additional cell markers for cell viability are future options for improvement. This method could be useful in infectious disease research as it conserves tissue, provides marker colocalization data on thousands of cells, allowing further cell level data mining as well as a reduction in user bias.

Quantitative patterns of motor cortex proteinopathy across ALS genotypes.

Degeneration of the primary motor cortex is a defining feature of amyotrophic lateral sclerosis (ALS), which is associated with the accumulation of microscopic protein aggregates in neurons and glia. However, little is known about the quantitative burden and pattern of motor cortex proteinopathies across ALS genotypes. We combined quantitative digital image analysis with multi-level generalized linear modelling in an independent cohort of 82 ALS cases to explore the relationship between genotype, total proteinopathy load and cellular vulnerability to aggregate formation. Primary motor cortex phosphorylated (p)TDP-43 burden and microglial activation were more severe in sporadic ALS-TDP disease than C9-ALS. Oligodendroglial pTDP-43 pathology was a defining feature of ALS-TDP in sporadic ALS, C9-ALS and ALS with OPTN, HNRNPA1 or TARDBP mutations. ALS-FUS and ALS-SOD1 showed less cortical proteinopathy in relation to spinal cord pathology than ALS-TDP, where pathology was more evenly spread across the motor cortex-spinal cord axis. Neuronal pTDP-43 aggregates were rare in GAD67+ and Parvalbumin+ inhibitory interneurons, consistent with predominant accumulation in excitatory neurons. Finally, we show that cortical microglia, but not astrocytes, contain pTDP-43. Our findings suggest divergent quantitative, genotype-specific vulnerability of the ALS primary motor cortex to proteinopathies, which may have implications for our understanding of disease pathogenesis and the development of genotype-specific therapies.

Understanding heterogeneous tumor microenvironment in metastatic melanoma.

A systemic analysis of the tumor-immune interactions within the heterogeneous tumor microenvironment is of particular importance for understanding the antitumor immune response. We used multiplexed immunofluorescence to elucidate cellular spatial interactions and T-cell infiltrations in metastatic melanoma tumor microenvironment. We developed two novel computational approaches that enable infiltration clustering and single cell analysis-cell aggregate algorithm and cell neighborhood analysis algorithm-to reveal and to compare the spatial distribution of various immune cells relative to tumor cell in sub-anatomic tumor microenvironment areas. We showed that the heterogeneous tumor human leukocyte antigen-1 expressions differently affect the magnitude of cytotoxic T-cell infiltration and the distributions of CD20+ B cells and CD4+FOXP3+ regulatory T cells within and outside of T-cell infiltrated tumor areas. In a cohort of 166 stage III melanoma samples, high tumor human leukocyte antigen-1 expression is required but not sufficient for high T-cell infiltration, with significantly improved overall survival. Our results demonstrate that tumor cells with heterogeneous properties are associated with differential but predictable distributions of immune cells within heterogeneous tumor microenvironment with various biological features and impacts on clinical outcomes. It establishes tools necessary for systematic analysis of the tumor microenvironment, allowing the elucidation of the "homogeneous patterns" within the heterogeneous tumor microenvironment.

Optimized multiplex immunofluorescence single-cell analysis reveals tuft cell heterogeneity.

Intestinal tuft cells are a rare, poorly understood cell type recently shown to be a critical mediator of type 2 immune response to helminth infection. Here, we present advances in segmentation algorithms and analytical tools for multiplex immunofluorescence (MxIF), a platform that enables iterative staining of over 60 antibodies on a single tissue section. These refinements have enabled a comprehensive analysis of tuft cell number, distribution, and protein expression profiles as a function of anatomical location and physiological perturbations. Based solely on DCLK1 immunoreactivity, tuft cell numbers were similar throughout the mouse small intestine and colon. However, multiple subsets of tuft cells were uncovered when protein coexpression signatures were examined, including two new intestinal tuft cell markers, Hopx and EGFR phosphotyrosine 1068. Furthermore, we identified dynamic changes in tuft cell number, composition, and protein expression associated with fasting and refeeding and after introduction of microbiota to germ-free mice. These studies provide a foundational framework for future studies of intestinal tuft cell regulation and demonstrate the utility of our improved MxIF computational methods and workflow for understanding cellular heterogeneity in complex tissues in normal and disease states.

Multiplexed immunofluorescence delineates proteomic cancer cell states associated with metabolism.

The phenotypic diversity of cancer results from genetic and nongenetic factors. Most studies of cancer heterogeneity have focused on DNA alterations, as technologies for proteomic measurements in clinical specimen are currently less advanced. Here, we used a multiplexed immunofluorescence staining platform to measure the expression of 27 proteins at the single-cell level in formalin-fixed and paraffin-embedded samples from treatment-naive stage II/III human breast cancer. Unsupervised clustering of protein expression data from 638,577 tumor cells in 26 breast cancers identified 8 clusters of protein coexpression. In about one-third of breast cancers, over 95% of all neoplastic cells expressed a single protein coexpression cluster. The remaining tumors harbored tumor cells representing multiple protein coexpression clusters, either in a regional distribution or intermingled throughout the tumor. Tumor uptake of the radiotracer 18F-fluorodeoxyglucose was associated with protein expression clusters characterized by hormone receptor loss, PTEN alteration, and HER2 gene amplification. Our study demonstrates an approach to generate cellular heterogeneity metrics in routinely collected solid tumor specimens and integrate them with in vivo cancer phenotypes.

Stromal-Based Signatures for the Classification of Gastric Cancer.

Treatment of metastatic gastric cancer typically involves chemotherapy and monoclonal antibodies targeting HER2 (ERBB2) and VEGFR2 (KDR). However, reliable methods to identify patients who would benefit most from a combination of treatment modalities targeting the tumor stroma, including new immunotherapy approaches, are still lacking. Therefore, we integrated a mouse model of stromal activation and gastric cancer genomic information to identify gene expression signatures that may inform treatment strategies. We generated a mouse model in which VEGF-A is expressed via adenovirus, enabling a stromal response marked by immune infiltration and angiogenesis at the injection site, and identified distinct stromal gene expression signatures. With these data, we designed multiplexed IHC assays that were applied to human primary gastric tumors and classified each tumor to a dominant stromal phenotype representative of the vascular and immune diversity found in gastric cancer. We also refined the stromal gene signatures and explored their relation to the dominant patient phenotypes identified by recent large-scale studies of gastric cancer genomics (The Cancer Genome Atlas and Asian Cancer Research Group), revealing four distinct stromal phenotypes. Collectively, these findings suggest that a genomics-based systems approach focused on the tumor stroma can be used to discover putative predictive biomarkers of treatment response, especially to antiangiogenesis agents and immunotherapy, thus offering an opportunity to improve patient stratification. Cancer Res; 76(9); 2573-86. ©2016 AACR.

Automatic Morphological Reconstruction of Neurons from Multiphoton and Confocal Microscopy Images Using 3D Tubular Models.

The challenges faced in analyzing optical imaging data from neurons include a low signal-to-noise ratio of the acquired images and the multiscale nature of the tubular structures that range in size from hundreds of microns to hundreds of nanometers. In this paper, we address these challenges and present a computational framework for an automatic, three-dimensional (3D) morphological reconstruction of live nerve cells. The key aspects of this approach are: (i) detection of neuronal dendrites through learning 3D tubular models, and (ii) skeletonization by a new algorithm using a morphology-guided deformable model for extracting the dendritic centerline. To represent the neuron morphology, we introduce a novel representation, the Minimum Shape-Cost (MSC) Tree that approximates the dendrite centerline with sub-voxel accuracy and demonstrate the uniqueness of such a shape representation as well as its computational efficiency. We present extensive quantitative and qualitative results that demonstrate the accuracy and robustness of our method.

A novel, automated technology for multiplex biomarker imaging and application to breast cancer.

AIMS: Multiplexed immunofluorescence is a powerful tool for validating multigene assays and understanding the complex interplay of proteins implicated in breast cancer within a morphological context. We describe a novel technology for imaging an extended panel of biomarkers on a single, formalin-fixed paraffin-embedded breast sample and evaluating biomarker interaction at a single-cell level, and demonstrate proof-of-concept on a small set of breast tumours, including those which co-express hormone receptors with Her2/neu and Ki-67. METHODS AND RESULTS: Using a microfluidic flow cell, reagent exchange was automated and consisted of serial rounds of staining with dye-conjugated antibodies, imaging and chemical deactivation. A two-step antigen retrieval process was developed to satisfy all epitopes simultaneously, and key parameters were optimized. The imaging sequence was applied to seven breast tumours, and compared with conventional immunohistochemistry. Single-cell correlation analysis was performed with automated image processing. CONCLUSIONS: We have described a novel platform for evaluating biomarker co-localization. Expression in multiplexed images is consistent with conventional immunohistochemistry. Automation reduces inconsistencies in staining and positional shifts, while the fluorescent dye cycling approach dramatically expands the number of biomarkers which can be visualized and quantified on a single tissue section.

Highly multiplexed single-cell analysis of formalin-fixed, paraffin-embedded cancer tissue.

Limitations on the number of unique protein and DNA molecules that can be characterized microscopically in a single tissue specimen impede advances in understanding the biological basis of health and disease. Here we present a multiplexed fluorescence microscopy method (MxIF) for quantitative, single-cell, and subcellular characterization of multiple analytes in formalin-fixed paraffin-embedded tissue. Chemical inactivation of fluorescent dyes after each image acquisition round allows reuse of common dyes in iterative staining and imaging cycles. The mild inactivation chemistry is compatible with total and phosphoprotein detection, as well as DNA FISH. Accurate computational registration of sequential images is achieved by aligning nuclear counterstain-derived fiducial points. Individual cells, plasma membrane, cytoplasm, nucleus, tumor, and stromal regions are segmented to achieve cellular and subcellular quantification of multiplexed targets. In a comparison of pathologist scoring of diaminobenzidine staining of serial sections and automated MxIF scoring of a single section, human epidermal growth factor receptor 2, estrogen receptor, p53, and androgen receptor staining by diaminobenzidine and MxIF methods yielded similar results. Single-cell staining patterns of 61 protein antigens by MxIF in 747 colorectal cancer subjects reveals extensive tumor heterogeneity, and cluster analysis of divergent signaling through ERK1/2, S6 kinase 1, and 4E binding protein 1 provides insights into the spatial organization of mechanistic target of rapamycin and MAPK signal transduction. Our results suggest MxIF should be broadly applicable to problems in the fields of basic biological research, drug discovery and development, and clinical diagnostics.

Autofluorescence removal using a customized filter set.

Quantitative fluorescence microscopy is severely hindered by intrinsic autofluorescence (AF). Endogenous fluorescent molecules in tissue and cell samples emit fluorescence that often dominates signals from specific dyes. This makes AF removal critical to the development and practice of quantitative fluorescence microscopy. In this study, we showed that AF signal could be separated from specific signal using a customized filter set. The filter set used the same excitation and beam splitter as the standard filter set, but the emission filter was red-shifted 40-60 nm from the peak of the specific dye. This filter set configuration collected mostly AF with minimum contribution from the specific dye. A linear transformation of AF images was required to correct for the difference in exposure and filter configuration. The constants (slope and intercept) in linear transformation were obtained through a pixel to pixel comparison between AF images (no staining) obtained by the standard filter set and the customized AF filter set. After staining of specific dye, the standard filter collecting target dye spectra was used to capture both target signal and AF, whereas customized filter was used to capture only AF. AF removal was accomplished by subtracting the linear transformed AF image from the image obtained from the standard filter. To validate our approach, we examined weak staining of androgen receptor in an AF abundant prostate tissue sample. Our method revealed a similar but cleaner nuclear staining of androgen receptor in a specimen, when compared to a traditional autofluorescence removal method.

Quantitative single cell analysis of cell population dynamics during submandibular salivary gland development and differentiation.

Epithelial organ morphogenesis involves reciprocal interactions between epithelial and mesenchymal cell types to balance progenitor cell retention and expansion with cell differentiation for evolution of tissue architecture. Underlying submandibular salivary gland branching morphogenesis is the regulated proliferation and differentiation of perhaps several progenitor cell populations, which have not been characterized throughout development, and yet are critical for understanding organ development, regeneration, and disease. Here we applied a serial multiplexed fluorescent immunohistochemistry technology to map the progressive refinement of the epithelial and mesenchymal cell populations throughout development from embryonic day 14 through postnatal day 20. Using computational single cell analysis methods, we simultaneously mapped the evolving temporal and spatial location of epithelial cells expressing subsets of differentiation and progenitor markers throughout salivary gland development. We mapped epithelial cell differentiation markers, including aquaporin 5, PSP, SABPA, and mucin 10 (acinar cells); cytokeratin 7 (ductal cells); and smooth muscle α-actin (myoepithelial cells) and epithelial progenitor cell markers, cytokeratin 5 and c-kit. We used pairwise correlation and visual mapping of the cells in multiplexed images to quantify the number of single- and double-positive cells expressing these differentiation and progenitor markers at each developmental stage. We identified smooth muscle α-actin as a putative early myoepithelial progenitor marker that is expressed in cytokeratin 5-negative cells. Additionally, our results reveal dynamic expansion and redistributions of c-kit- and K5-positive progenitor cell populations throughout development and in postnatal glands. The data suggest that there are temporally and spatially discreet progenitor populations that contribute to salivary gland development and homeostasis.

Functional morphology analysis of the left anterior descending coronary artery in EBCT images.

In this paper, we present a physics-based deformable model framework for morphological and motion analysis of the left anterior descending (LAD) coronary artery. The proposed model is designed to capture the complex motion that the LAD undergoes during the cardiac cycle. The key idea is to define a local coordinate system for the heart and to parameterize both the shape and motion of the LAD in a single framework. The shape of the LAD is modeled as a parametric generalized cylinder, and the motion during the heart cycle is modeled as a composite of three components, which are as follows: 1) longitudinal deformation, 2) radial displacement, and 3) angular displacement over the cardiac cycle. The proposed framework for the LAD shape-motion estimation is generic, since it does not assume any particular tubular shape. Results obtained for four human subjects using electron beam computed tomography data are in agreement with LAD shape-motion deformations reported in the literature.

Denoising for 3-d photon-limited imaging data using nonseparable filterbanks.

In this paper, we present a novel frame-based denoising algorithm for photon-limited 3-D images. We first construct a new 3-D nonseparable filterbank by adding elements to an existing frame in a structurally stable way. In contrast with the traditional 3-D separable wavelet system, the new filterbank is capable of using edge information in multiple directions. We then propose a data-adaptive hysteresis thresholding algorithm based on this new 3-D nonseparable filterbank. In addition, we develop a new validation strategy for denoising of photon-limited images containing sparse structures, such as neurons (the structure of interest is less than 5% of total volume). The validation method, based on tubular neighborhoods around the structure, is used to determine the optimal threshold of the proposed denoising algorithm. We compare our method with other state-of-the-art methods and report very encouraging results on applications utilizing both synthetic and real data.

Live neuron morphology automatically reconstructed from multiphoton and confocal imaging data.

We have developed a fully automated procedure for extracting dendritic morphology from multiple three-dimensional image stacks produced by laser scanning microscopy. By eliminating human intervention, we ensure that the results are objective, quickly generated, and accurate. The software suite accounts for typical experimental conditions by reducing background noise, removing pipette artifacts, and aligning multiple overlapping image stacks. The output morphology is appropriate for simulation in compartmental simulation environments. In this report, we validate the utility of this procedure by comparing its performance on live neurons and test specimens with other fully and semiautomated reconstruction tools.

Flexible fitting in 3D-EM guided by the structural variability of protein superfamilies.

A method for flexible fitting of molecular models into three-dimensional electron microscopy (3D-EM) reconstructions at a resolution range of 8-12 A is proposed. The approach uses the evolutionarily related structural variability existing among the protein domains of a given superfamily, according to structural databases such as CATH. A structural alignment of domains belonging to the superfamily, followed by a principal components analysis, is performed, and the first three principal components of the decomposition are explored. Using rigid body transformations for the secondary structure elements (SSEs) plus the cyclic coordinate descent algorithm to close the loops, stereochemically correct models are built for the structure to fit. All of the models are fitted into the 3D-EM map, and the best one is selected based on crosscorrelation measures. This work applies the method to both simulated and experimental data and shows that the flexible fitting was able to produce better results than rigid body fitting.

Frames-Based Denoising in 3D Confocal Microscopy Imaging.

In this paper, we propose a novel denoising method for 3D confocal microscopy data based on robust edge detection. Our approach relies on the construction of a non-separable frame system in 3D that incorporates the Sobel operator in dual spatial directions. This multidirectional set of digital filters is capable of robustly detecting edge information by ensemble thresholding of the filtered data. We demonstrate the application of our method to both synthetic and real confocal microscopy data by comparing it to denoising methods based on separable 3D wavelets and 3D median filtering, and report very encouraging results.